[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.004750 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:44043
I20260709 12:08:15.007091 24442 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.008538 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.029856 24449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.030122 24448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.031594 24451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.031479 24442 server_base.cc:1061] running on GCE node
I20260709 12:08:16.269042 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.269366 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.269660 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598896269623 us; error 0 us; skew 500 ppm
I20260709 12:08:16.270838 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.278326 24442 webserver.cc:533] Webserver started at http://127.23.222.190:43771/ using document root <none> and password file <none>
I20260709 12:08:16.279475 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.279740 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.280310 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.287592 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "17802fec7ccc40f0b6a31c3d651b883d"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-90bm"
I20260709 12:08:16.297446 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:08:16.304329 24457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.305945 24442 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:08:16.306427 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "17802fec7ccc40f0b6a31c3d651b883d"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-90bm"
I20260709 12:08:16.306785 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.385510 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.387418 24442 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:16.387986 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.475394 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:44043
I20260709 12:08:16.475482 24508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:44043 every 8 connection(s)
I20260709 12:08:16.484630 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.509841 24509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d: Bootstrap starting.
I20260709 12:08:16.516861 24509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.519142 24509 log.cc:826] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:16.524955 24509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d: No bootstrap required, opened a new log
I20260709 12:08:16.548776 24509 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17802fec7ccc40f0b6a31c3d651b883d" member_type: VOTER }
I20260709 12:08:16.549467 24509 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.549746 24509 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17802fec7ccc40f0b6a31c3d651b883d, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.550850 24509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17802fec7ccc40f0b6a31c3d651b883d" member_type: VOTER }
I20260709 12:08:16.551391 24509 raft_consensus.cc:399] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:16.551725 24509 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:16.552102 24509 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.556870 24509 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17802fec7ccc40f0b6a31c3d651b883d" member_type: VOTER }
I20260709 12:08:16.557782 24509 leader_election.cc:304] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17802fec7ccc40f0b6a31c3d651b883d; no voters: 
I20260709 12:08:16.559854 24509 leader_election.cc:290] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:16.560349 24512 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.563001 24512 raft_consensus.cc:697] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 1 LEADER]: Becoming Leader. State: Replica: 17802fec7ccc40f0b6a31c3d651b883d, State: Running, Role: LEADER
I20260709 12:08:16.564093 24512 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17802fec7ccc40f0b6a31c3d651b883d" member_type: VOTER }
I20260709 12:08:16.565385 24509 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:16.576400 24514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17802fec7ccc40f0b6a31c3d651b883d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17802fec7ccc40f0b6a31c3d651b883d" member_type: VOTER } }
I20260709 12:08:16.576751 24513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17802fec7ccc40f0b6a31c3d651b883d. Latest consensus state: current_term: 1 leader_uuid: "17802fec7ccc40f0b6a31c3d651b883d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17802fec7ccc40f0b6a31c3d651b883d" member_type: VOTER } }
I20260709 12:08:16.577482 24514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.577653 24513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.582695 24520 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:16.597677 24520 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:16.602559 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:16.618727 24520 catalog_manager.cc:1383] Generated new cluster ID: aaf0d284bcff47aeb227a5441cc97c82
I20260709 12:08:16.619119 24520 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:16.662770 24520 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:16.664698 24520 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:16.680333 24520 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d: Generated new TSK 0
I20260709 12:08:16.681730 24520 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:16.738977 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.750751 24531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.752077 24532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.757014 24442 server_base.cc:1061] running on GCE node
W20260709 12:08:16.757665 24535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.758726 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.758980 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.759168 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598896759132 us; error 0 us; skew 500 ppm
I20260709 12:08:16.759826 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.765139 24442 webserver.cc:533] Webserver started at http://127.23.222.129:36445/ using document root <none> and password file <none>
I20260709 12:08:16.765755 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.765986 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.766353 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.767767 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "13edd1c703304bf7b8f1e92b23e5b431"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-90bm"
I20260709 12:08:16.774730 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:08:16.779889 24539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.780942 24442 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:08:16.781339 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "13edd1c703304bf7b8f1e92b23e5b431"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-90bm"
I20260709 12:08:16.781741 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.803715 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.805836 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.808782 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.815469 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.815846 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.816200 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.816450 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.923718 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:40399
I20260709 12:08:16.923789 24601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:40399 every 8 connection(s)
I20260709 12:08:16.933012 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.944036 24606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.949944 24442 server_base.cc:1061] running on GCE node
W20260709 12:08:16.950824 24607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.951867 24609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.953459 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.953729 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.953950 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598896953928 us; error 0 us; skew 500 ppm
I20260709 12:08:16.954660 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.957828 24442 webserver.cc:533] Webserver started at http://127.23.222.130:45123/ using document root <none> and password file <none>
I20260709 12:08:16.958603 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.958897 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.959275 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.960992 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "1c30958831764b1795ecfaca0700f890"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-90bm"
I20260709 12:08:16.964332 24602 heartbeater.cc:344] Connected to a master server at 127.23.222.190:44043
I20260709 12:08:16.964910 24602 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.966226 24602 heartbeater.cc:507] Master 127.23.222.190:44043 requested a full tablet report, sending...
I20260709 12:08:16.968051 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:08:16.969760 24474 ts_manager.cc:194] Registered new tserver with Master: 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399)
I20260709 12:08:16.972661 24474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60904
I20260709 12:08:16.973829 24614 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.975076 24442 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:08:16.975428 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "1c30958831764b1795ecfaca0700f890"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-90bm"
I20260709 12:08:16.975826 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.004112 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.005658 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.008258 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.012161 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.012423 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.012687 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.012877 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.120582 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:43647
I20260709 12:08:17.120780 24676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:43647 every 8 connection(s)
I20260709 12:08:17.129415 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.143610 24681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.144858 24677 heartbeater.cc:344] Connected to a master server at 127.23.222.190:44043
I20260709 12:08:17.145292 24677 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.146458 24677 heartbeater.cc:507] Master 127.23.222.190:44043 requested a full tablet report, sending...
W20260709 12:08:17.149032 24680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.149354 24474 ts_manager.cc:194] Registered new tserver with Master: 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:17.151486 24474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60910
I20260709 12:08:17.152827 24442 server_base.cc:1061] running on GCE node
W20260709 12:08:17.153152 24684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.154721 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.155126 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.155375 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598897155351 us; error 0 us; skew 500 ppm
I20260709 12:08:17.155973 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.158828 24442 webserver.cc:533] Webserver started at http://127.23.222.131:37275/ using document root <none> and password file <none>
I20260709 12:08:17.159498 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.159760 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.160115 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.161686 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "81855d48d76443a7b74d2675de35d58b"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-90bm"
I20260709 12:08:17.166975 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 12:08:17.170907 24688 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.171753 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:08:17.172170 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "81855d48d76443a7b74d2675de35d58b"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-90bm"
I20260709 12:08:17.172535 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.214833 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.216478 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.218152 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.220831 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.221053 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.221395 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.221546 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.343480 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:35799
I20260709 12:08:17.343600 24750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:35799 every 8 connection(s)
I20260709 12:08:17.365880 24751 heartbeater.cc:344] Connected to a master server at 127.23.222.190:44043
I20260709 12:08:17.366412 24751 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.367337 24751 heartbeater.cc:507] Master 127.23.222.190:44043 requested a full tablet report, sending...
I20260709 12:08:17.369719 24474 ts_manager.cc:194] Registered new tserver with Master: 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:17.370162 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020360384s
I20260709 12:08:17.371767 24474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60916
I20260709 12:08:17.433893 24474 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60922:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:17.438244 24474 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:17.553387 24567 tablet_service.cc:1511] Processing CreateTablet for tablet 13af8e97d78841f6bf4f89b0c96b77c1 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.555521 24566 tablet_service.cc:1511] Processing CreateTablet for tablet 45ab4a43e4194072968eb8f4e8fd361f (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.556497 24565 tablet_service.cc:1511] Processing CreateTablet for tablet f3507ea6241e469a9fde08270a3bb43f (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.559738 24566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ab4a43e4194072968eb8f4e8fd361f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.560791 24567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13af8e97d78841f6bf4f89b0c96b77c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.562026 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3507ea6241e469a9fde08270a3bb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.564381 24564 tablet_service.cc:1511] Processing CreateTablet for tablet 0b71d65f95a146c3bf3505965bb11654 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.566427 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b71d65f95a146c3bf3505965bb11654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.577268 24563 tablet_service.cc:1511] Processing CreateTablet for tablet 38a881b250634de1a13889043bc8a2f1 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.579842 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a881b250634de1a13889043bc8a2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.585304 24562 tablet_service.cc:1511] Processing CreateTablet for tablet d89416d727fa418bad3549d99c294067 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
W20260709 12:08:17.592860 24522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.611336 24712 tablet_service.cc:1511] Processing CreateTablet for tablet 38a881b250634de1a13889043bc8a2f1 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.605064 24713 tablet_service.cc:1511] Processing CreateTablet for tablet 0b71d65f95a146c3bf3505965bb11654 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.615118 24714 tablet_service.cc:1511] Processing CreateTablet for tablet f3507ea6241e469a9fde08270a3bb43f (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.597472 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 13af8e97d78841f6bf4f89b0c96b77c1 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.617770 24715 tablet_service.cc:1511] Processing CreateTablet for tablet 45ab4a43e4194072968eb8f4e8fd361f (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.621392 24711 tablet_service.cc:1511] Processing CreateTablet for tablet d89416d727fa418bad3549d99c294067 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.623260 24562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89416d727fa418bad3549d99c294067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.614166 24712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a881b250634de1a13889043bc8a2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.632256 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13af8e97d78841f6bf4f89b0c96b77c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.633801 24714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3507ea6241e469a9fde08270a3bb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.635319 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ab4a43e4194072968eb8f4e8fd361f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.636955 24713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b71d65f95a146c3bf3505965bb11654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.655076 24561 tablet_service.cc:1511] Processing CreateTablet for tablet aed6b159755e4d50a6db838d1fb21379 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.656634 24561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed6b159755e4d50a6db838d1fb21379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.658804 24711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89416d727fa418bad3549d99c294067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.668200 24560 tablet_service.cc:1511] Processing CreateTablet for tablet d0233e9fe6df47d2a24de9bf731e9cf9 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.665788 24710 tablet_service.cc:1511] Processing CreateTablet for tablet aed6b159755e4d50a6db838d1fb21379 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.675595 24710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed6b159755e4d50a6db838d1fb21379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.679651 24560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0233e9fe6df47d2a24de9bf731e9cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.687274 24709 tablet_service.cc:1511] Processing CreateTablet for tablet d0233e9fe6df47d2a24de9bf731e9cf9 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.690023 24709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0233e9fe6df47d2a24de9bf731e9cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.719329 24559 tablet_service.cc:1511] Processing CreateTablet for tablet e75f48c8313647259b0903aa5a980c70 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.721005 24559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75f48c8313647259b0903aa5a980c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.731686 24769 tablet_bootstrap.cc:492] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:17.759626 24642 tablet_service.cc:1511] Processing CreateTablet for tablet 13af8e97d78841f6bf4f89b0c96b77c1 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.769485 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13af8e97d78841f6bf4f89b0c96b77c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.773834 24640 tablet_service.cc:1511] Processing CreateTablet for tablet f3507ea6241e469a9fde08270a3bb43f (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.770661 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 0b71d65f95a146c3bf3505965bb11654 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.769269 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 45ab4a43e4194072968eb8f4e8fd361f (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.782642 24640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3507ea6241e469a9fde08270a3bb43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.780395 24638 tablet_service.cc:1511] Processing CreateTablet for tablet 38a881b250634de1a13889043bc8a2f1 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.794050 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b71d65f95a146c3bf3505965bb11654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.805260 24636 tablet_service.cc:1511] Processing CreateTablet for tablet aed6b159755e4d50a6db838d1fb21379 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.794109 24637 tablet_service.cc:1511] Processing CreateTablet for tablet d89416d727fa418bad3549d99c294067 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.813776 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45ab4a43e4194072968eb8f4e8fd361f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.814332 24635 tablet_service.cc:1511] Processing CreateTablet for tablet d0233e9fe6df47d2a24de9bf731e9cf9 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.822986 24636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed6b159755e4d50a6db838d1fb21379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.824249 24634 tablet_service.cc:1511] Processing CreateTablet for tablet e75f48c8313647259b0903aa5a980c70 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.827426 24635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0233e9fe6df47d2a24de9bf731e9cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.830116 24637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89416d727fa418bad3549d99c294067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.835822 24634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75f48c8313647259b0903aa5a980c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.864231 24638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a881b250634de1a13889043bc8a2f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.878630 24708 tablet_service.cc:1511] Processing CreateTablet for tablet e75f48c8313647259b0903aa5a980c70 (DEFAULT_TABLE table=test-workload [id=cadd8e7cf6f34eeb8c31a880c6ef4927]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.884068 24708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e75f48c8313647259b0903aa5a980c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.899178 24769 tablet_bootstrap.cc:654] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.930227 24770 tablet_bootstrap.cc:492] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:17.939195 24769 tablet_bootstrap.cc:492] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:17.948637 24769 ts_tablet_manager.cc:1403] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.217s	user 0.019s	sys 0.004s
I20260709 12:08:17.962447 24769 raft_consensus.cc:359] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:17.963454 24769 raft_consensus.cc:385] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.963832 24769 raft_consensus.cc:740] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.968652 24769 consensus_queue.cc:260] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:17.977172 24602 heartbeater.cc:499] Master 127.23.222.190:44043 was elected leader, sending a full tablet report...
I20260709 12:08:18.000274 24769 ts_tablet_manager.cc:1434] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.051s	user 0.019s	sys 0.011s
I20260709 12:08:18.001917 24772 tablet_bootstrap.cc:492] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.005044 24770 tablet_bootstrap.cc:654] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.002466 24769 tablet_bootstrap.cc:492] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.015939 24770 tablet_bootstrap.cc:492] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.016521 24770 ts_tablet_manager.cc:1403] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.006s
I20260709 12:08:18.020153 24770 raft_consensus.cc:359] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.020994 24770 raft_consensus.cc:385] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.021315 24770 raft_consensus.cc:740] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.021997 24770 consensus_queue.cc:260] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.024684 24772 tablet_bootstrap.cc:654] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.025516 24751 heartbeater.cc:499] Master 127.23.222.190:44043 was elected leader, sending a full tablet report...
I20260709 12:08:18.026108 24770 ts_tablet_manager.cc:1434] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.006s
I20260709 12:08:18.027187 24770 tablet_bootstrap.cc:492] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.027604 24769 tablet_bootstrap.cc:654] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.036612 24770 tablet_bootstrap.cc:654] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.052601 24772 tablet_bootstrap.cc:492] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.053328 24772 ts_tablet_manager.cc:1403] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.026s
I20260709 12:08:18.058640 24770 tablet_bootstrap.cc:492] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.058898 24769 tablet_bootstrap.cc:492] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.059270 24770 ts_tablet_manager.cc:1403] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.016s
I20260709 12:08:18.058982 24772 raft_consensus.cc:359] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.059943 24772 raft_consensus.cc:385] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.060249 24772 raft_consensus.cc:740] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.061221 24772 consensus_queue.cc:260] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.062660 24770 raft_consensus.cc:359] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.063416 24770 raft_consensus.cc:385] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.063771 24770 raft_consensus.cc:740] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.059580 24769 ts_tablet_manager.cc:1403] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.009s
I20260709 12:08:18.064628 24770 consensus_queue.cc:260] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.067767 24770 ts_tablet_manager.cc:1434] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:08:18.068859 24770 tablet_bootstrap.cc:492] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.076368 24770 tablet_bootstrap.cc:654] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.068205 24769 raft_consensus.cc:359] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.087838 24769 raft_consensus.cc:385] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.088577 24769 raft_consensus.cc:740] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.089780 24769 consensus_queue.cc:260] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.092974 24677 heartbeater.cc:499] Master 127.23.222.190:44043 was elected leader, sending a full tablet report...
I20260709 12:08:18.093274 24770 tablet_bootstrap.cc:492] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.093796 24770 ts_tablet_manager.cc:1403] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.013s
I20260709 12:08:18.094692 24769 ts_tablet_manager.cc:1434] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:08:18.095831 24769 tablet_bootstrap.cc:492] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.097752 24772 ts_tablet_manager.cc:1434] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.044s	user 0.024s	sys 0.015s
I20260709 12:08:18.098927 24772 tablet_bootstrap.cc:492] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
W20260709 12:08:18.103199 24752 tablet.cc:2406] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:18.104018 24769 tablet_bootstrap.cc:654] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.107650 24772 tablet_bootstrap.cc:654] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.108400 24770 raft_consensus.cc:359] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.109228 24770 raft_consensus.cc:385] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.109314 24775 raft_consensus.cc:493] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.109609 24770 raft_consensus.cc:740] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.109823 24775 raft_consensus.cc:515] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.110458 24770 consensus_queue.cc:260] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.113476 24775 leader_election.cc:290] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.138471 24772 tablet_bootstrap.cc:492] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.139079 24772 ts_tablet_manager.cc:1403] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.017s
I20260709 12:08:18.139947 24769 tablet_bootstrap.cc:492] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.140450 24769 ts_tablet_manager.cc:1403] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.005s
I20260709 12:08:18.142329 24772 raft_consensus.cc:359] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.143155 24772 raft_consensus.cc:385] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.143414 24770 ts_tablet_manager.cc:1434] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.049s	user 0.018s	sys 0.006s
I20260709 12:08:18.143471 24772 raft_consensus.cc:740] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.144554 24770 tablet_bootstrap.cc:492] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.144317 24772 consensus_queue.cc:260] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.146682 24772 ts_tablet_manager.cc:1434] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:18.143862 24769 raft_consensus.cc:359] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.147809 24772 tablet_bootstrap.cc:492] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.148017 24769 raft_consensus.cc:385] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.148384 24769 raft_consensus.cc:740] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.149192 24769 consensus_queue.cc:260] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.156893 24770 tablet_bootstrap.cc:654] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.163465 24772 tablet_bootstrap.cc:654] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.167176 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
W20260709 12:08:18.169517 24689 leader_election.cc:343] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.172348 24769 ts_tablet_manager.cc:1434] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 12:08:18.173565 24769 tablet_bootstrap.cc:492] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.183383 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
W20260709 12:08:18.185545 24692 leader_election.cc:343] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.186234 24692 leader_election.cc:304] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81855d48d76443a7b74d2675de35d58b; no voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890
I20260709 12:08:18.188093 24783 raft_consensus.cc:2749] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.193889 24772 tablet_bootstrap.cc:492] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.194478 24772 ts_tablet_manager.cc:1403] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.006s
I20260709 12:08:18.194645 24769 tablet_bootstrap.cc:654] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.195477 24770 tablet_bootstrap.cc:492] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.196022 24770 ts_tablet_manager.cc:1403] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.031s
I20260709 12:08:18.197890 24772 raft_consensus.cc:359] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.198858 24772 raft_consensus.cc:385] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.199190 24772 raft_consensus.cc:740] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.199225 24770 raft_consensus.cc:359] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.200120 24770 raft_consensus.cc:385] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.200567 24770 raft_consensus.cc:740] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.200156 24772 consensus_queue.cc:260] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.201426 24770 consensus_queue.cc:260] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.203423 24772 ts_tablet_manager.cc:1434] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:08:18.204329 24770 ts_tablet_manager.cc:1434] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:08:18.204540 24772 tablet_bootstrap.cc:492] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.205404 24770 tablet_bootstrap.cc:492] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.213624 24770 tablet_bootstrap.cc:654] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.214535 24772 tablet_bootstrap.cc:654] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.231352 24769 tablet_bootstrap.cc:492] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.231913 24770 tablet_bootstrap.cc:492] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.231913 24769 ts_tablet_manager.cc:1403] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.012s
I20260709 12:08:18.232617 24770 ts_tablet_manager.cc:1403] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.010s
I20260709 12:08:18.233546 24772 tablet_bootstrap.cc:492] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.234048 24772 ts_tablet_manager.cc:1403] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.008s
I20260709 12:08:18.235513 24769 raft_consensus.cc:359] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.236279 24769 raft_consensus.cc:385] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.235858 24770 raft_consensus.cc:359] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.236601 24769 raft_consensus.cc:740] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.236783 24770 raft_consensus.cc:385] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.237360 24770 raft_consensus.cc:740] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.237427 24769 consensus_queue.cc:260] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.237162 24772 raft_consensus.cc:359] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.239333 24772 raft_consensus.cc:385] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.238996 24770 consensus_queue.cc:260] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.239673 24772 raft_consensus.cc:740] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.241076 24772 consensus_queue.cc:260] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.243285 24770 ts_tablet_manager.cc:1434] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:08:18.244432 24770 tablet_bootstrap.cc:492] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.248546 24772 ts_tablet_manager.cc:1434] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:08:18.249763 24772 tablet_bootstrap.cc:492] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.251754 24770 tablet_bootstrap.cc:654] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.260684 24779 raft_consensus.cc:493] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.261531 24779 raft_consensus.cc:515] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.266747 24779 leader_election.cc:290] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.271050 24772 tablet_bootstrap.cc:654] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.272511 24769 ts_tablet_manager.cc:1434] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:08:18.283104 24769 tablet_bootstrap.cc:492] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.287389 24770 tablet_bootstrap.cc:492] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.287822 24772 tablet_bootstrap.cc:492] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.292351 24769 tablet_bootstrap.cc:654] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.288199 24779 raft_consensus.cc:493] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.287956 24770 ts_tablet_manager.cc:1403] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.015s
I20260709 12:08:18.295542 24779 raft_consensus.cc:515] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.298614 24779 leader_election.cc:290] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.295176 24772 ts_tablet_manager.cc:1403] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.017s
I20260709 12:08:18.299532 24770 raft_consensus.cc:359] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.300297 24770 raft_consensus.cc:385] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.300593 24770 raft_consensus.cc:740] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.301455 24770 consensus_queue.cc:260] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.303905 24770 ts_tablet_manager.cc:1434] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:18.308528 24772 raft_consensus.cc:359] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.314677 24769 tablet_bootstrap.cc:492] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.314872 24772 raft_consensus.cc:385] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.315220 24769 ts_tablet_manager.cc:1403] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.008s
I20260709 12:08:18.315372 24772 raft_consensus.cc:740] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.316397 24772 consensus_queue.cc:260] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.321281 24772 ts_tablet_manager.cc:1434] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 12:08:18.322397 24772 tablet_bootstrap.cc:492] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.324715 24783 raft_consensus.cc:493] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.325296 24783 raft_consensus.cc:515] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.318612 24769 raft_consensus.cc:359] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.326419 24769 raft_consensus.cc:385] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.326777 24769 raft_consensus.cc:740] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.326829 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.312727 24770 tablet_bootstrap.cc:492] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.326140 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.328768 24783 leader_election.cc:290] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
W20260709 12:08:18.333518 24618 leader_election.cc:343] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:18.334283 24618 leader_election.cc:343] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.334383 24769 consensus_queue.cc:260] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.335836 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.337071 24769 ts_tablet_manager.cc:1434] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:08:18.344179 24769 tablet_bootstrap.cc:492] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
W20260709 12:08:18.344568 24618 leader_election.cc:343] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.338673 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.339294 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
W20260709 12:08:18.347113 24692 leader_election.cc:343] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.342197 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.348104 24652 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.345018 24618 leader_election.cc:304] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c30958831764b1795ecfaca0700f890; no voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:18.350014 24779 raft_consensus.cc:2749] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.341282 24772 tablet_bootstrap.cc:654] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.347024 24725 raft_consensus.cc:2468] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 0.
I20260709 12:08:18.350746 24689 leader_election.cc:304] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:18.354595 24618 leader_election.cc:304] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:18.355717 24783 raft_consensus.cc:2804] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.356294 24783 raft_consensus.cc:493] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.356838 24783 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.360564 24779 raft_consensus.cc:2804] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.361083 24779 raft_consensus.cc:493] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.361462 24779 raft_consensus.cc:3060] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.352401 24769 tablet_bootstrap.cc:654] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.353453 24770 tablet_bootstrap.cc:654] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.371184 24783 raft_consensus.cc:515] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.373658 24783 leader_election.cc:290] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.376114 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:18.378306 24772 tablet_bootstrap.cc:492] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.379335 24772 ts_tablet_manager.cc:1403] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.004s
I20260709 12:08:18.379823 24783 raft_consensus.cc:493] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:18.380002 24692 leader_election.cc:343] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.378027 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:18.380674 24783 raft_consensus.cc:515] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.381146 24652 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.385805 24783 leader_election.cc:290] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.388038 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.389163 24651 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.391099 24689 leader_election.cc:304] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.391820 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.391952 24783 raft_consensus.cc:2804] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.392577 24783 raft_consensus.cc:493] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.392546 24576 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.393209 24783 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.393942 24770 tablet_bootstrap.cc:492] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.394460 24770 ts_tablet_manager.cc:1403] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.018s
I20260709 12:08:18.394434 24772 raft_consensus.cc:359] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.395313 24772 raft_consensus.cc:385] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.395628 24772 raft_consensus.cc:740] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.396551 24772 consensus_queue.cc:260] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.401314 24779 raft_consensus.cc:515] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.405457 24772 ts_tablet_manager.cc:1434] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:08:18.406617 24783 raft_consensus.cc:515] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.408448 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:18.409039 24783 leader_election.cc:290] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.405465 24769 tablet_bootstrap.cc:492] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.410022 24769 ts_tablet_manager.cc:1403] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.004s
I20260709 12:08:18.410359 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:18.410727 24779 leader_election.cc:290] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.410974 24577 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.398801 24770 raft_consensus.cc:359] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.411794 24770 raft_consensus.cc:385] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.412108 24770 raft_consensus.cc:740] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.412902 24770 consensus_queue.cc:260] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.413470 24769 raft_consensus.cc:359] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.414480 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:18.415378 24769 raft_consensus.cc:385] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.415556 24651 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.415709 24769 raft_consensus.cc:740] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.417297 24770 ts_tablet_manager.cc:1434] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 12:08:18.418411 24770 tablet_bootstrap.cc:492] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.419073 24769 consensus_queue.cc:260] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.420735 24772 tablet_bootstrap.cc:492] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.426482 24770 tablet_bootstrap.cc:654] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.426570 24769 ts_tablet_manager.cc:1434] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
W20260709 12:08:18.429764 24618 leader_election.cc:343] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.432711 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:18.433521 24725 raft_consensus.cc:3060] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.442930 24783 raft_consensus.cc:493] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.443540 24783 raft_consensus.cc:515] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.446318 24783 leader_election.cc:290] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.448975 24772 tablet_bootstrap.cc:654] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.450497 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.451481 24650 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.453154 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.454232 24779 raft_consensus.cc:493] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.454908 24576 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.455402 24779 raft_consensus.cc:515] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.454195 24769 tablet_bootstrap.cc:492] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.455369 24689 leader_election.cc:304] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.458181 24779 leader_election.cc:290] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.460312 24783 raft_consensus.cc:2804] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.460723 24783 raft_consensus.cc:493] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.460682 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.461354 24783 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.461736 24576 raft_consensus.cc:2468] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 0.
I20260709 12:08:18.463629 24618 leader_election.cc:304] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:18.464529 24779 raft_consensus.cc:2804] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.465025 24779 raft_consensus.cc:493] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.465247 24770 tablet_bootstrap.cc:492] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.465466 24779 raft_consensus.cc:3060] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.465744 24770 ts_tablet_manager.cc:1403] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.006s
I20260709 12:08:18.470448 24651 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
I20260709 12:08:18.471534 24725 raft_consensus.cc:2468] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 1.
I20260709 12:08:18.474251 24577 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
I20260709 12:08:18.475564 24689 leader_election.cc:304] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.477823 24775 raft_consensus.cc:2804] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.487216 24775 raft_consensus.cc:697] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:18.487844 24770 raft_consensus.cc:359] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.488601 24770 raft_consensus.cc:385] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.488936 24770 raft_consensus.cc:740] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.490061 24770 consensus_queue.cc:260] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.488670 24775 consensus_queue.cc:237] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.493952 24769 tablet_bootstrap.cc:654] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.498965 24772 tablet_bootstrap.cc:492] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.499643 24772 ts_tablet_manager.cc:1403] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.005s
I20260709 12:08:18.504487 24772 raft_consensus.cc:359] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.505323 24769 tablet_bootstrap.cc:492] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.505540 24772 raft_consensus.cc:385] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.505970 24769 ts_tablet_manager.cc:1403] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.021s
I20260709 12:08:18.506006 24772 raft_consensus.cc:740] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.510977 24783 raft_consensus.cc:515] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.511567 24769 raft_consensus.cc:359] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.512259 24769 raft_consensus.cc:385] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.512555 24769 raft_consensus.cc:740] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.513394 24769 consensus_queue.cc:260] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.515298 24652 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
W20260709 12:08:18.515385 24692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40399, user_credentials={real_user=slave}} blocked reactor thread for 58363.7us
I20260709 12:08:18.516553 24618 leader_election.cc:304] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:18.517565 24689 leader_election.cc:304] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:18.517966 24801 raft_consensus.cc:2804] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.519579 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:18.520207 24577 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.523304 24770 ts_tablet_manager.cc:1434] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.057s	user 0.012s	sys 0.004s
I20260709 12:08:18.524273 24770 tablet_bootstrap.cc:492] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b: Bootstrap starting.
I20260709 12:08:18.526669 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:18.527411 24652 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.528422 24775 raft_consensus.cc:2804] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.528710 24769 ts_tablet_manager.cc:1434] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.007s
I20260709 12:08:18.529253 24775 raft_consensus.cc:697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:18.529807 24769 tablet_bootstrap.cc:492] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.530354 24775 consensus_queue.cc:237] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.508509 24772 consensus_queue.cc:260] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.538728 24770 tablet_bootstrap.cc:654] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.540143 24773 raft_consensus.cc:493] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.540650 24773 raft_consensus.cc:515] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.543744 24773 leader_election.cc:290] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.547658 24772 ts_tablet_manager.cc:1434] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.010s
I20260709 12:08:18.549374 24772 tablet_bootstrap.cc:492] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
I20260709 12:08:18.513391 24783 leader_election.cc:290] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.556859 24772 tablet_bootstrap.cc:654] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.556536 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.557454 24783 raft_consensus.cc:493] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.558048 24783 raft_consensus.cc:515] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
W20260709 12:08:18.558511 24618 leader_election.cc:343] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.561815 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.562567 24651 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.564196 24689 leader_election.cc:304] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.565091 24775 raft_consensus.cc:2804] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.565474 24775 raft_consensus.cc:493] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.565822 24775 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.566921 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431" is_pre_election: true
I20260709 12:08:18.567616 24576 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 0.
I20260709 12:08:18.571091 24783 leader_election.cc:290] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.552817 24472 catalog_manager.cc:5697] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 1 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.578177 24801 raft_consensus.cc:697] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:18.579476 24770 tablet_bootstrap.cc:492] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b: No bootstrap required, opened a new log
I20260709 12:08:18.580067 24770 ts_tablet_manager.cc:1403] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.004s
I20260709 12:08:18.583206 24769 tablet_bootstrap.cc:654] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.579419 24801 consensus_queue.cc:237] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.587240 24770 raft_consensus.cc:359] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.587922 24770 raft_consensus.cc:385] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.588215 24770 raft_consensus.cc:740] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.589166 24772 tablet_bootstrap.cc:492] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.589654 24772 ts_tablet_manager.cc:1403] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.003s
I20260709 12:08:18.589790 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.594347 24725 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 0.
I20260709 12:08:18.601724 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.602885 24773 raft_consensus.cc:493] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.603581 24773 raft_consensus.cc:515] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
W20260709 12:08:18.604566 24522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.602402 24770 consensus_queue.cc:260] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.611208 24577 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
I20260709 12:08:18.611253 24779 raft_consensus.cc:515] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.611855 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.612691 24650 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 0.
I20260709 12:08:18.613765 24779 leader_election.cc:290] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.614528 24775 raft_consensus.cc:515] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.616815 24775 leader_election.cc:290] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:18.607195 24543 leader_election.cc:304] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.623080 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:18.624279 24577 raft_consensus.cc:3060] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.625070 24540 leader_election.cc:304] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:18.631349 24770 ts_tablet_manager.cc:1434] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:08:18.637461 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:18.638124 24725 raft_consensus.cc:3060] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.627547 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:18.643301 24772 raft_consensus.cc:359] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.644213 24772 raft_consensus.cc:385] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.644507 24773 leader_election.cc:290] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.644585 24772 raft_consensus.cc:740] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.645192 24773 raft_consensus.cc:2804] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.645750 24773 raft_consensus.cc:493] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.645437 24772 consensus_queue.cc:260] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.643447 24650 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.646642 24773 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.656737 24772 ts_tablet_manager.cc:1434] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 12:08:18.658146 24772 tablet_bootstrap.cc:492] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: Bootstrap starting.
W20260709 12:08:18.656107 24540 leader_election.cc:343] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.663959 24818 raft_consensus.cc:2804] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:08:18.663841 24543 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:35799, user_credentials={real_user=slave}} blocked reactor thread for 57229.3us
I20260709 12:08:18.664427 24818 raft_consensus.cc:493] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.665360 24818 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.665424 24692 leader_election.cc:304] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.668375 24775 raft_consensus.cc:2804] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.669313 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.672899 24775 raft_consensus.cc:697] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:18.674520 24775 consensus_queue.cc:237] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.677304 24769 tablet_bootstrap.cc:492] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.677878 24769 ts_tablet_manager.cc:1403] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.148s	user 0.005s	sys 0.015s
I20260709 12:08:18.671552 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:18.678725 24576 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.677416 24726 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 0.
I20260709 12:08:18.684262 24769 raft_consensus.cc:359] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.684969 24769 raft_consensus.cc:385] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.688541 24769 raft_consensus.cc:740] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.689304 24769 consensus_queue.cc:260] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.691440 24769 ts_tablet_manager.cc:1434] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:08:18.692531 24772 tablet_bootstrap.cc:654] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.693498 24769 tablet_bootstrap.cc:492] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431: Bootstrap starting.
I20260709 12:08:18.721638 24652 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
I20260709 12:08:18.721732 24818 raft_consensus.cc:515] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.728368 24817 raft_consensus.cc:493] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.729163 24817 raft_consensus.cc:515] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.723685 24773 raft_consensus.cc:515] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.723599 24577 raft_consensus.cc:2468] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 1.
I20260709 12:08:18.735737 24773 leader_election.cc:290] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.736429 24618 leader_election.cc:304] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:18.721223 24650 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
I20260709 12:08:18.739972 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:18.740758 24801 raft_consensus.cc:2804] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.742815 24801 raft_consensus.cc:697] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:18.746642 24689 leader_election.cc:304] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:18.743188 24652 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.746985 24801 consensus_queue.cc:237] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.749585 24775 raft_consensus.cc:2804] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.747998 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:18.751972 24726 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.751850 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:18.752508 24650 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.748008 24818 leader_election.cc:290] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.756031 24473 catalog_manager.cc:5697] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.753091 24775 raft_consensus.cc:697] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:18.759344 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:18.760721 24724 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.761579 24817 leader_election.cc:290] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.771466 24723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.774170 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.761811 24775 consensus_queue.cc:237] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.776949 24723 raft_consensus.cc:2393] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13edd1c703304bf7b8f1e92b23e5b431 in current term 1: Already voted for candidate 1c30958831764b1795ecfaca0700f890 in this term.
I20260709 12:08:18.780340 24769 tablet_bootstrap.cc:654] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.783593 24772 tablet_bootstrap.cc:492] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: No bootstrap required, opened a new log
I20260709 12:08:18.784075 24772 ts_tablet_manager.cc:1403] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.004s
I20260709 12:08:18.786648 24543 leader_election.cc:304] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431; no voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:18.790490 24817 raft_consensus.cc:3060] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.791672 24772 raft_consensus.cc:359] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.792399 24772 raft_consensus.cc:385] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.792693 24772 raft_consensus.cc:740] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.793217 24769 tablet_bootstrap.cc:492] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431: No bootstrap required, opened a new log
I20260709 12:08:18.793627 24772 consensus_queue.cc:260] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.796586 24769 ts_tablet_manager.cc:1403] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.000s
I20260709 12:08:18.799224 24772 ts_tablet_manager.cc:1434] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:08:18.799911 24769 raft_consensus.cc:359] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.800628 24769 raft_consensus.cc:385] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.800932 24769 raft_consensus.cc:740] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.802222 24769 consensus_queue.cc:260] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.804301 24769 ts_tablet_manager.cc:1434] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:18.812907 24652 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 1.
I20260709 12:08:18.813067 24725 raft_consensus.cc:2468] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 1.
I20260709 12:08:18.814213 24650 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 1.
I20260709 12:08:18.819628 24576 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 1.
I20260709 12:08:18.822129 24540 leader_election.cc:304] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:18.823024 24818 raft_consensus.cc:493] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.824509 24822 raft_consensus.cc:2804] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.823582 24818 raft_consensus.cc:515] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.826449 24822 raft_consensus.cc:697] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:18.823189 24540 leader_election.cc:304] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:18.828630 24822 consensus_queue.cc:237] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.828964 24818 leader_election.cc:290] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.830276 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.833387 24818 raft_consensus.cc:2804] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.834120 24818 raft_consensus.cc:697] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:18.834183 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.835120 24650 raft_consensus.cc:2393] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13edd1c703304bf7b8f1e92b23e5b431 in current term 1: Already voted for candidate 81855d48d76443a7b74d2675de35d58b in this term.
I20260709 12:08:18.835181 24818 consensus_queue.cc:237] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.836922 24540 leader_election.cc:304] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431; no voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:18.838030 24773 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.839051 24471 catalog_manager.cc:5697] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.852978 24818 raft_consensus.cc:493] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.853760 24818 raft_consensus.cc:515] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:18.858009 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890" is_pre_election: true
I20260709 12:08:18.858767 24650 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 0.
I20260709 12:08:18.864078 24540 leader_election.cc:304] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:18.865672 24832 raft_consensus.cc:2804] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.866061 24832 raft_consensus.cc:493] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.866391 24832 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.868055 24818 leader_election.cc:290] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:18.869141 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b" is_pre_election: true
I20260709 12:08:18.868242 24471 catalog_manager.cc:5697] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.869762 24725 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 0.
I20260709 12:08:18.885396 24471 catalog_manager.cc:5697] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.914835 24817 raft_consensus.cc:2749] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.915164 24724 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 1.
I20260709 12:08:18.914835 24726 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 1.
I20260709 12:08:18.927064 24471 catalog_manager.cc:5697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 1 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.928586 24471 catalog_manager.cc:5697] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 1 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.929855 24471 catalog_manager.cc:5697] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 0 to 1, leader changed from <none> to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 1 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.970487 24775 consensus_queue.cc:1048] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.988430 24775 consensus_queue.cc:1048] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.019191 24773 raft_consensus.cc:2749] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.019414 24832 raft_consensus.cc:515] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.022893 24832 leader_election.cc:290] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.023696 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:19.024398 24650 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.024224 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.024906 24726 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.031797 24726 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 1.
I20260709 12:08:19.031797 24650 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 1.
I20260709 12:08:19.033356 24543 leader_election.cc:304] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:19.034089 24832 raft_consensus.cc:2804] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.034641 24832 raft_consensus.cc:697] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:19.035404 24832 consensus_queue.cc:237] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.043785 24801 consensus_queue.cc:1048] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.044517 24473 catalog_manager.cc:5697] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.063928 24775 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.071981 24779 consensus_queue.cc:1048] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.085093 24775 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.088728 24775 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.114022 24783 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.151109 24779 consensus_queue.cc:1048] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.168429 24801 consensus_queue.cc:1048] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.201900 24775 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.203186 24783 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.209868 24832 consensus_queue.cc:1048] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.232160 24817 consensus_queue.cc:1048] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.295857 24773 consensus_queue.cc:1048] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.310218 24817 consensus_queue.cc:1048] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.374488 24724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
mode: GRACEFUL
new_leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:59730
I20260709 12:08:19.375185 24724 raft_consensus.cc:606] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Received request to transfer leadership to TS 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:19.381325 24724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
mode: GRACEFUL
new_leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:59730
I20260709 12:08:19.381938 24724 raft_consensus.cc:606] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Received request to transfer leadership to TS 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:19.388195 24724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
mode: GRACEFUL
new_leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:59730
I20260709 12:08:19.388803 24724 raft_consensus.cc:606] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Received request to transfer leadership to TS 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:19.411773 24577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d89416d727fa418bad3549d99c294067"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:44188
I20260709 12:08:19.412775 24577 raft_consensus.cc:606] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:19.420907 24577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:44188
I20260709 12:08:19.421089 24783 raft_consensus.cc:993] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: : Instructing follower 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:19.421532 24577 raft_consensus.cc:606] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:19.421646 24783 raft_consensus.cc:1081] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Signalling peer 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:19.423633 24577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:08:19.424243 24577 raft_consensus.cc:493] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.424578 24577 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.427992 24724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:59730
I20260709 12:08:19.428714 24724 raft_consensus.cc:606] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:19.430788 24577 raft_consensus.cc:515] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.435073 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.435942 24724 raft_consensus.cc:3055] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.436264 24724 raft_consensus.cc:740] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:19.437063 24724 consensus_queue.cc:260] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.438740 24724 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.435073 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:19.442512 24577 leader_election.cc:290] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.442658 24650 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.449649 24650 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:19.451314 24540 leader_election.cc:304] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:19.452360 24817 raft_consensus.cc:2804] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.452451 24724 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:19.452929 24817 raft_consensus.cc:697] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:19.453894 24817 consensus_queue.cc:237] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.458315 24650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:58910
I20260709 12:08:19.458959 24650 raft_consensus.cc:606] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Received request to transfer leadership to TS 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:19.463497 24473 catalog_manager.cc:5697] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 1 to 2, leader changed from 81855d48d76443a7b74d2675de35d58b (127.23.222.131) to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.480046 24804 raft_consensus.cc:993] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: : Instructing follower 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:19.480533 24783 raft_consensus.cc:1081] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Signalling peer 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:19.482178 24577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:08:19.482760 24577 raft_consensus.cc:493] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.483083 24577 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.489696 24577 raft_consensus.cc:515] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.491505 24577 leader_election.cc:290] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.492619 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:19.492735 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.493309 24650 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.493394 24724 raft_consensus.cc:3055] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.493781 24724 raft_consensus.cc:740] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:19.494683 24724 consensus_queue.cc:260] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.496006 24724 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.498808 24650 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:19.499965 24540 leader_election.cc:304] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:19.500921 24817 raft_consensus.cc:2804] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.501398 24817 raft_consensus.cc:697] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:19.502152 24817 consensus_queue.cc:237] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.503849 24724 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:19.511051 24473 catalog_manager.cc:5697] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 1 to 2, leader changed from 81855d48d76443a7b74d2675de35d58b (127.23.222.131) to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.543290 24817 consensus_queue.cc:1048] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.556452 24817 consensus_queue.cc:1048] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.643877 24846 raft_consensus.cc:993] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:19.644377 24801 raft_consensus.cc:1081] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Signalling peer 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:19.645978 24724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:08:19.646596 24724 raft_consensus.cc:493] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.646951 24724 raft_consensus.cc:3060] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.656666 24724 raft_consensus.cc:515] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.658926 24724 leader_election.cc:290] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 2 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:19.660089 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:19.660632 24577 raft_consensus.cc:3060] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.661953 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e75f48c8313647259b0903aa5a980c70" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:19.662609 24650 raft_consensus.cc:3055] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.662914 24650 raft_consensus.cc:740] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:19.663735 24650 consensus_queue.cc:260] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.664983 24650 raft_consensus.cc:3060] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.671473 24577 raft_consensus.cc:2468] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 2.
I20260709 12:08:19.672390 24650 raft_consensus.cc:2468] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 2.
I20260709 12:08:19.674662 24692 leader_election.cc:304] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:19.675673 24817 raft_consensus.cc:993] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:19.676118 24817 raft_consensus.cc:1081] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:19.678239 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58898
I20260709 12:08:19.678879 24652 raft_consensus.cc:493] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.679242 24652 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.676246 24783 raft_consensus.cc:2804] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.680930 24804 raft_consensus.cc:993] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:19.681054 24783 raft_consensus.cc:697] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 2 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:19.681504 24775 raft_consensus.cc:1081] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:19.682018 24783 consensus_queue.cc:237] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.686704 24650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58890
I20260709 12:08:19.687562 24650 raft_consensus.cc:493] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.688012 24650 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.693554 24473 catalog_manager.cc:5697] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 1 to 2, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 2 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.696362 24650 raft_consensus.cc:515] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.696899 24652 raft_consensus.cc:515] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.699033 24652 leader_election.cc:290] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.700300 24650 leader_election.cc:290] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.701828 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:19.702445 24577 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.702877 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.703146 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.703441 24724 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.703730 24726 raft_consensus.cc:3055] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.704046 24726 raft_consensus.cc:740] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:19.704885 24726 consensus_queue.cc:260] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.706035 24726 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.706670 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:19.707247 24576 raft_consensus.cc:3055] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.707537 24576 raft_consensus.cc:740] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:19.708765 24576 consensus_queue.cc:260] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.710230 24577 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:19.711498 24618 leader_election.cc:304] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:19.712364 24801 raft_consensus.cc:2804] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.712683 24576 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.712842 24801 raft_consensus.cc:697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:19.713743 24801 consensus_queue.cc:237] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.715996 24726 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:19.721474 24576 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:19.722793 24724 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:19.727224 24473 catalog_manager.cc:5697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 1 to 2, leader changed from 81855d48d76443a7b74d2675de35d58b (127.23.222.131) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.730659 24618 leader_election.cc:304] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:19.732654 24801 raft_consensus.cc:2804] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.733430 24801 raft_consensus.cc:697] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:19.734361 24801 consensus_queue.cc:237] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.746156 24473 catalog_manager.cc:5697] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 1 to 2, leader changed from 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.853751 24860 raft_consensus.cc:993] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: : Instructing follower 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:19.854380 24804 raft_consensus.cc:1081] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Signalling peer 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:19.856564 24576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:44160
I20260709 12:08:19.857230 24576 raft_consensus.cc:493] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.857641 24576 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.863119 24576 raft_consensus.cc:515] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.865049 24576 leader_election.cc:290] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.865927 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:19.866328 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.866603 24650 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.867167 24724 raft_consensus.cc:3055] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.867478 24724 raft_consensus.cc:740] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:19.868257 24724 consensus_queue.cc:260] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.869225 24724 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.874362 24724 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:19.874358 24650 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:19.875883 24540 leader_election.cc:304] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:19.876664 24832 raft_consensus.cc:2804] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.877178 24832 raft_consensus.cc:697] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:19.878024 24832 consensus_queue.cc:237] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.888016 24473 catalog_manager.cc:5697] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 1 to 2, leader changed from 81855d48d76443a7b74d2675de35d58b (127.23.222.131) to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.904744 24817 raft_consensus.cc:993] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:19.905304 24817 raft_consensus.cc:1081] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:19.907107 24650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d89416d727fa418bad3549d99c294067"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58898
I20260709 12:08:19.907729 24650 raft_consensus.cc:493] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.908103 24650 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.914165 24650 raft_consensus.cc:515] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.916361 24650 leader_election.cc:290] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:19.917240 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:19.917654 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:19.917927 24576 raft_consensus.cc:3055] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.918375 24724 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.918361 24576 raft_consensus.cc:740] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:19.919588 24576 consensus_queue.cc:260] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.920890 24576 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.926688 24724 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:19.928086 24618 leader_election.cc:304] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:19.928375 24576 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:19.930534 24801 raft_consensus.cc:2804] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.930989 24801 raft_consensus.cc:697] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:19.931864 24801 consensus_queue.cc:237] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:19.934527 24724 raft_consensus.cc:1275] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.936022 24832 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.939921 24473 catalog_manager.cc:5697] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 1 to 2, leader changed from 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.948204 24650 raft_consensus.cc:1275] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.950632 24832 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:20.048557 24724 raft_consensus.cc:1275] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.049993 24832 consensus_queue.cc:1048] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.062259 24650 raft_consensus.cc:1275] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.063890 24832 consensus_queue.cc:1048] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.104377 24650 raft_consensus.cc:1275] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.105741 24804 consensus_queue.cc:1048] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.114166 24576 raft_consensus.cc:1275] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.115942 24860 consensus_queue.cc:1048] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.133626 24724 raft_consensus.cc:1275] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.135308 24801 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.145098 24576 raft_consensus.cc:1275] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.148279 24808 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.220939 24576 raft_consensus.cc:1275] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.222662 24808 consensus_queue.cc:1048] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.231257 24724 raft_consensus.cc:1275] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.232874 24808 consensus_queue.cc:1048] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.326551 24576 raft_consensus.cc:1275] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.328121 24846 consensus_queue.cc:1048] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.337946 24724 raft_consensus.cc:1275] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.339546 24808 consensus_queue.cc:1048] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.352626 24724 raft_consensus.cc:1275] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.354245 24818 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.364284 24650 raft_consensus.cc:1275] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.365945 24862 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:22.493637 24442 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:22.494699 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.517156 24650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:58922
I20260709 12:08:22.517724 24650 raft_consensus.cc:606] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Received request to transfer leadership to TS 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:22.530329 24576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
mode: GRACEFUL
new_leader_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:44204
I20260709 12:08:22.530892 24576 raft_consensus.cc:606] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Received request to transfer leadership to TS 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:22.532241 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:22.532838 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.939325 24818 raft_consensus.cc:993] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: : Instructing follower 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:22.939859 24878 raft_consensus.cc:1081] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Signalling peer 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:22.941486 24726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:59714
I20260709 12:08:22.941992 24726 raft_consensus.cc:493] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.942309 24726 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.948755 24726 raft_consensus.cc:515] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:22.950711 24726 leader_election.cc:290] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:22.951735 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:22.951900 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:22.952430 24650 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.952407 24576 raft_consensus.cc:3055] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.952956 24576 raft_consensus.cc:740] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:22.953816 24576 consensus_queue.cc:260] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:22.955114 24576 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.959794 24650 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:22.961320 24689 leader_election.cc:304] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:22.962237 24872 raft_consensus.cc:2804] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.962415 24576 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:22.963960 24872 raft_consensus.cc:697] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:22.964772 24872 consensus_queue.cc:237] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:22.972996 24473 catalog_manager.cc:5697] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 2 to 3, leader changed from 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129) to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 3 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:23.093714 24873 raft_consensus.cc:993] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:23.094332 24877 raft_consensus.cc:1081] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Signalling peer 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:23.096381 24726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:08:23.097041 24726 raft_consensus.cc:493] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:23.097483 24726 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.102834 24726 raft_consensus.cc:515] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:23.104488 24726 leader_election.cc:290] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:23.105548 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:23.105842 24650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:23.106125 24576 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.106624 24650 raft_consensus.cc:3055] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:23.106977 24650 raft_consensus.cc:740] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:23.107601 24650 consensus_queue.cc:260] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:23.108490 24650 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.111624 24576 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:23.112902 24692 leader_election.cc:304] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:23.113488 24650 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:23.113945 24872 raft_consensus.cc:2804] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:23.114534 24872 raft_consensus.cc:697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:23.115336 24872 consensus_queue.cc:237] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:23.122153 24473 catalog_manager.cc:5697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 2 to 3, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 3 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:23.519742 24650 raft_consensus.cc:1275] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.521310 24872 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.534528 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.539680 24576 raft_consensus.cc:1275] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.541226 24888 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.542868 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.543322 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.585268 24650 raft_consensus.cc:1275] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.586807 24888 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.590000 24576 raft_consensus.cc:1275] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.591519 24888 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:24.544481 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.550426 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.550925 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.552058 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.558542 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.558990 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.560127 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.565199 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.565651 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.566987 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.572463 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.573035 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.574412 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.579898 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.580379 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.581295 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.586771 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.587179 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.588253 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.593868 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.594288 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.595279 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.600121 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.600512 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.633080 24442 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:32.638517 24576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:44188
I20260709 12:08:32.639256 24576 raft_consensus.cc:606] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:32.644843 24576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:44188
I20260709 12:08:32.645427 24576 raft_consensus.cc:606] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:32.651706 24725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:59730
I20260709 12:08:32.652287 24725 raft_consensus.cc:606] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:32.658113 24576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:44188
I20260709 12:08:32.658720 24576 raft_consensus.cc:606] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:32.673770 24725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
mode: GRACEFUL
new_leader_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:59730
I20260709 12:08:32.674374 24725 raft_consensus.cc:606] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Received request to transfer leadership to TS 1c30958831764b1795ecfaca0700f890
I20260709 12:08:32.924422 24902 raft_consensus.cc:993] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:32.925614 24907 raft_consensus.cc:993] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:32.925765 24908 raft_consensus.cc:1081] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:32.926296 24907 raft_consensus.cc:1081] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:32.927912 24650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58890
I20260709 12:08:32.928526 24650 raft_consensus.cc:493] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.928365 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58890
I20260709 12:08:32.929069 24650 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.929342 24652 raft_consensus.cc:493] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.929806 24652 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.934327 24650 raft_consensus.cc:515] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:32.935510 24652 raft_consensus.cc:515] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:32.936393 24650 leader_election.cc:290] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 4 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:32.937770 24652 leader_election.cc:290] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 4 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:32.938598 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:32.938709 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:32.937623 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3507ea6241e469a9fde08270a3bb43f" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:32.939286 24725 raft_consensus.cc:3055] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.939373 24577 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.939334 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0233e9fe6df47d2a24de9bf731e9cf9" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:32.939967 24576 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.939899 24725 raft_consensus.cc:740] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:32.940373 24726 raft_consensus.cc:3055] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.940711 24726 raft_consensus.cc:740] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:32.941115 24725 consensus_queue.cc:260] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:32.941452 24726 consensus_queue.cc:260] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:32.942663 24725 raft_consensus.cc:3060] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.943040 24726 raft_consensus.cc:3060] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.948292 24576 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 4.
I20260709 12:08:32.948783 24577 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 4.
I20260709 12:08:32.950280 24618 leader_election.cc:304] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:32.950562 24725 raft_consensus.cc:2468] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 4.
I20260709 12:08:32.951002 24726 raft_consensus.cc:2468] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 4.
I20260709 12:08:32.951395 24904 raft_consensus.cc:2804] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.951406 24618 leader_election.cc:304] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 1c30958831764b1795ecfaca0700f890; no voters: 
I20260709 12:08:32.952915 24904 raft_consensus.cc:697] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 4 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:32.953814 24910 raft_consensus.cc:2804] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.954461 24910 raft_consensus.cc:697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 4 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:32.954396 24904 consensus_queue.cc:237] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:32.955570 24910 consensus_queue.cc:237] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:32.963608 24471 catalog_manager.cc:5697] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 3 to 4, leader changed from 81855d48d76443a7b74d2675de35d58b (127.23.222.131) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 4 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.982362 24471 catalog_manager.cc:5697] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 3 to 4, leader changed from 81855d48d76443a7b74d2675de35d58b (127.23.222.131) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 4 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.001897 24918 raft_consensus.cc:993] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:33.002600 24903 raft_consensus.cc:1081] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:33.004665 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58898
I20260709 12:08:33.005267 24652 raft_consensus.cc:493] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.005545 24652 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:33.010753 24652 raft_consensus.cc:515] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.013090 24652 leader_election.cc:290] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:33.013837 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:33.014257 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:33.014729 24577 raft_consensus.cc:3055] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:33.014935 24725 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:33.015126 24577 raft_consensus.cc:740] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:33.016130 24577 consensus_queue.cc:260] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.017400 24577 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:33.020771 24725 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:33.022624 24618 leader_election.cc:304] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:33.023366 24910 raft_consensus.cc:2804] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:33.023890 24910 raft_consensus.cc:697] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:33.024010 24577 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 2.
I20260709 12:08:33.024835 24910 consensus_queue.cc:237] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.032858 24471 catalog_manager.cc:5697] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 1 to 2, leader changed from 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.059922 24918 raft_consensus.cc:993] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:33.060509 24918 raft_consensus.cc:1081] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:33.062520 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58898
I20260709 12:08:33.063057 24652 raft_consensus.cc:493] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.063385 24652 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.069837 24652 raft_consensus.cc:515] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.071878 24652 leader_election.cc:290] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 3 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:33.072870 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:33.073016 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:33.073503 24577 raft_consensus.cc:3055] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.073557 24725 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.073851 24577 raft_consensus.cc:740] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:33.074728 24577 consensus_queue.cc:260] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.075745 24577 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.080114 24725 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 3.
I20260709 12:08:33.081601 24618 leader_election.cc:304] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:33.081808 24577 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 3.
I20260709 12:08:33.082546 24910 raft_consensus.cc:2804] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.083287 24910 raft_consensus.cc:697] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:33.084353 24910 consensus_queue.cc:237] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.092121 24471 catalog_manager.cc:5697] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 2 to 3, leader changed from 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 3 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.101841 24903 raft_consensus.cc:993] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: : Instructing follower 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:33.102494 24918 raft_consensus.cc:1081] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Signalling peer 1c30958831764b1795ecfaca0700f890 to start an election
I20260709 12:08:33.104038 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
 from {username='slave'} at 127.0.0.1:58898
I20260709 12:08:33.104557 24652 raft_consensus.cc:493] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.104880 24652 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.110245 24652 raft_consensus.cc:515] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.112249 24652 leader_election.cc:290] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 3 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:33.113150 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:33.113282 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45ab4a43e4194072968eb8f4e8fd361f" candidate_uuid: "1c30958831764b1795ecfaca0700f890" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:33.113864 24577 raft_consensus.cc:3055] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:33.113919 24725 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.114229 24577 raft_consensus.cc:740] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:33.115085 24577 consensus_queue.cc:260] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.116047 24577 raft_consensus.cc:3060] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:33.119917 24725 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 3.
I20260709 12:08:33.121129 24618 leader_election.cc:304] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c30958831764b1795ecfaca0700f890, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:33.121829 24910 raft_consensus.cc:2804] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:33.122303 24910 raft_consensus.cc:697] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Becoming Leader. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:33.123298 24577 raft_consensus.cc:2468] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c30958831764b1795ecfaca0700f890 in term 3.
I20260709 12:08:33.123267 24910 consensus_queue.cc:237] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:33.131695 24471 catalog_manager.cc:5697] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 reported cstate change: term changed from 2 to 3, leader changed from 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129) to 1c30958831764b1795ecfaca0700f890 (127.23.222.130). New cstate: current_term: 3 leader_uuid: "1c30958831764b1795ecfaca0700f890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.388602 24725 raft_consensus.cc:1275] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.389920 24910 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.400606 24577 raft_consensus.cc:1275] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.402639 24911 consensus_queue.cc:1048] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:33.438650 24725 raft_consensus.cc:1275] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:33.440016 24910 consensus_queue.cc:1048] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:33.452616 24577 raft_consensus.cc:1275] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:33.454483 24910 consensus_queue.cc:1048] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:33.461359 24576 raft_consensus.cc:1275] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.462639 24910 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.471871 24725 raft_consensus.cc:1275] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.473440 24910 consensus_queue.cc:1048] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.484441 24576 raft_consensus.cc:1275] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.485920 24904 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:33.497121 24725 raft_consensus.cc:1275] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.498706 24911 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.587103 24725 raft_consensus.cc:1275] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.588594 24911 consensus_queue.cc:1048] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.600461 24576 raft_consensus.cc:1275] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Refusing update from remote peer 1c30958831764b1795ecfaca0700f890: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.603467 24904 consensus_queue.cc:1048] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.713008 24442 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:35.714382 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.721896 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:58922
I20260709 12:08:35.722813 24652 raft_consensus.cc:606] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Received request to transfer leadership to TS 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:35.726089 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:58922
I20260709 12:08:35.726605 24652 raft_consensus.cc:606] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Received request to transfer leadership to TS 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:35.729067 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:58922
I20260709 12:08:35.729547 24652 raft_consensus.cc:606] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Received request to transfer leadership to TS 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:35.732069 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:58922
I20260709 12:08:35.732512 24652 raft_consensus.cc:606] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Received request to transfer leadership to TS 81855d48d76443a7b74d2675de35d58b
I20260709 12:08:35.735039 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d89416d727fa418bad3549d99c294067"
dest_uuid: "1c30958831764b1795ecfaca0700f890"
mode: GRACEFUL
new_leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:58922
I20260709 12:08:35.735532 24652 raft_consensus.cc:606] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Received request to transfer leadership to TS 13edd1c703304bf7b8f1e92b23e5b431
I20260709 12:08:35.736819 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:35.737357 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.806371 24939 raft_consensus.cc:993] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:35.806998 24910 raft_consensus.cc:1081] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Signalling peer 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:35.809165 24576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d89416d727fa418bad3549d99c294067"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:08:35.809825 24576 raft_consensus.cc:493] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.810146 24576 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.817515 24576 raft_consensus.cc:515] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.820086 24576 leader_election.cc:290] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 3 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:35.821542 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:35.822170 24726 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.822038 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89416d727fa418bad3549d99c294067" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:35.822845 24652 raft_consensus.cc:3055] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.823272 24652 raft_consensus.cc:740] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:35.824201 24652 consensus_queue.cc:260] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.825412 24652 raft_consensus.cc:3060] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.827239 24726 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 3.
I20260709 12:08:35.828547 24543 leader_election.cc:304] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:35.830615 24940 raft_consensus.cc:2804] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.832197 24940 raft_consensus.cc:697] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:35.833762 24652 raft_consensus.cc:2468] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 3.
I20260709 12:08:35.833371 24940 consensus_queue.cc:237] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.842800 24473 catalog_manager.cc:5697] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 2 to 3, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.885126 24939 raft_consensus.cc:993] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:35.885753 24910 raft_consensus.cc:1081] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Signalling peer 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:35.887440 24576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:08:35.887919 24576 raft_consensus.cc:493] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.888164 24576 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.892740 24576 raft_consensus.cc:515] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.894330 24576 leader_election.cc:290] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 4 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:35.895533 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:35.895533 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b71d65f95a146c3bf3505965bb11654" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:35.896273 24726 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.896292 24652 raft_consensus.cc:3055] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:35.896816 24652 raft_consensus.cc:740] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:35.897704 24652 consensus_queue.cc:260] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.899006 24652 raft_consensus.cc:3060] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.903191 24726 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 4.
I20260709 12:08:35.904572 24543 leader_election.cc:304] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:35.905551 24652 raft_consensus.cc:2468] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 4.
I20260709 12:08:35.905491 24940 raft_consensus.cc:2804] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:35.906536 24940 raft_consensus.cc:697] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:35.907454 24940 consensus_queue.cc:237] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.914324 24473 catalog_manager.cc:5697] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 3 to 4, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.925529 24939 raft_consensus.cc:993] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:35.926067 24910 raft_consensus.cc:1081] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Signalling peer 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:35.927737 24726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:08:35.928294 24726 raft_consensus.cc:493] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.928646 24726 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.932916 24726 raft_consensus.cc:515] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.934993 24726 leader_election.cc:290] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:35.936211 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:35.936229 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13af8e97d78841f6bf4f89b0c96b77c1" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:35.936741 24652 raft_consensus.cc:3055] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.936971 24576 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.937119 24652 raft_consensus.cc:740] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:35.937969 24652 consensus_queue.cc:260] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.939033 24652 raft_consensus.cc:3060] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.941998 24576 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:35.943410 24692 leader_election.cc:304] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:35.943800 24652 raft_consensus.cc:2468] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:35.944655 24937 raft_consensus.cc:2804] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.946015 24937 raft_consensus.cc:697] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:35.946859 24937 consensus_queue.cc:237] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:35.954485 24473 catalog_manager.cc:5697] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 2 to 3, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 3 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.037915 24939 raft_consensus.cc:993] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:36.038551 24910 raft_consensus.cc:1081] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Signalling peer 81855d48d76443a7b74d2675de35d58b to start an election
I20260709 12:08:36.040094 24726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379"
dest_uuid: "81855d48d76443a7b74d2675de35d58b"
 from {username='slave'} at 127.0.0.1:59712
I20260709 12:08:36.040620 24726 raft_consensus.cc:493] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.040915 24726 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.045378 24726 raft_consensus.cc:515] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:36.047394 24726 leader_election.cc:290] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Requested vote from peers 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399), 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647)
I20260709 12:08:36.048291 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
I20260709 12:08:36.048506 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed6b159755e4d50a6db838d1fb21379" candidate_uuid: "81855d48d76443a7b74d2675de35d58b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:36.048806 24576 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.048998 24652 raft_consensus.cc:3055] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:36.049335 24652 raft_consensus.cc:740] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:36.049968 24652 consensus_queue.cc:260] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:36.050905 24652 raft_consensus.cc:3060] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.054126 24576 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:36.055189 24692 leader_election.cc:304] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:36.055832 24937 raft_consensus.cc:2804] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:36.056311 24937 raft_consensus.cc:697] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Becoming Leader. State: Replica: 81855d48d76443a7b74d2675de35d58b, State: Running, Role: LEADER
I20260709 12:08:36.056362 24652 raft_consensus.cc:2468] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81855d48d76443a7b74d2675de35d58b in term 3.
I20260709 12:08:36.057390 24937 consensus_queue.cc:237] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:36.065166 24473 catalog_manager.cc:5697] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b reported cstate change: term changed from 2 to 3, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 81855d48d76443a7b74d2675de35d58b (127.23.222.131). New cstate: current_term: 3 leader_uuid: "81855d48d76443a7b74d2675de35d58b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.246652 24939 raft_consensus.cc:993] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: : Instructing follower 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:36.247156 24910 raft_consensus.cc:1081] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Signalling peer 13edd1c703304bf7b8f1e92b23e5b431 to start an election
I20260709 12:08:36.248832 24576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1"
dest_uuid: "13edd1c703304bf7b8f1e92b23e5b431"
 from {username='slave'} at 127.0.0.1:44172
I20260709 12:08:36.249336 24576 raft_consensus.cc:493] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.249631 24576 raft_consensus.cc:3060] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:36.254495 24576 raft_consensus.cc:515] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:36.256330 24576 leader_election.cc:290] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Requested vote from peers 1c30958831764b1795ecfaca0700f890 (127.23.222.130:43647), 81855d48d76443a7b74d2675de35d58b (127.23.222.131:35799)
I20260709 12:08:36.257262 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c30958831764b1795ecfaca0700f890"
I20260709 12:08:36.257503 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38a881b250634de1a13889043bc8a2f1" candidate_uuid: "13edd1c703304bf7b8f1e92b23e5b431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81855d48d76443a7b74d2675de35d58b"
I20260709 12:08:36.257781 24652 raft_consensus.cc:3055] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:36.258033 24726 raft_consensus.cc:3060] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:36.258078 24652 raft_consensus.cc:740] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c30958831764b1795ecfaca0700f890, State: Running, Role: LEADER
I20260709 12:08:36.259114 24652 consensus_queue.cc:260] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:36.260033 24652 raft_consensus.cc:3060] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:36.263337 24726 raft_consensus.cc:2468] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:36.264374 24652 raft_consensus.cc:2468] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13edd1c703304bf7b8f1e92b23e5b431 in term 2.
I20260709 12:08:36.264454 24543 leader_election.cc:304] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13edd1c703304bf7b8f1e92b23e5b431, 81855d48d76443a7b74d2675de35d58b; no voters: 
I20260709 12:08:36.265312 24940 raft_consensus.cc:2804] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:36.265723 24940 raft_consensus.cc:697] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Becoming Leader. State: Replica: 13edd1c703304bf7b8f1e92b23e5b431, State: Running, Role: LEADER
I20260709 12:08:36.266626 24940 consensus_queue.cc:237] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } }
I20260709 12:08:36.274959 24473 catalog_manager.cc:5697] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 reported cstate change: term changed from 1 to 2, leader changed from 1c30958831764b1795ecfaca0700f890 (127.23.222.130) to 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "13edd1c703304bf7b8f1e92b23e5b431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.278602 24726 raft_consensus.cc:1275] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.279946 24940 consensus_queue.cc:1048] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.292889 24652 raft_consensus.cc:1275] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.295332 24941 consensus_queue.cc:1048] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.344255 24652 raft_consensus.cc:1275] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.345530 24941 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.354867 24726 raft_consensus.cc:1275] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.357136 24941 consensus_queue.cc:1048] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.472234 24576 raft_consensus.cc:1275] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.473944 24937 consensus_queue.cc:1048] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.483029 24576 raft_consensus.cc:1275] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.485064 24652 raft_consensus.cc:1275] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.487988 24948 consensus_queue.cc:1048] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.492630 24937 consensus_queue.cc:1048] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13edd1c703304bf7b8f1e92b23e5b431" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:08:36.505467 24652 raft_consensus.cc:1275] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Refusing update from remote peer 81855d48d76443a7b74d2675de35d58b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.507349 24961 consensus_queue.cc:1048] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.711107 24652 raft_consensus.cc:1275] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:36.712392 24941 consensus_queue.cc:1048] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c30958831764b1795ecfaca0700f890" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:36.723388 24726 raft_consensus.cc:1275] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Refusing update from remote peer 13edd1c703304bf7b8f1e92b23e5b431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:36.725063 24958 consensus_queue.cc:1048] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81855d48d76443a7b74d2675de35d58b" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:36.738801 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.744638 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.745083 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.746138 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.751479 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.751885 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.752983 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.758121 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.758587 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.759650 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.767408 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.767922 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.769367 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.774660 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.775148 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.776367 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.782862 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.783373 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.784572 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.789923 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.790482 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.791666 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.796944 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.797403 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.798465 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.803293 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.803783 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.846225 24442 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:45.847008 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
I20260709 12:08:45.883302 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.884351 24442 tablet_replica.cc:333] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.885249 24442 raft_consensus.cc:2243] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.886157 24442 raft_consensus.cc:2272] T d0233e9fe6df47d2a24de9bf731e9cf9 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.888983 24442 tablet_replica.cc:333] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.889647 24442 raft_consensus.cc:2243] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.890745 24442 raft_consensus.cc:2272] T d89416d727fa418bad3549d99c294067 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.892719 24442 tablet_replica.cc:333] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.893280 24442 raft_consensus.cc:2243] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.893822 24442 raft_consensus.cc:2272] T f3507ea6241e469a9fde08270a3bb43f P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.896030 24442 tablet_replica.cc:333] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.896605 24442 raft_consensus.cc:2243] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.897505 24442 raft_consensus.cc:2272] T 38a881b250634de1a13889043bc8a2f1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.899860 24442 tablet_replica.cc:333] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.900599 24442 raft_consensus.cc:2243] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.901477 24442 raft_consensus.cc:2272] T 0b71d65f95a146c3bf3505965bb11654 P 13edd1c703304bf7b8f1e92b23e5b431 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.903527 24442 tablet_replica.cc:333] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.904067 24442 raft_consensus.cc:2243] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.904584 24442 raft_consensus.cc:2272] T 13af8e97d78841f6bf4f89b0c96b77c1 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.906453 24442 tablet_replica.cc:333] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.906963 24442 raft_consensus.cc:2243] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.907444 24442 raft_consensus.cc:2272] T e75f48c8313647259b0903aa5a980c70 P 13edd1c703304bf7b8f1e92b23e5b431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.909165 24442 tablet_replica.cc:333] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.909648 24442 raft_consensus.cc:2243] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.910109 24442 raft_consensus.cc:2272] T aed6b159755e4d50a6db838d1fb21379 P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.911904 24442 tablet_replica.cc:333] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431: stopping tablet replica
I20260709 12:08:45.912366 24442 raft_consensus.cc:2243] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.912822 24442 raft_consensus.cc:2272] T 45ab4a43e4194072968eb8f4e8fd361f P 13edd1c703304bf7b8f1e92b23e5b431 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:46.010479 24618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111)
W20260709 12:08:46.036376 24692 consensus_peers.cc:597] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b -> Peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Couldn't send request to peer 13edd1c703304bf7b8f1e92b23e5b431. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.036916 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
W20260709 12:08:46.037180 24692 consensus_peers.cc:597] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b -> Peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Couldn't send request to peer 13edd1c703304bf7b8f1e92b23e5b431. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:46.040557 24618 consensus_peers.cc:597] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 -> Peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Couldn't send request to peer 13edd1c703304bf7b8f1e92b23e5b431. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:46.045182 24618 consensus_peers.cc:597] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 -> Peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Couldn't send request to peer 13edd1c703304bf7b8f1e92b23e5b431. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.065194 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
W20260709 12:08:46.103500 24618 consensus_peers.cc:597] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 -> Peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Couldn't send request to peer 13edd1c703304bf7b8f1e92b23e5b431. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.105358 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.106191 24442 tablet_replica.cc:333] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.107290 24442 raft_consensus.cc:2243] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.108099 24442 raft_consensus.cc:2272] T aed6b159755e4d50a6db838d1fb21379 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.110390 24442 tablet_replica.cc:333] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.110991 24442 raft_consensus.cc:2243] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.112267 24442 raft_consensus.cc:2272] T 45ab4a43e4194072968eb8f4e8fd361f P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.114878 24442 tablet_replica.cc:333] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.115505 24442 raft_consensus.cc:2243] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.116130 24442 raft_consensus.cc:2272] T 13af8e97d78841f6bf4f89b0c96b77c1 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.118496 24442 tablet_replica.cc:333] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.119333 24442 raft_consensus.cc:2243] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:08:46.119817 24692 consensus_peers.cc:597] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b -> Peer 13edd1c703304bf7b8f1e92b23e5b431 (127.23.222.129:40399): Couldn't send request to peer 13edd1c703304bf7b8f1e92b23e5b431. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.120059 24442 raft_consensus.cc:2272] T e75f48c8313647259b0903aa5a980c70 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.122362 24442 tablet_replica.cc:333] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.122920 24442 raft_consensus.cc:2243] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.123772 24442 raft_consensus.cc:2272] T d0233e9fe6df47d2a24de9bf731e9cf9 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.125533 24442 tablet_replica.cc:333] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.126091 24442 raft_consensus.cc:2243] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.126552 24442 raft_consensus.cc:2272] T 0b71d65f95a146c3bf3505965bb11654 P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.128636 24442 tablet_replica.cc:333] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.129410 24442 raft_consensus.cc:2243] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.129885 24442 raft_consensus.cc:2272] T 38a881b250634de1a13889043bc8a2f1 P 1c30958831764b1795ecfaca0700f890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.131655 24442 tablet_replica.cc:333] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.132313 24442 raft_consensus.cc:2243] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.133180 24442 raft_consensus.cc:2272] T f3507ea6241e469a9fde08270a3bb43f P 1c30958831764b1795ecfaca0700f890 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.135046 24442 tablet_replica.cc:333] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890: stopping tablet replica
I20260709 12:08:46.135536 24442 raft_consensus.cc:2243] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.135996 24442 raft_consensus.cc:2272] T d89416d727fa418bad3549d99c294067 P 1c30958831764b1795ecfaca0700f890 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.166446 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
I20260709 12:08:46.188740 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
I20260709 12:08:46.221191 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.222155 24442 tablet_replica.cc:333] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.222867 24442 raft_consensus.cc:2243] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.224967 24442 raft_consensus.cc:2272] T aed6b159755e4d50a6db838d1fb21379 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.227021 24442 tablet_replica.cc:333] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.227609 24442 raft_consensus.cc:2243] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.228066 24442 raft_consensus.cc:2272] T d89416d727fa418bad3549d99c294067 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.230226 24442 tablet_replica.cc:333] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.231024 24442 raft_consensus.cc:2243] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.231562 24442 raft_consensus.cc:2272] T f3507ea6241e469a9fde08270a3bb43f P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.233620 24442 tablet_replica.cc:333] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.234177 24442 raft_consensus.cc:2243] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.234754 24442 raft_consensus.cc:2272] T 0b71d65f95a146c3bf3505965bb11654 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.236464 24442 tablet_replica.cc:333] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.236970 24442 raft_consensus.cc:2243] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.237389 24442 raft_consensus.cc:2272] T 38a881b250634de1a13889043bc8a2f1 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.239094 24442 tablet_replica.cc:333] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.239596 24442 raft_consensus.cc:2243] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.240077 24442 raft_consensus.cc:2272] T 45ab4a43e4194072968eb8f4e8fd361f P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.241849 24442 tablet_replica.cc:333] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.242393 24442 raft_consensus.cc:2243] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.243230 24442 raft_consensus.cc:2272] T e75f48c8313647259b0903aa5a980c70 P 81855d48d76443a7b74d2675de35d58b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.245083 24442 tablet_replica.cc:333] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.245599 24442 raft_consensus.cc:2243] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.246495 24442 raft_consensus.cc:2272] T 13af8e97d78841f6bf4f89b0c96b77c1 P 81855d48d76443a7b74d2675de35d58b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.248422 24442 tablet_replica.cc:333] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b: stopping tablet replica
I20260709 12:08:46.249060 24442 raft_consensus.cc:2243] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.249747 24442 raft_consensus.cc:2272] T d0233e9fe6df47d2a24de9bf731e9cf9 P 81855d48d76443a7b74d2675de35d58b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.281446 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:08:46.304740 24442 master.cc:562] Master@127.23.222.190:44043 shutting down...
I20260709 12:08:46.553295 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.554143 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.554617 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P 17802fec7ccc40f0b6a31c3d651b883d: stopping tablet replica
I20260709 12:08:46.578619 24442 master.cc:584] Master@127.23.222.190:44043 shutdown complete.
13edd1c703304bf7b8f1e92b23e5b431  4
1c30958831764b1795ecfaca0700f890  4
81855d48d76443a7b74d2675de35d58b  1
13edd1c703304bf7b8f1e92b23e5b431  3
1c30958831764b1795ecfaca0700f890  3
81855d48d76443a7b74d2675de35d58b  3
13edd1c703304bf7b8f1e92b23e5b431  0
1c30958831764b1795ecfaca0700f890  8
81855d48d76443a7b74d2675de35d58b  1
13edd1c703304bf7b8f1e92b23e5b431  3
1c30958831764b1795ecfaca0700f890  3
81855d48d76443a7b74d2675de35d58b  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31630 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:46.631007 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:40361
I20260709 12:08:46.632485 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.639173 24979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.639171 24978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.640976 24981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.641721 24442 server_base.cc:1061] running on GCE node
I20260709 12:08:46.642972 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.643177 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.643428 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598926643381 us; error 0 us; skew 500 ppm
I20260709 12:08:46.644073 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.647426 24442 webserver.cc:533] Webserver started at http://127.23.222.190:32853/ using document root <none> and password file <none>
I20260709 12:08:46.648033 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.648203 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.648557 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.649842 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "f2712858488444f9a80ad8e72429a02e"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-90bm"
I20260709 12:08:46.654731 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:08:46.658731 24986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.659993 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:08:46.660284 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "f2712858488444f9a80ad8e72429a02e"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-90bm"
I20260709 12:08:46.660569 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.700987 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.702549 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.749401 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:40361
I20260709 12:08:46.749519 25037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:40361 every 8 connection(s)
I20260709 12:08:46.753904 25038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.764196 25038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e: Bootstrap starting.
I20260709 12:08:46.769328 25038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.774199 25038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e: No bootstrap required, opened a new log
I20260709 12:08:46.776701 25038 raft_consensus.cc:359] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2712858488444f9a80ad8e72429a02e" member_type: VOTER }
I20260709 12:08:46.777172 25038 raft_consensus.cc:385] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.777431 25038 raft_consensus.cc:740] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2712858488444f9a80ad8e72429a02e, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.778070 25038 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2712858488444f9a80ad8e72429a02e" member_type: VOTER }
I20260709 12:08:46.778631 25038 raft_consensus.cc:399] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:46.778841 25038 raft_consensus.cc:493] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:46.779135 25038 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.783631 25038 raft_consensus.cc:515] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2712858488444f9a80ad8e72429a02e" member_type: VOTER }
I20260709 12:08:46.784197 25038 leader_election.cc:304] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2712858488444f9a80ad8e72429a02e; no voters: 
I20260709 12:08:46.785413 25038 leader_election.cc:290] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:46.785887 25041 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.787254 25041 raft_consensus.cc:697] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 1 LEADER]: Becoming Leader. State: Replica: f2712858488444f9a80ad8e72429a02e, State: Running, Role: LEADER
I20260709 12:08:46.788010 25041 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2712858488444f9a80ad8e72429a02e" member_type: VOTER }
I20260709 12:08:46.788422 25038 sys_catalog.cc:565] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:46.793534 25043 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2712858488444f9a80ad8e72429a02e. Latest consensus state: current_term: 1 leader_uuid: "f2712858488444f9a80ad8e72429a02e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2712858488444f9a80ad8e72429a02e" member_type: VOTER } }
I20260709 12:08:46.793576 25042 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2712858488444f9a80ad8e72429a02e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2712858488444f9a80ad8e72429a02e" member_type: VOTER } }
I20260709 12:08:46.794428 25043 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.795094 25042 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.797518 25051 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:46.806593 25051 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:46.807760 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:46.816452 25051 catalog_manager.cc:1383] Generated new cluster ID: ad56a620481141a188e815139437634e
I20260709 12:08:46.816782 25051 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:46.830924 25051 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:46.832357 25051 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:46.847743 25051 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e: Generated new TSK 0
I20260709 12:08:46.848430 25051 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:46.874917 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.881630 25059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.882771 25060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.884598 25062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.885345 24442 server_base.cc:1061] running on GCE node
I20260709 12:08:46.886586 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.886786 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.886914 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598926886901 us; error 0 us; skew 500 ppm
I20260709 12:08:46.887420 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.890172 24442 webserver.cc:533] Webserver started at http://127.23.222.129:43469/ using document root <none> and password file <none>
I20260709 12:08:46.891012 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.891249 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.891494 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.892580 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "2368fa54c9b2401e92fd72153c23c05b"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-90bm"
I20260709 12:08:46.897320 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:46.901209 25067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.902186 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:08:46.902596 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "2368fa54c9b2401e92fd72153c23c05b"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-90bm"
I20260709 12:08:46.902925 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.929340 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.930876 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.932500 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.934949 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.935179 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.935449 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.935642 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.985846 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:36971
I20260709 12:08:46.985955 25129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:36971 every 8 connection(s)
I20260709 12:08:46.991187 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.998873 25134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.000720 25135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.005282 25137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.006765 24442 server_base.cc:1061] running on GCE node
I20260709 12:08:47.008098 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.008347 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.008530 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598927008508 us; error 0 us; skew 500 ppm
I20260709 12:08:47.009203 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.011087 25130 heartbeater.cc:344] Connected to a master server at 127.23.222.190:40361
I20260709 12:08:47.011513 25130 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.012522 25130 heartbeater.cc:507] Master 127.23.222.190:40361 requested a full tablet report, sending...
I20260709 12:08:47.012681 24442 webserver.cc:533] Webserver started at http://127.23.222.130:35627/ using document root <none> and password file <none>
I20260709 12:08:47.013399 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.013691 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.014037 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.015316 25003 ts_manager.cc:194] Registered new tserver with Master: 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971)
I20260709 12:08:47.015440 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "f7242ddad7524622981309a9da450238"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-90bm"
I20260709 12:08:47.017329 25003 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47336
I20260709 12:08:47.020891 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:08:47.024701 25142 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.025960 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:08:47.026476 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "f7242ddad7524622981309a9da450238"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-90bm"
I20260709 12:08:47.026790 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.043886 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.045614 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.047529 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.050216 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.050676 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.051083 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.051427 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.101598 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:34155
I20260709 12:08:47.101708 25204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:34155 every 8 connection(s)
I20260709 12:08:47.106971 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:47.115418 25208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:47.119158 25209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.121666 24442 server_base.cc:1061] running on GCE node
W20260709 12:08:47.121762 25211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:47.122927 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:47.123167 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:47.123394 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598927123370 us; error 0 us; skew 500 ppm
I20260709 12:08:47.123591 25205 heartbeater.cc:344] Connected to a master server at 127.23.222.190:40361
I20260709 12:08:47.124002 25205 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.124068 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:47.124799 25205 heartbeater.cc:507] Master 127.23.222.190:40361 requested a full tablet report, sending...
I20260709 12:08:47.127353 25003 ts_manager.cc:194] Registered new tserver with Master: f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:47.127492 24442 webserver.cc:533] Webserver started at http://127.23.222.131:42917/ using document root <none> and password file <none>
I20260709 12:08:47.128472 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:47.128952 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:47.129284 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:47.129500 25003 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47348
I20260709 12:08:47.130836 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "234a1b4963664022a506355c4f3a5e6c"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-90bm"
I20260709 12:08:47.135798 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:47.139801 25216 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.140959 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:47.141337 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "234a1b4963664022a506355c4f3a5e6c"
format_stamp: "Formatted at 2026-07-09 12:08:47 on dist-test-slave-90bm"
I20260709 12:08:47.141692 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:47.175060 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:47.176450 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:47.177925 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:47.180323 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:47.180585 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.180847 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:47.181030 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:47.231356 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:46473
I20260709 12:08:47.231676 25278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:46473 every 8 connection(s)
I20260709 12:08:47.249593 25279 heartbeater.cc:344] Connected to a master server at 127.23.222.190:40361
I20260709 12:08:47.250016 25279 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:47.251024 25279 heartbeater.cc:507] Master 127.23.222.190:40361 requested a full tablet report, sending...
I20260709 12:08:47.253228 25003 ts_manager.cc:194] Registered new tserver with Master: 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:47.254249 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019164949s
I20260709 12:08:47.254853 25003 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47350
I20260709 12:08:47.284976 25003 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47358:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:47.288338 25003 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:47.393771 25170 tablet_service.cc:1511] Processing CreateTablet for tablet 37c47c76969d46b7a266bd9c1c0b762d (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.395731 25170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c47c76969d46b7a266bd9c1c0b762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.397751 25167 tablet_service.cc:1511] Processing CreateTablet for tablet 763d024b21444bd08760193e057a434c (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.399389 25167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763d024b21444bd08760193e057a434c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.401314 25169 tablet_service.cc:1511] Processing CreateTablet for tablet e4d017908a354fda931cfbbda6de7508 (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.402766 25169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d017908a354fda931cfbbda6de7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.403573 25095 tablet_service.cc:1511] Processing CreateTablet for tablet 37c47c76969d46b7a266bd9c1c0b762d (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.405015 25095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c47c76969d46b7a266bd9c1c0b762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.405620 25092 tablet_service.cc:1511] Processing CreateTablet for tablet 763d024b21444bd08760193e057a434c (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.407424 25092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763d024b21444bd08760193e057a434c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.407675 25093 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd552a67a2444b5bf1626037b6a68f5 (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.409188 25093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd552a67a2444b5bf1626037b6a68f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.411938 25094 tablet_service.cc:1511] Processing CreateTablet for tablet e4d017908a354fda931cfbbda6de7508 (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.413640 25094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d017908a354fda931cfbbda6de7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.415810 25168 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd552a67a2444b5bf1626037b6a68f5 (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.417699 25168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd552a67a2444b5bf1626037b6a68f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.418951 25165 tablet_service.cc:1511] Processing CreateTablet for tablet cf99a79a79b743c2b1e7aec996ae20aa (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.419687 25166 tablet_service.cc:1511] Processing CreateTablet for tablet 0803a513442d47909bcf51d9fa7f64eb (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.420536 25165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf99a79a79b743c2b1e7aec996ae20aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.422113 25090 tablet_service.cc:1511] Processing CreateTablet for tablet cf99a79a79b743c2b1e7aec996ae20aa (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.423556 25090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf99a79a79b743c2b1e7aec996ae20aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.425576 25089 tablet_service.cc:1511] Processing CreateTablet for tablet 59b908d08d9d4a0985f174994b92514a (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.427086 25089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b908d08d9d4a0985f174994b92514a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.428375 25164 tablet_service.cc:1511] Processing CreateTablet for tablet 59b908d08d9d4a0985f174994b92514a (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.430063 25164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b908d08d9d4a0985f174994b92514a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.406121 25091 tablet_service.cc:1511] Processing CreateTablet for tablet 0803a513442d47909bcf51d9fa7f64eb (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.431679 25091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0803a513442d47909bcf51d9fa7f64eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.433610 25088 tablet_service.cc:1511] Processing CreateTablet for tablet d51ff3f1ef26436286ab963e1521e6ca (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.434468 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0803a513442d47909bcf51d9fa7f64eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.435194 25088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51ff3f1ef26436286ab963e1521e6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.440164 25163 tablet_service.cc:1511] Processing CreateTablet for tablet d51ff3f1ef26436286ab963e1521e6ca (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.441722 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51ff3f1ef26436286ab963e1521e6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.443750 25087 tablet_service.cc:1511] Processing CreateTablet for tablet afaeba2dc598493a88c382673ec7bece (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.445230 25087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afaeba2dc598493a88c382673ec7bece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.447768 25162 tablet_service.cc:1511] Processing CreateTablet for tablet afaeba2dc598493a88c382673ec7bece (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.449452 25162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afaeba2dc598493a88c382673ec7bece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.451884 25086 tablet_service.cc:1511] Processing CreateTablet for tablet d3dfd502e7694b9c972e3c6635bdb71f (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.455641 25086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3dfd502e7694b9c972e3c6635bdb71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.455377 25161 tablet_service.cc:1511] Processing CreateTablet for tablet d3dfd502e7694b9c972e3c6635bdb71f (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.457051 25161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3dfd502e7694b9c972e3c6635bdb71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.468124 25243 tablet_service.cc:1511] Processing CreateTablet for tablet e4d017908a354fda931cfbbda6de7508 (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.469977 25243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d017908a354fda931cfbbda6de7508. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.470626 25244 tablet_service.cc:1511] Processing CreateTablet for tablet 37c47c76969d46b7a266bd9c1c0b762d (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.471581 25242 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd552a67a2444b5bf1626037b6a68f5 (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.473264 25236 tablet_service.cc:1511] Processing CreateTablet for tablet afaeba2dc598493a88c382673ec7bece (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.473984 25241 tablet_service.cc:1511] Processing CreateTablet for tablet 763d024b21444bd08760193e057a434c (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.477198 25240 tablet_service.cc:1511] Processing CreateTablet for tablet 0803a513442d47909bcf51d9fa7f64eb (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.479506 25235 tablet_service.cc:1511] Processing CreateTablet for tablet d3dfd502e7694b9c972e3c6635bdb71f (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.483023 25237 tablet_service.cc:1511] Processing CreateTablet for tablet d51ff3f1ef26436286ab963e1521e6ca (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.486301 25239 tablet_service.cc:1511] Processing CreateTablet for tablet cf99a79a79b743c2b1e7aec996ae20aa (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.487738 25235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3dfd502e7694b9c972e3c6635bdb71f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.490053 25237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d51ff3f1ef26436286ab963e1521e6ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.492774 25238 tablet_service.cc:1511] Processing CreateTablet for tablet 59b908d08d9d4a0985f174994b92514a (DEFAULT_TABLE table=test-workload [id=528ac746ae9f40bebae97cb988eda259]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.494725 25241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763d024b21444bd08760193e057a434c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.499363 25294 tablet_bootstrap.cc:492] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:47.497519 25238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59b908d08d9d4a0985f174994b92514a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.504710 25239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf99a79a79b743c2b1e7aec996ae20aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.506608 25244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37c47c76969d46b7a266bd9c1c0b762d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.507987 25240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0803a513442d47909bcf51d9fa7f64eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.513577 25242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd552a67a2444b5bf1626037b6a68f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.522681 25236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afaeba2dc598493a88c382673ec7bece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.607054 25294 tablet_bootstrap.cc:654] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.660856 25296 tablet_bootstrap.cc:492] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:47.660856 25295 tablet_bootstrap.cc:492] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:47.669407 25296 tablet_bootstrap.cc:654] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.677255 25295 tablet_bootstrap.cc:654] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.695402 25296 tablet_bootstrap.cc:492] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:47.696135 25295 tablet_bootstrap.cc:492] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:47.696179 25296 ts_tablet_manager.cc:1403] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.020s
I20260709 12:08:47.695411 25294 tablet_bootstrap.cc:492] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:47.696767 25295 ts_tablet_manager.cc:1403] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.008s
I20260709 12:08:47.696926 25294 ts_tablet_manager.cc:1403] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.198s	user 0.028s	sys 0.012s
I20260709 12:08:47.699069 25296 raft_consensus.cc:359] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.699680 25296 raft_consensus.cc:385] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.699949 25296 raft_consensus.cc:740] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.700122 25294 raft_consensus.cc:359] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.700359 25295 raft_consensus.cc:359] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.700963 25294 raft_consensus.cc:385] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.700663 25296 consensus_queue.cc:260] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.701118 25295 raft_consensus.cc:385] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.701335 25294 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.701496 25295 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.702325 25294 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.702325 25295 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.703416 25279 heartbeater.cc:499] Master 127.23.222.190:40361 was elected leader, sending a full tablet report...
I20260709 12:08:47.703926 25296 ts_tablet_manager.cc:1434] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:47.704922 25296 tablet_bootstrap.cc:492] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:47.713272 25296 tablet_bootstrap.cc:654] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.713347 25294 ts_tablet_manager.cc:1434] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:08:47.715415 25130 heartbeater.cc:499] Master 127.23.222.190:40361 was elected leader, sending a full tablet report...
I20260709 12:08:47.715788 25295 ts_tablet_manager.cc:1434] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:08:47.716938 25295 tablet_bootstrap.cc:492] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:47.724023 25295 tablet_bootstrap.cc:654] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.715312 25205 heartbeater.cc:499] Master 127.23.222.190:40361 was elected leader, sending a full tablet report...
I20260709 12:08:47.730847 25294 tablet_bootstrap.cc:492] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:47.734139 25300 raft_consensus.cc:493] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.734920 25300 raft_consensus.cc:515] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.743292 25294 tablet_bootstrap.cc:654] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.753336 25300 leader_election.cc:290] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:47.762207 25296 tablet_bootstrap.cc:492] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:47.763072 25296 ts_tablet_manager.cc:1403] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.058s	user 0.036s	sys 0.018s
I20260709 12:08:47.766693 25296 raft_consensus.cc:359] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.769421 25296 raft_consensus.cc:385] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.769901 25296 raft_consensus.cc:740] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.772845 25296 consensus_queue.cc:260] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.776548 25296 ts_tablet_manager.cc:1434] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
W20260709 12:08:47.799877 25050 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:47.819543 25296 tablet_bootstrap.cc:492] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:47.820828 25295 tablet_bootstrap.cc:492] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:47.821607 25295 ts_tablet_manager.cc:1403] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.105s	user 0.031s	sys 0.040s
I20260709 12:08:47.822448 25294 tablet_bootstrap.cc:492] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:47.823021 25294 ts_tablet_manager.cc:1403] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.030s
I20260709 12:08:47.824952 25295 raft_consensus.cc:359] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:47.825809 25295 raft_consensus.cc:385] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.826191 25295 raft_consensus.cc:740] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.826076 25294 raft_consensus.cc:359] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:47.826951 25294 raft_consensus.cc:385] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.827339 25294 raft_consensus.cc:740] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.827332 25295 consensus_queue.cc:260] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:47.828176 25296 tablet_bootstrap.cc:654] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.828529 25294 consensus_queue.cc:260] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:47.830385 25295 ts_tablet_manager.cc:1434] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:08:47.831177 25294 ts_tablet_manager.cc:1434] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:08:47.831497 25295 tablet_bootstrap.cc:492] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:47.832201 25294 tablet_bootstrap.cc:492] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:47.839442 25294 tablet_bootstrap.cc:654] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.841748 25295 tablet_bootstrap.cc:654] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.851579 25296 tablet_bootstrap.cc:492] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:47.852495 25296 ts_tablet_manager.cc:1403] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.030s
I20260709 12:08:47.856132 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:47.856451 25296 raft_consensus.cc:359] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.857175 25296 raft_consensus.cc:385] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.857498 25296 raft_consensus.cc:740] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
W20260709 12:08:47.858224 25220 leader_election.cc:343] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.858532 25296 consensus_queue.cc:260] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.867523 25294 tablet_bootstrap.cc:492] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:47.868340 25296 ts_tablet_manager.cc:1434] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:08:47.868409 25294 ts_tablet_manager.cc:1403] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.009s
I20260709 12:08:47.868595 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:47.869668 25296 tablet_bootstrap.cc:492] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
W20260709 12:08:47.870311 25220 leader_election.cc:343] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7242ddad7524622981309a9da450238 (127.23.222.130:34155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.870862 25220 leader_election.cc:304] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c; no voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238
I20260709 12:08:47.871762 25295 tablet_bootstrap.cc:492] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:47.871958 25300 raft_consensus.cc:2749] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.872247 25295 ts_tablet_manager.cc:1403] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.014s
I20260709 12:08:47.875419 25294 raft_consensus.cc:359] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.875630 25295 raft_consensus.cc:359] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.876398 25294 raft_consensus.cc:385] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.876542 25295 raft_consensus.cc:385] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.876801 25294 raft_consensus.cc:740] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.876996 25295 raft_consensus.cc:740] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.877712 25294 consensus_queue.cc:260] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.877863 25295 consensus_queue.cc:260] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.878614 25296 tablet_bootstrap.cc:654] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.880132 25294 ts_tablet_manager.cc:1434] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:47.881214 25294 tablet_bootstrap.cc:492] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:47.887328 25295 ts_tablet_manager.cc:1434] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 12:08:47.888469 25294 tablet_bootstrap.cc:654] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.889060 25295 tablet_bootstrap.cc:492] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:47.899684 25295 tablet_bootstrap.cc:654] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.901278 25294 tablet_bootstrap.cc:492] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:47.901883 25294 ts_tablet_manager.cc:1403] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:08:47.905030 25294 raft_consensus.cc:359] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.905864 25294 raft_consensus.cc:385] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.906229 25294 raft_consensus.cc:740] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.906338 25296 tablet_bootstrap.cc:492] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:47.907146 25296 ts_tablet_manager.cc:1403] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.020s
I20260709 12:08:47.907389 25294 consensus_queue.cc:260] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.912067 25294 ts_tablet_manager.cc:1434] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:08:47.911170 25296 raft_consensus.cc:359] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.912853 25296 raft_consensus.cc:385] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.913331 25294 tablet_bootstrap.cc:492] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:47.913344 25296 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.914985 25296 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.916414 25295 tablet_bootstrap.cc:492] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:47.917027 25295 ts_tablet_manager.cc:1403] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.009s
I20260709 12:08:47.917402 25296 ts_tablet_manager.cc:1434] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:08:47.918493 25296 tablet_bootstrap.cc:492] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:47.920110 25295 raft_consensus.cc:359] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.921074 25295 raft_consensus.cc:385] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.921429 25295 raft_consensus.cc:740] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.922510 25295 consensus_queue.cc:260] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.924077 25294 tablet_bootstrap.cc:654] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.925614 25296 tablet_bootstrap.cc:654] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.928085 25295 ts_tablet_manager.cc:1434] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:47.929597 25295 tablet_bootstrap.cc:492] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:47.940590 25296 tablet_bootstrap.cc:492] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:47.941350 25296 ts_tablet_manager.cc:1403] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:08:47.942727 25295 tablet_bootstrap.cc:654] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.945264 25296 raft_consensus.cc:359] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:47.946389 25296 raft_consensus.cc:385] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.946869 25296 raft_consensus.cc:740] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.948218 25296 consensus_queue.cc:260] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:47.951651 25294 tablet_bootstrap.cc:492] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:47.951835 25296 ts_tablet_manager.cc:1434] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:08:47.952236 25294 ts_tablet_manager.cc:1403] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.014s
I20260709 12:08:47.952750 25296 tablet_bootstrap.cc:492] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:47.953441 25302 raft_consensus.cc:493] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.953940 25302 raft_consensus.cc:515] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.955705 25294 raft_consensus.cc:359] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.956561 25294 raft_consensus.cc:385] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.956851 25294 raft_consensus.cc:740] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.957780 25294 consensus_queue.cc:260] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.961675 25296 tablet_bootstrap.cc:654] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.963505 25294 ts_tablet_manager.cc:1434] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:08:47.966087 25294 tablet_bootstrap.cc:492] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:47.972415 25295 tablet_bootstrap.cc:492] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:47.973062 25295 ts_tablet_manager.cc:1403] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.012s
I20260709 12:08:47.975019 25302 leader_election.cc:290] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:47.976545 25295 raft_consensus.cc:359] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.977371 25295 raft_consensus.cc:385] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.977675 25295 raft_consensus.cc:740] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.977843 25302 raft_consensus.cc:493] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.978540 25302 raft_consensus.cc:515] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.978485 25295 consensus_queue.cc:260] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:47.981557 25302 leader_election.cc:290] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:47.993480 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:47.995683 25294 tablet_bootstrap.cc:654] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.996476 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:47.997440 25105 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 0.
W20260709 12:08:47.999323 25146 leader_election.cc:343] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.007140 25146 leader_election.cc:304] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.008738 25302 raft_consensus.cc:2804] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.009310 25302 raft_consensus.cc:493] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.009745 25302 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.010397 25294 tablet_bootstrap.cc:492] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:48.011116 25294 ts_tablet_manager.cc:1403] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.009s
I20260709 12:08:48.015326 25301 raft_consensus.cc:493] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.016238 25301 raft_consensus.cc:515] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.020434 25302 raft_consensus.cc:515] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.023910 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.024609 25105 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.034757 25295 ts_tablet_manager.cc:1434] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.061s	user 0.035s	sys 0.021s
I20260709 12:08:48.035698 25302 leader_election.cc:290] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.033830 25105 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.038695 25295 tablet_bootstrap.cc:492] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:48.039534 25296 tablet_bootstrap.cc:492] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:48.039623 25253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.040706 25301 leader_election.cc:290] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.041219 25253 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 0.
I20260709 12:08:48.042868 25296 ts_tablet_manager.cc:1403] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.090s	user 0.034s	sys 0.032s
I20260709 12:08:48.042840 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.043685 25252 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.047190 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.048219 25254 raft_consensus.cc:2468] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 0.
I20260709 12:08:48.048157 25294 raft_consensus.cc:359] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.049047 25294 raft_consensus.cc:385] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.049365 25294 raft_consensus.cc:740] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.049724 25295 tablet_bootstrap.cc:654] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.050196 25294 consensus_queue.cc:260] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.051785 25146 leader_election.cc:304] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.055815 25295 tablet_bootstrap.cc:492] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:48.055928 25302 raft_consensus.cc:2804] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.056357 25295 ts_tablet_manager.cc:1403] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 12:08:48.056444 25302 raft_consensus.cc:697] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:48.057425 25302 consensus_queue.cc:237] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.057991 25294 ts_tablet_manager.cc:1434] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:08:48.052481 25143 leader_election.cc:304] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:08:48.059022 25294 tablet_bootstrap.cc:492] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:48.052871 25252 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.059909 25295 raft_consensus.cc:359] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.060690 25295 raft_consensus.cc:385] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.061057 25295 raft_consensus.cc:740] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.062107 25295 consensus_queue.cc:260] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.069065 25320 raft_consensus.cc:2804] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.069693 25320 raft_consensus.cc:493] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.070132 25320 raft_consensus.cc:3060] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.052883 25296 raft_consensus.cc:359] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.071378 25296 raft_consensus.cc:385] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.071702 25296 raft_consensus.cc:740] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.075609 25296 consensus_queue.cc:260] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.076659 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.077329 25180 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.078191 25296 ts_tablet_manager.cc:1434] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.002s
I20260709 12:08:48.079031 25071 leader_election.cc:304] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.079392 25296 tablet_bootstrap.cc:492] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:48.080047 25301 raft_consensus.cc:2804] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.080515 25301 raft_consensus.cc:493] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.080916 25301 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.084096 25000 catalog_manager.cc:5697] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.088023 25296 tablet_bootstrap.cc:654] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.090631 25301 raft_consensus.cc:515] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.097272 25294 tablet_bootstrap.cc:654] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.103550 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
W20260709 12:08:48.105772 25068 leader_election.cc:343] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.106921 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.107052 25295 ts_tablet_manager.cc:1434] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.017s
I20260709 12:08:48.107565 25180 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:48.108444 25206 tablet.cc:2406] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:48.107069 25320 raft_consensus.cc:515] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.110946 25296 tablet_bootstrap.cc:492] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:48.111600 25296 ts_tablet_manager.cc:1403] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.010s
I20260709 12:08:48.112294 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.112967 25105 raft_consensus.cc:3060] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.114934 25296 raft_consensus.cc:359] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.115880 25296 raft_consensus.cc:385] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.116218 25296 raft_consensus.cc:740] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.116330 25295 tablet_bootstrap.cc:492] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:48.117229 25296 consensus_queue.cc:260] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.118924 25300 raft_consensus.cc:493] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.119467 25300 raft_consensus.cc:515] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.121922 25300 leader_election.cc:290] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:48.121764 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.122828 25252 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.125032 25179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3dfd502e7694b9c972e3c6635bdb71f" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.125545 25104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3dfd502e7694b9c972e3c6635bdb71f" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.126837 25104 raft_consensus.cc:2468] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 0.
W20260709 12:08:48.127439 25220 leader_election.cc:343] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7242ddad7524622981309a9da450238 (127.23.222.130:34155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.128492 25220 leader_election.cc:304] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: f7242ddad7524622981309a9da450238
I20260709 12:08:48.130893 25300 raft_consensus.cc:493] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.131579 25300 raft_consensus.cc:515] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.130867 25295 tablet_bootstrap.cc:654] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.118932 25301 leader_election.cc:290] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.134142 25300 leader_election.cc:290] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:48.136214 25300 raft_consensus.cc:2804] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.138962 25300 raft_consensus.cc:493] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.139513 25300 raft_consensus.cc:3060] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.118120 25180 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.143723 25320 leader_election.cc:290] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.147603 25294 tablet_bootstrap.cc:492] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:48.149431 25294 ts_tablet_manager.cc:1403] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.000s
I20260709 12:08:48.148617 25105 raft_consensus.cc:2468] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.150710 25252 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.150619 25104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.150985 25146 leader_election.cc:304] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.152197 25296 ts_tablet_manager.cc:1434] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.040s	user 0.020s	sys 0.012s
I20260709 12:08:48.152431 25320 raft_consensus.cc:2804] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.154882 25320 raft_consensus.cc:697] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:48.155144 25068 leader_election.cc:304] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.156394 25301 raft_consensus.cc:2804] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.156157 25320 consensus_queue.cc:237] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.163142 25294 raft_consensus.cc:359] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.164034 25294 raft_consensus.cc:385] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.164390 25294 raft_consensus.cc:740] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.165373 25294 consensus_queue.cc:260] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.166190 25296 tablet_bootstrap.cc:492] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:48.172487 25334 raft_consensus.cc:493] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.178846 25334 raft_consensus.cc:515] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.179385 25000 catalog_manager.cc:5697] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.172538 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.181963 25252 raft_consensus.cc:3060] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.182207 25300 raft_consensus.cc:515] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.183347 25334 leader_election.cc:290] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:48.185002 25300 leader_election.cc:290] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:48.186632 25296 tablet_bootstrap.cc:654] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:48.171870 25220 leader_election.cc:343] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.193720 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.206787 25252 raft_consensus.cc:2468] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.211973 25301 raft_consensus.cc:697] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:48.211030 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.213428 25179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3dfd502e7694b9c972e3c6635bdb71f" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.211495 25104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3dfd502e7694b9c972e3c6635bdb71f" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.214814 25104 raft_consensus.cc:3060] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.215898 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.216741 25295 tablet_bootstrap.cc:492] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
W20260709 12:08:48.217573 25220 leader_election.cc:343] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.217941 25295 ts_tablet_manager.cc:1403] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.017s
W20260709 12:08:48.218295 25220 leader_election.cc:343] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7242ddad7524622981309a9da450238 (127.23.222.130:34155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.218756 25220 leader_election.cc:304] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c; no voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238
I20260709 12:08:48.219590 25300 raft_consensus.cc:2749] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:48.219957 25220 leader_election.cc:343] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7242ddad7524622981309a9da450238 (127.23.222.130:34155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:48.220654 25220 leader_election.cc:343] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7242ddad7524622981309a9da450238 (127.23.222.130:34155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.221052 25220 leader_election.cc:304] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c; no voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238
I20260709 12:08:48.221155 25295 raft_consensus.cc:359] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.221891 25300 raft_consensus.cc:2749] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.221959 25295 raft_consensus.cc:385] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.223026 25295 raft_consensus.cc:740] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.223803 25294 ts_tablet_manager.cc:1434] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.066s	user 0.023s	sys 0.018s
I20260709 12:08:48.224074 25295 consensus_queue.cc:260] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.224749 25320 raft_consensus.cc:493] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.224977 25294 tablet_bootstrap.cc:492] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:48.225272 25320 raft_consensus.cc:515] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.226958 25104 raft_consensus.cc:2468] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 1.
I20260709 12:08:48.227728 25320 leader_election.cc:290] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.228322 25301 consensus_queue.cc:237] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.229303 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.229660 25300 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.230185 25300 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:48.231361 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.232323 25300 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971)
I20260709 12:08:48.232497 25220 leader_election.cc:304] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: f7242ddad7524622981309a9da450238
I20260709 12:08:48.232755 25294 tablet_bootstrap.cc:654] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.233233 25300 raft_consensus.cc:2804] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.234473 25300 raft_consensus.cc:697] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Becoming Leader. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:08:48.234551 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.235154 25180 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 0.
I20260709 12:08:48.230017 25105 raft_consensus.cc:2468] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 0.
I20260709 12:08:48.235395 25300 consensus_queue.cc:237] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.235821 25320 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.237458 25146 leader_election.cc:304] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.238054 25320 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:48.239158 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.239562 25327 raft_consensus.cc:2804] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.240056 25105 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 0.
I20260709 12:08:48.240101 25327 raft_consensus.cc:493] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.242138 25327 raft_consensus.cc:3060] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.242825 25220 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.243650 25334 raft_consensus.cc:2804] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.243997 25334 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:08:48.238449 25143 leader_election.cc:343] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.244597 25294 tablet_bootstrap.cc:492] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:48.248517 25294 ts_tablet_manager.cc:1403] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.001s
I20260709 12:08:48.249517 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.250407 25105 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 0.
I20260709 12:08:48.251845 25294 raft_consensus.cc:359] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.252065 25146 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.253360 25326 raft_consensus.cc:2804] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.253696 25326 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.253930 25326 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.252067 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.244413 25334 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.256618 25295 ts_tablet_manager.cc:1434] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:08:48.261022 25320 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473), 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971)
I20260709 12:08:48.262356 25000 catalog_manager.cc:5697] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 1 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.264086 25296 tablet_bootstrap.cc:492] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:48.266085 25296 ts_tablet_manager.cc:1403] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.006s
I20260709 12:08:48.252592 25294 raft_consensus.cc:385] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.266605 25294 raft_consensus.cc:740] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.266556 25334 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:48.267987 25252 raft_consensus.cc:2393] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7242ddad7524622981309a9da450238 in current term 1: Already voted for candidate 234a1b4963664022a506355c4f3a5e6c in this term.
I20260709 12:08:48.267760 25294 consensus_queue.cc:260] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.269296 25296 raft_consensus.cc:359] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.265156 25326 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:48.270608 25294 ts_tablet_manager.cc:1434] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:08:48.271834 25294 tablet_bootstrap.cc:492] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:48.272136 25295 tablet_bootstrap.cc:492] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:48.273334 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.273967 25105 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.277256 25326 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Requested vote from peers 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473), 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971)
I20260709 12:08:48.277709 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.278612 25252 raft_consensus.cc:2393] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7242ddad7524622981309a9da450238 in current term 1: Already voted for candidate 234a1b4963664022a506355c4f3a5e6c in this term.
I20260709 12:08:48.278827 25294 tablet_bootstrap.cc:654] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.280157 25327 raft_consensus.cc:515] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.283882 25327 leader_election.cc:290] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.284638 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.285526 25180 raft_consensus.cc:2393] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 234a1b4963664022a506355c4f3a5e6c in current term 1: Already voted for candidate f7242ddad7524622981309a9da450238 in this term.
I20260709 12:08:48.286761 25295 tablet_bootstrap.cc:654] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.287618 25104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.288625 25104 raft_consensus.cc:3060] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.289649 25296 raft_consensus.cc:385] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.290102 25296 raft_consensus.cc:740] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.291469 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.292052 25294 tablet_bootstrap.cc:492] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:48.293145 25294 ts_tablet_manager.cc:1403] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 12:08:48.293653 25105 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.295023 25146 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 234a1b4963664022a506355c4f3a5e6c
I20260709 12:08:48.295969 25327 raft_consensus.cc:2804] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.296448 25327 raft_consensus.cc:697] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:48.296430 25296 consensus_queue.cc:260] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.297106 25294 raft_consensus.cc:359] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.297668 25252 raft_consensus.cc:3060] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.298017 25294 raft_consensus.cc:385] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.297555 25327 consensus_queue.cc:237] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:48.298332 25294 raft_consensus.cc:740] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.299332 25296 ts_tablet_manager.cc:1434] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:08:48.299273 25294 consensus_queue.cc:260] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.300400 25296 tablet_bootstrap.cc:492] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:48.301841 25294 ts_tablet_manager.cc:1434] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:48.303220 25294 tablet_bootstrap.cc:492] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b: Bootstrap starting.
I20260709 12:08:48.303134 25326 raft_consensus.cc:493] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.304633 25326 raft_consensus.cc:515] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.303241 25104 raft_consensus.cc:2468] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.312076 25002 catalog_manager.cc:5697] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 234a1b4963664022a506355c4f3a5e6c (127.23.222.131). New cstate: current_term: 1 leader_uuid: "234a1b4963664022a506355c4f3a5e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.313740 25146 leader_election.cc:304] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.314808 25320 raft_consensus.cc:2804] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.315557 25320 raft_consensus.cc:697] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:48.316500 25320 consensus_queue.cc:237] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.317988 25326 leader_election.cc:290] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.311587 25296 tablet_bootstrap.cc:654] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.321681 25294 tablet_bootstrap.cc:654] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.320492 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.325184 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
W20260709 12:08:48.325809 25146 leader_election.cc:343] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:48.327087 25143 leader_election.cc:343] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:48.327528 25143 leader_election.cc:304] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7242ddad7524622981309a9da450238; no voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:08:48.327986 25000 catalog_manager.cc:5697] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.328743 25327 raft_consensus.cc:2749] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.336328 25295 tablet_bootstrap.cc:492] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:48.337772 25295 ts_tablet_manager.cc:1403] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.013s
I20260709 12:08:48.338963 25252 raft_consensus.cc:2468] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 1.
I20260709 12:08:48.340867 25295 raft_consensus.cc:359] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.343356 25295 raft_consensus.cc:385] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.343719 25295 raft_consensus.cc:740] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.344633 25295 consensus_queue.cc:260] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.345939 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.347409 25105 raft_consensus.cc:2393] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 234a1b4963664022a506355c4f3a5e6c in current term 1: Already voted for candidate f7242ddad7524622981309a9da450238 in this term.
I20260709 12:08:48.347612 25295 ts_tablet_manager.cc:1434] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:08:48.348940 25295 tablet_bootstrap.cc:492] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:48.349316 25220 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c; no voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238
I20260709 12:08:48.350045 25334 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971)
I20260709 12:08:48.351666 25300 raft_consensus.cc:2749] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.359278 25294 tablet_bootstrap.cc:492] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b: No bootstrap required, opened a new log
I20260709 12:08:48.359290 25296 tablet_bootstrap.cc:492] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:48.360440 25294 ts_tablet_manager.cc:1403] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.020s
I20260709 12:08:48.361011 25301 raft_consensus.cc:493] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.361510 25301 raft_consensus.cc:515] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.363860 25301 leader_election.cc:290] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.364014 25294 raft_consensus.cc:359] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.364738 25294 raft_consensus.cc:385] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.364991 25294 raft_consensus.cc:740] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.365370 25295 tablet_bootstrap.cc:654] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.365350 25000 catalog_manager.cc:5697] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.365912 25294 consensus_queue.cc:260] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.368714 25294 ts_tablet_manager.cc:1434] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:48.369004 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.369724 25252 raft_consensus.cc:2468] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.372345 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.373018 25180 raft_consensus.cc:2468] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.374977 25071 leader_election.cc:304] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.376411 25339 raft_consensus.cc:2804] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.376791 25339 raft_consensus.cc:493] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.377111 25339 raft_consensus.cc:3060] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.360569 25296 ts_tablet_manager.cc:1403] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.003s
I20260709 12:08:48.389472 25339 raft_consensus.cc:515] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.391569 25296 raft_consensus.cc:359] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.392587 25296 raft_consensus.cc:385] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.392884 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.392951 25296 raft_consensus.cc:740] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.393131 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.393846 25180 raft_consensus.cc:3060] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.394112 25252 raft_consensus.cc:3060] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.394227 25296 consensus_queue.cc:260] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.398006 25296 ts_tablet_manager.cc:1434] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:08:48.399585 25296 tablet_bootstrap.cc:492] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c: Bootstrap starting.
I20260709 12:08:48.402424 25339 leader_election.cc:290] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.403017 25252 raft_consensus.cc:2468] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.404974 25295 tablet_bootstrap.cc:492] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:48.404844 25068 leader_election.cc:304] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.405238 25296 tablet_bootstrap.cc:654] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.405547 25295 ts_tablet_manager.cc:1403] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.024s
I20260709 12:08:48.405897 25339 raft_consensus.cc:2804] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.407018 25339 raft_consensus.cc:697] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:48.407964 25339 consensus_queue.cc:237] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.409026 25295 raft_consensus.cc:359] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.410481 25295 raft_consensus.cc:385] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.410931 25295 raft_consensus.cc:740] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.412045 25295 consensus_queue.cc:260] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.415688 25295 ts_tablet_manager.cc:1434] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 12:08:48.417487 25295 tablet_bootstrap.cc:492] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238: Bootstrap starting.
I20260709 12:08:48.426553 25295 tablet_bootstrap.cc:654] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:48.405845 25180 raft_consensus.cc:2468] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.427985 25296 tablet_bootstrap.cc:492] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c: No bootstrap required, opened a new log
I20260709 12:08:48.428633 25296 ts_tablet_manager.cc:1403] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 12:08:48.425093 25001 catalog_manager.cc:5697] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 1 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.432358 25296 raft_consensus.cc:359] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.433234 25296 raft_consensus.cc:385] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.433722 25296 raft_consensus.cc:740] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.434765 25296 consensus_queue.cc:260] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.436870 25296 ts_tablet_manager.cc:1434] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:08:48.440428 25295 tablet_bootstrap.cc:492] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238: No bootstrap required, opened a new log
I20260709 12:08:48.440907 25295 ts_tablet_manager.cc:1403] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.012s
I20260709 12:08:48.443913 25295 raft_consensus.cc:359] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.444690 25295 raft_consensus.cc:385] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:48.444974 25295 raft_consensus.cc:740] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Initialized, Role: FOLLOWER
I20260709 12:08:48.445537 25295 consensus_queue.cc:260] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.447338 25295 ts_tablet_manager.cc:1434] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:48.454777 25339 raft_consensus.cc:493] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.455469 25339 raft_consensus.cc:515] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.457667 25339 leader_election.cc:290] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.458582 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.458860 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.459342 25180 raft_consensus.cc:2468] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.459509 25252 raft_consensus.cc:2468] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.460506 25071 leader_election.cc:304] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.461357 25339 raft_consensus.cc:2804] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.461728 25339 raft_consensus.cc:493] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.462062 25339 raft_consensus.cc:3060] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.467592 25339 raft_consensus.cc:515] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.469434 25339 leader_election.cc:290] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.470628 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.470670 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.471328 25252 raft_consensus.cc:3060] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.471423 25180 raft_consensus.cc:3060] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.476857 25252 raft_consensus.cc:2468] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.477979 25180 raft_consensus.cc:2468] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.478194 25068 leader_election.cc:304] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.479128 25339 raft_consensus.cc:2804] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.479631 25339 raft_consensus.cc:697] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:48.480440 25339 consensus_queue.cc:237] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.488377 25001 catalog_manager.cc:5697] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 1 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.537609 25320 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.549149 25339 raft_consensus.cc:493] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.549882 25339 raft_consensus.cc:515] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.553093 25326 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.553745 25339 leader_election.cc:290] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.554659 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.555380 25254 raft_consensus.cc:2468] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.556170 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.556938 25180 raft_consensus.cc:2468] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 0.
I20260709 12:08:48.556988 25068 leader_election.cc:304] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.558452 25301 raft_consensus.cc:2804] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.558851 25301 raft_consensus.cc:493] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.559211 25301 raft_consensus.cc:3060] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.568387 25301 raft_consensus.cc:515] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.570955 25301 leader_election.cc:290] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.571318 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.571969 25180 raft_consensus.cc:3060] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.571575 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:48.573671 25252 raft_consensus.cc:3060] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.579387 25180 raft_consensus.cc:2468] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.580600 25071 leader_election.cc:304] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:48.580843 25252 raft_consensus.cc:2468] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 1.
I20260709 12:08:48.581375 25301 raft_consensus.cc:2804] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.581856 25301 raft_consensus.cc:697] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:48.582650 25301 consensus_queue.cc:237] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.591602 25001 catalog_manager.cc:5697] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 1 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.615695 25320 raft_consensus.cc:493] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.616300 25320 raft_consensus.cc:515] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.618211 25320 leader_election.cc:290] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:48.619393 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3dfd502e7694b9c972e3c6635bdb71f" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.619432 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3dfd502e7694b9c972e3c6635bdb71f" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "234a1b4963664022a506355c4f3a5e6c" is_pre_election: true
I20260709 12:08:48.620205 25105 raft_consensus.cc:2393] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7242ddad7524622981309a9da450238 in current term 1: Already voted for candidate 234a1b4963664022a506355c4f3a5e6c in this term.
I20260709 12:08:48.621268 25146 leader_election.cc:304] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7242ddad7524622981309a9da450238; no voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:08:48.621955 25320 raft_consensus.cc:3060] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.627707 25320 raft_consensus.cc:2749] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.629266 25300 raft_consensus.cc:493] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.629828 25300 raft_consensus.cc:515] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.631866 25300 leader_election.cc:290] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:48.632872 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b" is_pre_election: true
I20260709 12:08:48.633469 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238" is_pre_election: true
I20260709 12:08:48.633837 25105 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 0.
I20260709 12:08:48.634138 25180 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 0.
I20260709 12:08:48.635210 25220 leader_election.cc:304] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.635896 25300 raft_consensus.cc:2804] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.636236 25300 raft_consensus.cc:493] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.636515 25300 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.642167 25300 raft_consensus.cc:515] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.644026 25300 leader_election.cc:290] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:48.645001 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:48.645123 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:48.645565 25105 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.645733 25180 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.651130 25105 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 1.
I20260709 12:08:48.651692 25180 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 1.
I20260709 12:08:48.652645 25220 leader_election.cc:304] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:48.653505 25300 raft_consensus.cc:2804] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.653980 25300 raft_consensus.cc:697] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Becoming Leader. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:08:48.654731 25300 consensus_queue.cc:237] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:48.663144 25001 catalog_manager.cc:5697] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 234a1b4963664022a506355c4f3a5e6c (127.23.222.131). New cstate: current_term: 1 leader_uuid: "234a1b4963664022a506355c4f3a5e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.666508 25301 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.681231 25301 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.690866 25326 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.702759 25302 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.717617 25302 consensus_queue.cc:1048] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.723922 25302 consensus_queue.cc:1048] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.739804 25326 consensus_queue.cc:1048] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.745368 25327 consensus_queue.cc:1048] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.747558 25300 consensus_queue.cc:1048] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.775928 25333 consensus_queue.cc:1048] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.865283 25301 consensus_queue.cc:1048] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.876399 25301 consensus_queue.cc:1048] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.899652 25180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d"
dest_uuid: "f7242ddad7524622981309a9da450238"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:47546
I20260709 12:08:48.900408 25180 raft_consensus.cc:606] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:08:48.906096 25180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508"
dest_uuid: "f7242ddad7524622981309a9da450238"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:47546
I20260709 12:08:48.906687 25180 raft_consensus.cc:606] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:08:48.915752 25180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "f7242ddad7524622981309a9da450238"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:47546
I20260709 12:08:48.916363 25180 raft_consensus.cc:606] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:08:48.933478 25252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
mode: GRACEFUL
new_leader_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:59744
I20260709 12:08:48.934113 25252 raft_consensus.cc:606] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Received request to transfer leadership to TS f7242ddad7524622981309a9da450238
I20260709 12:08:48.951239 25104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:46390
I20260709 12:08:48.951776 25104 raft_consensus.cc:606] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Received request to transfer leadership to TS f7242ddad7524622981309a9da450238
I20260709 12:08:48.957500 25104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:46390
I20260709 12:08:48.958011 25104 raft_consensus.cc:606] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Received request to transfer leadership to TS f7242ddad7524622981309a9da450238
I20260709 12:08:48.974417 25301 consensus_queue.cc:1048] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.986572 25336 consensus_queue.cc:1048] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.003429 25336 consensus_queue.cc:1048] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.016840 25339 consensus_queue.cc:1048] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.030483 25302 raft_consensus.cc:993] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:08:49.031013 25302 raft_consensus.cc:1081] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:08:49.032624 25104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46378
I20260709 12:08:49.033210 25104 raft_consensus.cc:493] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.033589 25104 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.039335 25104 raft_consensus.cc:515] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.041612 25104 leader_election.cc:290] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:49.042891 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:49.042934 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:49.043676 25252 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.043774 25180 raft_consensus.cc:3055] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.044221 25180 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:49.044996 25180 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.046012 25180 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.050117 25252 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:08:49.051514 25180 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:08:49.051510 25068 leader_election.cc:304] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:49.052588 25339 raft_consensus.cc:2804] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.053081 25339 raft_consensus.cc:697] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:49.053891 25339 consensus_queue.cc:237] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.061156 25000 catalog_manager.cc:5697] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 1 to 2, leader changed from f7242ddad7524622981309a9da450238 (127.23.222.130) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 2 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.127256 25302 raft_consensus.cc:993] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:08:49.127763 25302 raft_consensus.cc:1081] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:08:49.129736 25104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46378
I20260709 12:08:49.130669 25104 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.131075 25104 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.137904 25104 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:49.139829 25104 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:49.141057 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:49.141273 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:49.141716 25252 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.141860 25180 raft_consensus.cc:3055] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.142248 25180 raft_consensus.cc:740] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:49.143178 25180 consensus_queue.cc:260] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:49.144402 25180 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.147712 25252 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:08:49.148912 25068 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:49.149665 25339 raft_consensus.cc:2804] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.149693 25180 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:08:49.150338 25339 raft_consensus.cc:697] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:49.151257 25339 consensus_queue.cc:237] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:49.158712 25003 catalog_manager.cc:5697] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 1 to 2, leader changed from f7242ddad7524622981309a9da450238 (127.23.222.130) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 2 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:49.172700 25334 consensus_queue.cc:1048] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:49.187438 25334 consensus_queue.cc:1048] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:49.195686 25333 raft_consensus.cc:993] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: : Instructing follower f7242ddad7524622981309a9da450238 to start an election
I20260709 12:08:49.196241 25333 raft_consensus.cc:1081] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Signalling peer f7242ddad7524622981309a9da450238 to start an election
I20260709 12:08:49.198122 25180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa"
dest_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:47528
I20260709 12:08:49.198913 25180 raft_consensus.cc:493] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.199337 25180 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.200845 25339 raft_consensus.cc:993] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower f7242ddad7524622981309a9da450238 to start an election
I20260709 12:08:49.201362 25363 raft_consensus.cc:1081] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Signalling peer f7242ddad7524622981309a9da450238 to start an election
I20260709 12:08:49.203214 25179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca"
dest_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:47530
I20260709 12:08:49.203802 25179 raft_consensus.cc:493] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.204166 25179 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.206799 25180 raft_consensus.cc:515] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.208985 25180 leader_election.cc:290] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:49.210395 25104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:49.210980 25104 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.211107 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:49.212260 25252 raft_consensus.cc:3055] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.212687 25252 raft_consensus.cc:740] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:08:49.213126 25179 raft_consensus.cc:515] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.214100 25252 consensus_queue.cc:260] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.216116 25252 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.216231 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:49.216992 25105 raft_consensus.cc:3055] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.217355 25105 raft_consensus.cc:740] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:49.217656 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:49.218446 25179 leader_election.cc:290] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:49.218209 25105 consensus_queue.cc:260] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.219451 25105 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.220342 25104 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:08:49.222069 25146 leader_election.cc:304] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:49.223366 25302 raft_consensus.cc:2804] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.223878 25302 raft_consensus.cc:697] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:49.224785 25252 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:08:49.224769 25302 consensus_queue.cc:237] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.218222 25254 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.231825 25105 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:08:49.233525 25146 leader_election.cc:304] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:49.234790 25320 raft_consensus.cc:2804] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.235320 25320 raft_consensus.cc:697] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:49.236208 25254 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:08:49.236061 25320 consensus_queue.cc:237] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.238837 25000 catalog_manager.cc:5697] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 1 to 2, leader changed from 234a1b4963664022a506355c4f3a5e6c (127.23.222.131) to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.247359 25320 raft_consensus.cc:993] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:08:49.247963 25326 raft_consensus.cc:1081] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:08:49.249594 25105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46378
I20260709 12:08:49.250111 25105 raft_consensus.cc:493] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.250515 25105 raft_consensus.cc:3060] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.254012 25000 catalog_manager.cc:5697] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 1 to 2, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.256423 25105 raft_consensus.cc:515] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.259900 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:49.260586 25254 raft_consensus.cc:3060] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.263540 25105 leader_election.cc:290] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:49.263530 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d017908a354fda931cfbbda6de7508" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:49.264362 25180 raft_consensus.cc:3055] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.264690 25180 raft_consensus.cc:740] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:49.265580 25180 consensus_queue.cc:260] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.266958 25180 raft_consensus.cc:3060] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.269762 25254 raft_consensus.cc:2468] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:08:49.271136 25068 leader_election.cc:304] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:08:49.272063 25363 raft_consensus.cc:2804] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.272527 25363 raft_consensus.cc:697] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:49.273341 25363 consensus_queue.cc:237] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.273964 25336 raft_consensus.cc:993] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower f7242ddad7524622981309a9da450238 to start an election
I20260709 12:08:49.274451 25336 raft_consensus.cc:1081] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Signalling peer f7242ddad7524622981309a9da450238 to start an election
I20260709 12:08:49.275231 25180 raft_consensus.cc:2468] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:08:49.277776 25180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece"
dest_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:47530
I20260709 12:08:49.278329 25180 raft_consensus.cc:493] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.278631 25180 raft_consensus.cc:3060] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.280620 25000 catalog_manager.cc:5697] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 1 to 2, leader changed from f7242ddad7524622981309a9da450238 (127.23.222.130) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 2 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.284812 25180 raft_consensus.cc:515] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.287294 25180 leader_election.cc:290] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:08:49.287735 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:49.287997 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afaeba2dc598493a88c382673ec7bece" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:08:49.288437 25105 raft_consensus.cc:3055] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.288631 25254 raft_consensus.cc:3060] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.288836 25105 raft_consensus.cc:740] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:49.289861 25105 consensus_queue.cc:260] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.291544 25105 raft_consensus.cc:3060] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.294938 25254 raft_consensus.cc:2468] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:08:49.296393 25143 leader_election.cc:304] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:49.297329 25105 raft_consensus.cc:2468] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:08:49.297314 25326 raft_consensus.cc:2804] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.297964 25326 raft_consensus.cc:697] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:08:49.298846 25326 consensus_queue.cc:237] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:49.305998 25000 catalog_manager.cc:5697] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 1 to 2, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.536743 25254 raft_consensus.cc:1275] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.538627 25301 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.547012 25180 raft_consensus.cc:1275] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.548841 25339 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.583307 25254 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.584408 25180 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.585279 25339 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.586059 25363 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.674326 25254 raft_consensus.cc:1275] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.675912 25326 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:49.685642 25105 raft_consensus.cc:1275] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.687461 25326 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:49.725310 25180 raft_consensus.cc:1275] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.726998 25339 consensus_queue.cc:1048] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.736802 25254 raft_consensus.cc:1275] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.738381 25339 consensus_queue.cc:1048] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.787555 25254 raft_consensus.cc:1275] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.788964 25326 consensus_queue.cc:1048] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.798961 25105 raft_consensus.cc:1275] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.801146 25326 consensus_queue.cc:1048] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.815958 25105 raft_consensus.cc:1275] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.817649 25302 consensus_queue.cc:1048] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:49.824484 25254 raft_consensus.cc:1275] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.826293 25326 consensus_queue.cc:1048] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:51.998725 24442 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:51.999495 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.022040 25105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:46402
I20260709 12:08:52.022884 25105 raft_consensus.cc:606] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Received request to transfer leadership to TS 234a1b4963664022a506355c4f3a5e6c
I20260709 12:08:52.025591 25105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:46402
I20260709 12:08:52.026147 25105 raft_consensus.cc:606] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Received request to transfer leadership to TS 234a1b4963664022a506355c4f3a5e6c
I20260709 12:08:52.027176 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:52.027643 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.323057 25394 raft_consensus.cc:993] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:08:52.323570 25363 raft_consensus.cc:1081] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Signalling peer 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:08:52.325179 25254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 12:08:52.325755 25254 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.326121 25254 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.331936 25254 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:52.333542 25254 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 3 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971)
I20260709 12:08:52.334795 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:52.335289 25180 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.335354 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:52.335988 25105 raft_consensus.cc:3055] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.336223 25105 raft_consensus.cc:740] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:52.336946 25105 consensus_queue.cc:260] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:52.337893 25105 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.340260 25180 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 3.
I20260709 12:08:52.341392 25220 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:52.342099 25391 raft_consensus.cc:2804] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.342900 25105 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 3.
I20260709 12:08:52.343456 25391 raft_consensus.cc:697] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Becoming Leader. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:08:52.344342 25391 consensus_queue.cc:237] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:08:52.353839 25003 catalog_manager.cc:5697] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c reported cstate change: term changed from 2 to 3, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to 234a1b4963664022a506355c4f3a5e6c (127.23.222.131). New cstate: current_term: 3 leader_uuid: "234a1b4963664022a506355c4f3a5e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:52.619315 25394 raft_consensus.cc:993] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:08:52.619809 25394 raft_consensus.cc:1081] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Signalling peer 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:08:52.621321 25254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 12:08:52.621832 25254 raft_consensus.cc:493] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.622154 25254 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.627450 25254 raft_consensus.cc:515] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:52.629235 25254 leader_election.cc:290] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 3 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:08:52.630316 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:08:52.630471 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:08:52.630937 25105 raft_consensus.cc:3055] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.630973 25180 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.631283 25105 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:08:52.632042 25105 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:52.632947 25105 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.636691 25180 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 3.
I20260709 12:08:52.637995 25105 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 3.
I20260709 12:08:52.637928 25220 leader_election.cc:304] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:08:52.638989 25391 raft_consensus.cc:2804] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.639501 25391 raft_consensus.cc:697] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Becoming Leader. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:08:52.640219 25391 consensus_queue.cc:237] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:08:52.648569 25003 catalog_manager.cc:5697] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c reported cstate change: term changed from 2 to 3, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to 234a1b4963664022a506355c4f3a5e6c (127.23.222.131). New cstate: current_term: 3 leader_uuid: "234a1b4963664022a506355c4f3a5e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.915248 25105 raft_consensus.cc:1275] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.916937 25391 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.928252 25180 raft_consensus.cc:1275] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.930387 25395 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:53.028851 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.035256 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.035808 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.038446 25180 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.039937 25405 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:53.050519 25105 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:53.052503 25395 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:54.036893 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.042294 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.042688 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.043924 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.049659 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.050127 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.051589 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.060041 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.060580 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.062119 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.068275 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.068821 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.069953 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.075379 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.075829 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.076926 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.082909 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.083446 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.084384 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.092331 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.092995 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.094102 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:01.102691 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:01.103363 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.139338 24442 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:02.144414 25254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:59744
I20260709 12:09:02.145140 25254 raft_consensus.cc:606] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:09:02.155458 25254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:59744
I20260709 12:09:02.156064 25254 raft_consensus.cc:606] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:09:02.166321 25180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa"
dest_uuid: "f7242ddad7524622981309a9da450238"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:47546
I20260709 12:09:02.166829 25180 raft_consensus.cc:606] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:09:02.172670 25180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a"
dest_uuid: "f7242ddad7524622981309a9da450238"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:47546
I20260709 12:09:02.173225 25180 raft_consensus.cc:606] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:09:02.179001 25180 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca"
dest_uuid: "f7242ddad7524622981309a9da450238"
mode: GRACEFUL
new_leader_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:47546
I20260709 12:09:02.179585 25180 raft_consensus.cc:606] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Received request to transfer leadership to TS 2368fa54c9b2401e92fd72153c23c05b
I20260709 12:09:02.188028 25421 raft_consensus.cc:993] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.188539 25421 raft_consensus.cc:1081] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.190441 25105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46376
I20260709 12:09:02.190963 25105 raft_consensus.cc:493] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.191294 25105 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.197172 25105 raft_consensus.cc:515] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:09:02.199664 25105 leader_election.cc:290] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 4 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:02.201045 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:02.201045 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37c47c76969d46b7a266bd9c1c0b762d" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:02.202080 25180 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.202078 25254 raft_consensus.cc:3055] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.202634 25254 raft_consensus.cc:740] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:09:02.203567 25254 consensus_queue.cc:260] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:09:02.205020 25254 raft_consensus.cc:3060] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.210584 25180 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 4.
I20260709 12:09:02.212378 25417 raft_consensus.cc:993] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.212379 25071 leader_election.cc:304] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:09:02.213304 25422 raft_consensus.cc:1081] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.213373 25254 raft_consensus.cc:2468] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 4.
I20260709 12:09:02.213721 25411 raft_consensus.cc:2804] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.215479 25411 raft_consensus.cc:697] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:02.215669 25105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46378
I20260709 12:09:02.216349 25105 raft_consensus.cc:493] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.216744 25105 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.216539 25411 consensus_queue.cc:237] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } }
I20260709 12:09:02.224413 25105 raft_consensus.cc:515] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.226868 25105 leader_election.cc:290] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 3 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:02.227665 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:02.227881 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf99a79a79b743c2b1e7aec996ae20aa" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:02.227392 25001 catalog_manager.cc:5697] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 3 to 4, leader changed from 234a1b4963664022a506355c4f3a5e6c (127.23.222.131) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 4 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:02.228286 25180 raft_consensus.cc:3055] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.228336 25254 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.228766 25180 raft_consensus.cc:740] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:09:02.229671 25180 consensus_queue.cc:260] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.230796 25180 raft_consensus.cc:3060] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.236150 25254 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 3.
I20260709 12:09:02.238334 25068 leader_election.cc:304] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:09:02.239224 25411 raft_consensus.cc:2804] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.239895 25180 raft_consensus.cc:2468] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 3.
I20260709 12:09:02.241870 25411 raft_consensus.cc:697] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:02.243268 25411 consensus_queue.cc:237] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.254439 25001 catalog_manager.cc:5697] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 2 to 3, leader changed from f7242ddad7524622981309a9da450238 (127.23.222.130) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 3 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.289862 25417 raft_consensus.cc:993] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.290444 25417 raft_consensus.cc:1081] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.291939 25105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46378
I20260709 12:09:02.292536 25105 raft_consensus.cc:493] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.292832 25105 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.297874 25105 raft_consensus.cc:515] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.299523 25105 leader_election.cc:290] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 3 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:02.300575 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:02.300683 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:02.301277 25252 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.301265 25180 raft_consensus.cc:3055] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.301776 25180 raft_consensus.cc:740] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:09:02.302645 25180 consensus_queue.cc:260] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.303862 25180 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.308862 25252 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 3.
I20260709 12:09:02.310294 25068 leader_election.cc:304] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:09:02.310957 25180 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 3.
I20260709 12:09:02.311285 25411 raft_consensus.cc:2804] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.311940 25411 raft_consensus.cc:697] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:02.313024 25411 consensus_queue.cc:237] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.320627 25001 catalog_manager.cc:5697] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 2 to 3, leader changed from f7242ddad7524622981309a9da450238 (127.23.222.130) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 3 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.335496 25418 raft_consensus.cc:993] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.335947 25421 raft_consensus.cc:1081] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.337364 25105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46376
I20260709 12:09:02.337817 25105 raft_consensus.cc:493] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.338063 25105 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.342659 25105 raft_consensus.cc:515] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.344902 25105 leader_election.cc:290] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 4 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:02.346084 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:02.346084 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:02.346881 25180 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.346912 25252 raft_consensus.cc:3055] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.347441 25252 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:09:02.348253 25252 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.349552 25252 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.354079 25180 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 4.
I20260709 12:09:02.355477 25071 leader_election.cc:304] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2368fa54c9b2401e92fd72153c23c05b, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:09:02.355754 25252 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 4.
I20260709 12:09:02.356276 25411 raft_consensus.cc:2804] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.356792 25411 raft_consensus.cc:697] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:02.357560 25411 consensus_queue.cc:237] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.365842 25001 catalog_manager.cc:5697] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 3 to 4, leader changed from 234a1b4963664022a506355c4f3a5e6c (127.23.222.131) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 4 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.564438 25422 raft_consensus.cc:993] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: : Instructing follower 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.564936 25422 raft_consensus.cc:1081] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Signalling peer 2368fa54c9b2401e92fd72153c23c05b to start an election
I20260709 12:09:02.566709 25105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
 from {username='slave'} at 127.0.0.1:46378
I20260709 12:09:02.567238 25105 raft_consensus.cc:493] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.567485 25105 raft_consensus.cc:3060] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.572317 25105 raft_consensus.cc:515] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.573877 25105 leader_election.cc:290] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Requested vote from peers f7242ddad7524622981309a9da450238 (127.23.222.130:34155), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:02.574998 25252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:02.574990 25180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59b908d08d9d4a0985f174994b92514a" candidate_uuid: "2368fa54c9b2401e92fd72153c23c05b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:02.575554 25252 raft_consensus.cc:3060] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.575639 25180 raft_consensus.cc:3055] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:02.575999 25180 raft_consensus.cc:740] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:09:02.576781 25180 consensus_queue.cc:260] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.577744 25180 raft_consensus.cc:3060] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.580701 25252 raft_consensus.cc:2468] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:09:02.581817 25068 leader_election.cc:304] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, 2368fa54c9b2401e92fd72153c23c05b; no voters: 
I20260709 12:09:02.582680 25411 raft_consensus.cc:2804] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:02.583160 25411 raft_consensus.cc:697] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Becoming Leader. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:02.584353 25180 raft_consensus.cc:2468] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2368fa54c9b2401e92fd72153c23c05b in term 2.
I20260709 12:09:02.584071 25411 consensus_queue.cc:237] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:02.591903 25001 catalog_manager.cc:5697] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b reported cstate change: term changed from 1 to 2, leader changed from f7242ddad7524622981309a9da450238 (127.23.222.130) to 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129). New cstate: current_term: 2 leader_uuid: "2368fa54c9b2401e92fd72153c23c05b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.681809 25252 raft_consensus.cc:1275] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.683326 25411 consensus_queue.cc:1048] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.695261 25180 raft_consensus.cc:1275] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.697156 25423 consensus_queue.cc:1048] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.737928 25180 raft_consensus.cc:1275] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.738422 25179 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.739702 25427 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.739854 25423 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.770987 25254 raft_consensus.cc:1275] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.774233 25254 raft_consensus.cc:1275] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.774294 25252 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.775393 25441 consensus_queue.cc:1048] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:02.776346 25442 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.776590 25423 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.795029 25179 raft_consensus.cc:1275] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.798504 25427 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.998162 25179 raft_consensus.cc:1275] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.999537 25427 consensus_queue.cc:1048] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:03.008848 25254 raft_consensus.cc:1275] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer 2368fa54c9b2401e92fd72153c23c05b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:03.011818 25442 consensus_queue.cc:1048] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:05.260668 24442 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:05.261682 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.271344 25105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:46402
I20260709 12:09:05.272162 25105 raft_consensus.cc:606] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Received request to transfer leadership to TS 234a1b4963664022a506355c4f3a5e6c
I20260709 12:09:05.275473 25105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:46402
I20260709 12:09:05.275955 25105 raft_consensus.cc:606] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Received request to transfer leadership to TS f7242ddad7524622981309a9da450238
I20260709 12:09:05.278764 25105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:46402
I20260709 12:09:05.279237 25105 raft_consensus.cc:606] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Received request to transfer leadership to TS f7242ddad7524622981309a9da450238
I20260709 12:09:05.281584 25105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca"
dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
mode: GRACEFUL
new_leader_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:46402
I20260709 12:09:05.281997 25105 raft_consensus.cc:606] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Received request to transfer leadership to TS 234a1b4963664022a506355c4f3a5e6c
I20260709 12:09:05.283195 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:05.283663 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.292577 25452 raft_consensus.cc:993] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower f7242ddad7524622981309a9da450238 to start an election
I20260709 12:09:05.293141 25452 raft_consensus.cc:1081] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Signalling peer f7242ddad7524622981309a9da450238 to start an election
I20260709 12:09:05.294996 25179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "763d024b21444bd08760193e057a434c"
dest_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:47530
I20260709 12:09:05.295555 25179 raft_consensus.cc:493] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.295910 25179 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.303987 25179 raft_consensus.cc:515] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.307220 25179 leader_election.cc:290] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 5 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:05.308292 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:09:05.309074 25105 raft_consensus.cc:3055] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:05.309015 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "763d024b21444bd08760193e057a434c" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:05.309355 25105 raft_consensus.cc:740] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:05.309664 25254 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.310338 25105 consensus_queue.cc:260] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.311628 25105 raft_consensus.cc:3060] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.315653 25254 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 5.
I20260709 12:09:05.317155 25143 leader_election.cc:304] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:09:05.317247 25105 raft_consensus.cc:2468] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 5.
I20260709 12:09:05.318320 25417 raft_consensus.cc:2804] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:05.319723 25417 raft_consensus.cc:697] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 5 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:09:05.320870 25417 consensus_queue.cc:237] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.332403 25003 catalog_manager.cc:5697] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 4 to 5, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 5 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.473846 25454 raft_consensus.cc:993] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:09:05.474637 25454 raft_consensus.cc:1081] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Signalling peer 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:09:05.476451 25254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 12:09:05.476907 25254 raft_consensus.cc:493] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.477245 25254 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.484218 25254 raft_consensus.cc:515] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.486243 25254 leader_election.cc:290] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 4 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:09:05.487756 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:09:05.487979 25179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d51ff3f1ef26436286ab963e1521e6ca" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:05.488399 25105 raft_consensus.cc:3055] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:05.488695 25179 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.488986 25105 raft_consensus.cc:740] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:05.490202 25105 consensus_queue.cc:260] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.491627 25105 raft_consensus.cc:3060] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.495165 25179 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 4.
I20260709 12:09:05.496696 25220 leader_election.cc:304] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:09:05.497190 25105 raft_consensus.cc:2468] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 4.
I20260709 12:09:05.497675 25421 raft_consensus.cc:2804] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:05.499061 25421 raft_consensus.cc:697] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 4 LEADER]: Becoming Leader. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:09:05.500072 25421 consensus_queue.cc:237] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.508067 25003 catalog_manager.cc:5697] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c reported cstate change: term changed from 3 to 4, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to 234a1b4963664022a506355c4f3a5e6c (127.23.222.131). New cstate: current_term: 4 leader_uuid: "234a1b4963664022a506355c4f3a5e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.631117 25452 raft_consensus.cc:993] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower f7242ddad7524622981309a9da450238 to start an election
I20260709 12:09:05.631642 25454 raft_consensus.cc:1081] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Signalling peer f7242ddad7524622981309a9da450238 to start an election
I20260709 12:09:05.633342 25179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5"
dest_uuid: "f7242ddad7524622981309a9da450238"
 from {username='slave'} at 127.0.0.1:47530
I20260709 12:09:05.634071 25179 raft_consensus.cc:493] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.634562 25179 raft_consensus.cc:3060] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.640720 25179 raft_consensus.cc:515] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.643134 25179 leader_election.cc:290] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), 234a1b4963664022a506355c4f3a5e6c (127.23.222.131:46473)
I20260709 12:09:05.643730 25254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
I20260709 12:09:05.644783 25254 raft_consensus.cc:3060] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.643604 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd552a67a2444b5bf1626037b6a68f5" candidate_uuid: "f7242ddad7524622981309a9da450238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:09:05.645809 25105 raft_consensus.cc:3055] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:05.646052 25105 raft_consensus.cc:740] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:05.646965 25105 consensus_queue.cc:260] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.648603 25105 raft_consensus.cc:3060] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.650379 25254 raft_consensus.cc:2468] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:09:05.651448 25143 leader_election.cc:304] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:09:05.652448 25417 raft_consensus.cc:2804] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:05.653052 25417 raft_consensus.cc:697] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Becoming Leader. State: Replica: f7242ddad7524622981309a9da450238, State: Running, Role: LEADER
I20260709 12:09:05.654091 25417 consensus_queue.cc:237] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.655723 25105 raft_consensus.cc:2468] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7242ddad7524622981309a9da450238 in term 2.
I20260709 12:09:05.661540 25003 catalog_manager.cc:5697] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 reported cstate change: term changed from 1 to 2, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to f7242ddad7524622981309a9da450238 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "f7242ddad7524622981309a9da450238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.759758 25452 raft_consensus.cc:993] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: : Instructing follower 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:09:05.760258 25452 raft_consensus.cc:1081] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Signalling peer 234a1b4963664022a506355c4f3a5e6c to start an election
I20260709 12:09:05.761890 25254 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb"
dest_uuid: "234a1b4963664022a506355c4f3a5e6c"
 from {username='slave'} at 127.0.0.1:59728
I20260709 12:09:05.762419 25254 raft_consensus.cc:493] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.762740 25254 raft_consensus.cc:3060] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.767515 25254 raft_consensus.cc:515] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.769073 25254 leader_election.cc:290] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 2 election: Requested vote from peers 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971), f7242ddad7524622981309a9da450238 (127.23.222.130:34155)
I20260709 12:09:05.770170 25105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2368fa54c9b2401e92fd72153c23c05b"
I20260709 12:09:05.770412 25179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0803a513442d47909bcf51d9fa7f64eb" candidate_uuid: "234a1b4963664022a506355c4f3a5e6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7242ddad7524622981309a9da450238"
I20260709 12:09:05.770838 25105 raft_consensus.cc:3055] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:05.770958 25179 raft_consensus.cc:3060] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.771193 25105 raft_consensus.cc:740] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2368fa54c9b2401e92fd72153c23c05b, State: Running, Role: LEADER
I20260709 12:09:05.771987 25105 consensus_queue.cc:260] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.773238 25105 raft_consensus.cc:3060] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:05.777972 25179 raft_consensus.cc:2468] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 2.
I20260709 12:09:05.779356 25105 raft_consensus.cc:2468] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 234a1b4963664022a506355c4f3a5e6c in term 2.
I20260709 12:09:05.779376 25220 leader_election.cc:304] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 234a1b4963664022a506355c4f3a5e6c, f7242ddad7524622981309a9da450238; no voters: 
I20260709 12:09:05.780434 25421 raft_consensus.cc:2804] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:05.780951 25421 raft_consensus.cc:697] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 2 LEADER]: Becoming Leader. State: Replica: 234a1b4963664022a506355c4f3a5e6c, State: Running, Role: LEADER
I20260709 12:09:05.781790 25421 consensus_queue.cc:237] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } }
I20260709 12:09:05.785449 25105 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 5 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:05.787165 25417 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:05.790299 25003 catalog_manager.cc:5697] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c reported cstate change: term changed from 1 to 2, leader changed from 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129) to 234a1b4963664022a506355c4f3a5e6c (127.23.222.131). New cstate: current_term: 2 leader_uuid: "234a1b4963664022a506355c4f3a5e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.804374 25254 raft_consensus.cc:1275] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 5 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:05.806792 25467 consensus_queue.cc:1048] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:05.892796 25179 raft_consensus.cc:1275] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.894409 25461 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:05.905622 25105 raft_consensus.cc:1275] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.908177 25421 consensus_queue.cc:1048] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:06.168100 25105 raft_consensus.cc:1275] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:06.169338 25417 consensus_queue.cc:1048] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:06.179872 25254 raft_consensus.cc:1275] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Refusing update from remote peer f7242ddad7524622981309a9da450238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:06.181294 25467 consensus_queue.cc:1048] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "234a1b4963664022a506355c4f3a5e6c" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 46473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:06.268707 25105 raft_consensus.cc:1275] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:06.270305 25461 consensus_queue.cc:1048] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2368fa54c9b2401e92fd72153c23c05b" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 36971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:06.271844 25179 raft_consensus.cc:1275] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Refusing update from remote peer 234a1b4963664022a506355c4f3a5e6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:06.273288 25461 consensus_queue.cc:1048] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7242ddad7524622981309a9da450238" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:06.284776 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.295557 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.296304 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.297313 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.303397 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.303841 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.304908 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.311121 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.311611 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.312520 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.318015 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.318475 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.319345 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.326053 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.326648 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.327692 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.334328 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.334776 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.335708 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.341667 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.342095 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.343106 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.349203 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.349671 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.350723 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:14.356603 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:14.357079 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.395053 24442 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:15.396037 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
I20260709 12:09:15.435331 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.436316 24442 tablet_replica.cc:333] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.437211 24442 raft_consensus.cc:2243] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.438792 24442 raft_consensus.cc:2272] T cf99a79a79b743c2b1e7aec996ae20aa P 2368fa54c9b2401e92fd72153c23c05b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.441061 24442 tablet_replica.cc:333] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.441694 24442 raft_consensus.cc:2243] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.442214 24442 raft_consensus.cc:2272] T 3cd552a67a2444b5bf1626037b6a68f5 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.444500 24442 tablet_replica.cc:333] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.445039 24442 raft_consensus.cc:2243] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.445552 24442 raft_consensus.cc:2272] T afaeba2dc598493a88c382673ec7bece P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.447842 24442 tablet_replica.cc:333] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.448470 24442 raft_consensus.cc:2243] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.449067 24442 raft_consensus.cc:2272] T 0803a513442d47909bcf51d9fa7f64eb P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.448987 25146 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:09:15.452028 24442 tablet_replica.cc:333] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.452677 24442 raft_consensus.cc:2243] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:09:15.453472 25146 consensus_peers.cc:597] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 -> Peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Couldn't send request to peer 2368fa54c9b2401e92fd72153c23c05b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.454080 24442 raft_consensus.cc:2272] T 37c47c76969d46b7a266bd9c1c0b762d P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.456231 24442 tablet_replica.cc:333] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.456784 24442 raft_consensus.cc:2243] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.457316 24442 raft_consensus.cc:2272] T d3dfd502e7694b9c972e3c6635bdb71f P 2368fa54c9b2401e92fd72153c23c05b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.459604 24442 tablet_replica.cc:333] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.460223 24442 raft_consensus.cc:2243] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.461186 24442 raft_consensus.cc:2272] T 59b908d08d9d4a0985f174994b92514a P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.463413 24442 tablet_replica.cc:333] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.463955 24442 raft_consensus.cc:2243] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.464480 24442 raft_consensus.cc:2272] T d51ff3f1ef26436286ab963e1521e6ca P 2368fa54c9b2401e92fd72153c23c05b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.467275 24442 tablet_replica.cc:333] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.468293 24442 raft_consensus.cc:2243] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.469502 24442 raft_consensus.cc:2272] T e4d017908a354fda931cfbbda6de7508 P 2368fa54c9b2401e92fd72153c23c05b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.471735 24442 tablet_replica.cc:333] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b: stopping tablet replica
I20260709 12:09:15.472280 24442 raft_consensus.cc:2243] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.473026 24442 raft_consensus.cc:2272] T 763d024b21444bd08760193e057a434c P 2368fa54c9b2401e92fd72153c23c05b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.503446 25220 consensus_peers.cc:597] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c -> Peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Couldn't send request to peer 2368fa54c9b2401e92fd72153c23c05b. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.513383 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
I20260709 12:09:15.538328 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
I20260709 12:09:15.570180 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.571165 24442 tablet_replica.cc:333] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.572118 24442 raft_consensus.cc:2243] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.572723 24442 raft_consensus.cc:2272] T 0803a513442d47909bcf51d9fa7f64eb P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.575001 24442 tablet_replica.cc:333] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.576049 24442 raft_consensus.cc:2243] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.577337 24442 raft_consensus.cc:2272] T afaeba2dc598493a88c382673ec7bece P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.580348 24442 tablet_replica.cc:333] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.581382 24442 raft_consensus.cc:2243] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.582039 24442 raft_consensus.cc:2272] T e4d017908a354fda931cfbbda6de7508 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.582978 25146 consensus_peers.cc:597] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 -> Peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Couldn't send request to peer 2368fa54c9b2401e92fd72153c23c05b. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.584408 24442 tablet_replica.cc:333] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.585036 24442 raft_consensus.cc:2243] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.586079 24442 raft_consensus.cc:2272] T 3cd552a67a2444b5bf1626037b6a68f5 P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.588152 24442 tablet_replica.cc:333] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.588717 24442 raft_consensus.cc:2243] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.589246 24442 raft_consensus.cc:2272] T cf99a79a79b743c2b1e7aec996ae20aa P f7242ddad7524622981309a9da450238 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.591598 24442 tablet_replica.cc:333] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.592185 24442 raft_consensus.cc:2243] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.592736 24442 raft_consensus.cc:2272] T d3dfd502e7694b9c972e3c6635bdb71f P f7242ddad7524622981309a9da450238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.595008 24442 tablet_replica.cc:333] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.595548 24442 raft_consensus.cc:2243] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.596064 24442 raft_consensus.cc:2272] T 37c47c76969d46b7a266bd9c1c0b762d P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.598121 24442 tablet_replica.cc:333] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.598713 24442 raft_consensus.cc:2243] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.599224 24442 raft_consensus.cc:2272] T d51ff3f1ef26436286ab963e1521e6ca P f7242ddad7524622981309a9da450238 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.600991 24442 tablet_replica.cc:333] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.601502 24442 raft_consensus.cc:2243] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.601966 24442 raft_consensus.cc:2272] T 59b908d08d9d4a0985f174994b92514a P f7242ddad7524622981309a9da450238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.604115 24442 tablet_replica.cc:333] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238: stopping tablet replica
I20260709 12:09:15.604774 24442 raft_consensus.cc:2243] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.606025 24442 raft_consensus.cc:2272] T 763d024b21444bd08760193e057a434c P f7242ddad7524622981309a9da450238 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.639381 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
I20260709 12:09:15.664752 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
W20260709 12:09:15.679033 25220 consensus_peers.cc:597] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c -> Peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Couldn't send request to peer 2368fa54c9b2401e92fd72153c23c05b. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.696749 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.697759 24442 tablet_replica.cc:333] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.699173 24442 raft_consensus.cc:2243] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.700359 24442 raft_consensus.cc:2272] T 0803a513442d47909bcf51d9fa7f64eb P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.702564 24442 tablet_replica.cc:333] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.703116 24442 raft_consensus.cc:2243] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.703657 24442 raft_consensus.cc:2272] T e4d017908a354fda931cfbbda6de7508 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.706718 24442 tablet_replica.cc:333] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.707603 24442 raft_consensus.cc:2243] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.708796 24442 raft_consensus.cc:2272] T d3dfd502e7694b9c972e3c6635bdb71f P 234a1b4963664022a506355c4f3a5e6c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.710055 25220 consensus_peers.cc:597] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c -> Peer 2368fa54c9b2401e92fd72153c23c05b (127.23.222.129:36971): Couldn't send request to peer 2368fa54c9b2401e92fd72153c23c05b. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:36971: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.711182 24442 tablet_replica.cc:333] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.711750 24442 raft_consensus.cc:2243] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.712265 24442 raft_consensus.cc:2272] T 37c47c76969d46b7a266bd9c1c0b762d P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.714687 24442 tablet_replica.cc:333] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.715242 24442 raft_consensus.cc:2243] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.715781 24442 raft_consensus.cc:2272] T cf99a79a79b743c2b1e7aec996ae20aa P 234a1b4963664022a506355c4f3a5e6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.717499 24442 tablet_replica.cc:333] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.718019 24442 raft_consensus.cc:2243] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.718549 24442 raft_consensus.cc:2272] T 3cd552a67a2444b5bf1626037b6a68f5 P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.720393 24442 tablet_replica.cc:333] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.720930 24442 raft_consensus.cc:2243] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.721377 24442 raft_consensus.cc:2272] T afaeba2dc598493a88c382673ec7bece P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.723279 24442 tablet_replica.cc:333] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.723768 24442 raft_consensus.cc:2243] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.724188 24442 raft_consensus.cc:2272] T 763d024b21444bd08760193e057a434c P 234a1b4963664022a506355c4f3a5e6c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.725883 24442 tablet_replica.cc:333] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.726428 24442 raft_consensus.cc:2243] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.727353 24442 raft_consensus.cc:2272] T d51ff3f1ef26436286ab963e1521e6ca P 234a1b4963664022a506355c4f3a5e6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.729679 24442 tablet_replica.cc:333] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c: stopping tablet replica
I20260709 12:09:15.730183 24442 raft_consensus.cc:2243] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.730710 24442 raft_consensus.cc:2272] T 59b908d08d9d4a0985f174994b92514a P 234a1b4963664022a506355c4f3a5e6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.763545 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:09:15.788054 24442 master.cc:562] Master@127.23.222.190:40361 shutting down...
I20260709 12:09:15.821967 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.822715 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.823037 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P f2712858488444f9a80ad8e72429a02e: stopping tablet replica
I20260709 12:09:15.846980 24442 master.cc:584] Master@127.23.222.190:40361 shutdown complete.
234a1b4963664022a506355c4f3a5e6c  1
2368fa54c9b2401e92fd72153c23c05b  5
f7242ddad7524622981309a9da450238  4
234a1b4963664022a506355c4f3a5e6c  3
2368fa54c9b2401e92fd72153c23c05b  3
f7242ddad7524622981309a9da450238  4
234a1b4963664022a506355c4f3a5e6c  1
2368fa54c9b2401e92fd72153c23c05b  8
f7242ddad7524622981309a9da450238  1
234a1b4963664022a506355c4f3a5e6c  3
2368fa54c9b2401e92fd72153c23c05b  4
f7242ddad7524622981309a9da450238  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29269 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:15.900466 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:33735
I20260709 12:09:15.901659 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.908656 25492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.908656 25493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.910002 25495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.910847 24442 server_base.cc:1061] running on GCE node
I20260709 12:09:15.911897 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.912083 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.912237 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598955912219 us; error 0 us; skew 500 ppm
I20260709 12:09:15.912835 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.915948 24442 webserver.cc:533] Webserver started at http://127.23.222.190:42489/ using document root <none> and password file <none>
I20260709 12:09:15.916530 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.916746 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.917076 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.918746 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "522441a6317141cea1e624f44af51018"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-90bm"
I20260709 12:09:15.924885 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:09:15.929301 25500 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.930435 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:09:15.930737 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "522441a6317141cea1e624f44af51018"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-90bm"
I20260709 12:09:15.931010 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.941493 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.942905 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.990494 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:33735
I20260709 12:09:15.990631 25551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:33735 every 8 connection(s)
I20260709 12:09:15.995229 25552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.007203 25552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Bootstrap starting.
I20260709 12:09:16.012873 25552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.018550 25552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: No bootstrap required, opened a new log
I20260709 12:09:16.020819 25552 raft_consensus.cc:359] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522441a6317141cea1e624f44af51018" member_type: VOTER }
I20260709 12:09:16.021507 25552 raft_consensus.cc:385] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.021716 25552 raft_consensus.cc:740] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 522441a6317141cea1e624f44af51018, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.022416 25552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522441a6317141cea1e624f44af51018" member_type: VOTER }
I20260709 12:09:16.022886 25552 raft_consensus.cc:399] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:16.023078 25552 raft_consensus.cc:493] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:16.023314 25552 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.028296 25552 raft_consensus.cc:515] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522441a6317141cea1e624f44af51018" member_type: VOTER }
I20260709 12:09:16.028820 25552 leader_election.cc:304] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 522441a6317141cea1e624f44af51018; no voters: 
I20260709 12:09:16.030119 25552 leader_election.cc:290] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:16.030625 25555 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.032161 25555 raft_consensus.cc:697] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 1 LEADER]: Becoming Leader. State: Replica: 522441a6317141cea1e624f44af51018, State: Running, Role: LEADER
I20260709 12:09:16.032918 25555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522441a6317141cea1e624f44af51018" member_type: VOTER }
I20260709 12:09:16.033525 25552 sys_catalog.cc:565] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:16.039088 25557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 522441a6317141cea1e624f44af51018. Latest consensus state: current_term: 1 leader_uuid: "522441a6317141cea1e624f44af51018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522441a6317141cea1e624f44af51018" member_type: VOTER } }
I20260709 12:09:16.040004 25557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:16.045353 25556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "522441a6317141cea1e624f44af51018" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "522441a6317141cea1e624f44af51018" member_type: VOTER } }
I20260709 12:09:16.046216 25556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:16.047030 25561 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:16.057698 25561 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:16.058908 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:16.069051 25561 catalog_manager.cc:1383] Generated new cluster ID: 8d09977257394cb19f6b82b88ed475eb
I20260709 12:09:16.069373 25561 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:16.096064 25561 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:16.097465 25561 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:16.113762 25561 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Generated new TSK 0
I20260709 12:09:16.114392 25561 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:16.125771 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.132752 25573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.133685 25574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.135159 25576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.135582 24442 server_base.cc:1061] running on GCE node
I20260709 12:09:16.136555 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.136757 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.136904 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598956136890 us; error 0 us; skew 500 ppm
I20260709 12:09:16.137395 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.140163 24442 webserver.cc:533] Webserver started at http://127.23.222.129:43301/ using document root <none> and password file <none>
I20260709 12:09:16.140651 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.140820 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.141040 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.142156 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "56b5d00aa592407c9d5e67a03a961508"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-90bm"
I20260709 12:09:16.147157 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:09:16.151011 25581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.152005 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:09:16.152348 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "56b5d00aa592407c9d5e67a03a961508"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-90bm"
I20260709 12:09:16.152665 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.165078 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.166638 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.168386 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.171072 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.171320 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.171586 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.171787 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.224383 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:43875
I20260709 12:09:16.224502 25643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:43875 every 8 connection(s)
I20260709 12:09:16.229954 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.240010 25649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.242214 25648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.245133 25651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.250233 24442 server_base.cc:1061] running on GCE node
I20260709 12:09:16.252420 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.252671 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.252803 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598956252790 us; error 0 us; skew 500 ppm
I20260709 12:09:16.253549 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.256752 24442 webserver.cc:533] Webserver started at http://127.23.222.130:35223/ using document root <none> and password file <none>
I20260709 12:09:16.257333 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.257618 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.257946 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.257874 25644 heartbeater.cc:344] Connected to a master server at 127.23.222.190:33735
I20260709 12:09:16.258522 25644 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.259712 25644 heartbeater.cc:507] Master 127.23.222.190:33735 requested a full tablet report, sending...
I20260709 12:09:16.259902 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "c781e437472a42e2a6162b67b1c7bbbd"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-90bm"
I20260709 12:09:16.262317 25517 ts_manager.cc:194] Registered new tserver with Master: 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:16.264487 25517 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51974
I20260709 12:09:16.265617 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:09:16.269639 25656 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.270787 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:16.271109 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "c781e437472a42e2a6162b67b1c7bbbd"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-90bm"
I20260709 12:09:16.271442 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.303946 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.305541 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.307339 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.310114 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.310497 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:09:16.310784 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.310966 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.362536 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:39349
I20260709 12:09:16.362641 25718 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:39349 every 8 connection(s)
I20260709 12:09:16.368484 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.377112 25722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.378389 25723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.382081 25725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.382405 25719 heartbeater.cc:344] Connected to a master server at 127.23.222.190:33735
I20260709 12:09:16.382565 24442 server_base.cc:1061] running on GCE node
I20260709 12:09:16.382930 25719 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.383653 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:09:16.383783 25719 heartbeater.cc:507] Master 127.23.222.190:33735 requested a full tablet report, sending...
W20260709 12:09:16.383869 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.384280 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598956384246 us; error 0 us; skew 500 ppm
I20260709 12:09:16.385115 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.386173 25517 ts_manager.cc:194] Registered new tserver with Master: c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:16.387912 25517 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51990
I20260709 12:09:16.388548 24442 webserver.cc:533] Webserver started at http://127.23.222.131:35945/ using document root <none> and password file <none>
I20260709 12:09:16.389271 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.389564 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.389858 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.391469 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "04e6206f9e924fb3931891bf3a64b392"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-90bm"
I20260709 12:09:16.396631 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:16.400686 25730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.401695 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:16.402004 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "04e6206f9e924fb3931891bf3a64b392"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-90bm"
I20260709 12:09:16.402330 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.416334 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.417693 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.419373 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.422003 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.422194 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.422544 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.422693 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.472116 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:44413
I20260709 12:09:16.472237 25792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:44413 every 8 connection(s)
I20260709 12:09:16.487996 25793 heartbeater.cc:344] Connected to a master server at 127.23.222.190:33735
I20260709 12:09:16.488443 25793 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.489261 25793 heartbeater.cc:507] Master 127.23.222.190:33735 requested a full tablet report, sending...
I20260709 12:09:16.491801 25517 ts_manager.cc:194] Registered new tserver with Master: 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:16.491907 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016401855s
I20260709 12:09:16.493686 25517 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51996
I20260709 12:09:16.522076 25517 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52004:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:16.528662 25517 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:16.742394 25758 tablet_service.cc:1511] Processing CreateTablet for tablet 39e6df07fdde400cbbefc675d486ab4a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.744274 25758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e6df07fdde400cbbefc675d486ab4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.744419 25755 tablet_service.cc:1511] Processing CreateTablet for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.746142 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.750804 25757 tablet_service.cc:1511] Processing CreateTablet for tablet 6640372ef1e64554b6b1025b28173499 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.752454 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6640372ef1e64554b6b1025b28173499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.755607 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 2eaf15c7f3ab41eea32890f20f50b4fd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.757143 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaf15c7f3ab41eea32890f20f50b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.761457 25754 tablet_service.cc:1511] Processing CreateTablet for tablet d559aa8dd6d44d11ab56eb9a423319bd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.763108 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 60795798854e400987349043af926b8a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.763528 25753 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba2cd1bc7a14c19bade889bb7b32145 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.764570 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60795798854e400987349043af926b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.766626 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 6225db99ff6d444e990645903f433cf3 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.768039 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6225db99ff6d444e990645903f433cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.770006 25753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba2cd1bc7a14c19bade889bb7b32145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.770699 25752 tablet_service.cc:1511] Processing CreateTablet for tablet e7414eafc9044de28063237176e3435f (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.776695 25754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d559aa8dd6d44d11ab56eb9a423319bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.778963 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7414eafc9044de28063237176e3435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.780431 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 460a9cbf9985461f9237f09b4f5ca854 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.781865 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460a9cbf9985461f9237f09b4f5ca854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.801640 25807 tablet_bootstrap.cc:492] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:16.815582 25755 tablet_service.cc:1511] Processing CreateTablet for tablet 0100a4dff40541e38cf6a72d218d3a44 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.805406 25754 tablet_service.cc:1511] Processing CreateTablet for tablet b7b82e0d41f14cc2baa1e889ed4c7312 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.831442 25754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b82e0d41f14cc2baa1e889ed4c7312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.833308 25749 tablet_service.cc:1511] Processing CreateTablet for tablet f944cbb1f9c948d88b377be34146370e (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.833585 25758 tablet_service.cc:1511] Processing CreateTablet for tablet 7a8225ffb62d4087a3a45c98cc24c581 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.817896 25807 tablet_bootstrap.cc:654] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.819600 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 39e6df07fdde400cbbefc675d486ab4a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.835953 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e6df07fdde400cbbefc675d486ab4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.820098 25683 tablet_service.cc:1511] Processing CreateTablet for tablet 6640372ef1e64554b6b1025b28173499 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.837965 25678 tablet_service.cc:1511] Processing CreateTablet for tablet e7414eafc9044de28063237176e3435f (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.839169 25683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6640372ef1e64554b6b1025b28173499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.841115 25677 tablet_service.cc:1511] Processing CreateTablet for tablet 6225db99ff6d444e990645903f433cf3 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.842651 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6225db99ff6d444e990645903f433cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.844457 25757 tablet_service.cc:1511] Processing CreateTablet for tablet d3e9aede281f4f4d8ad175c6b2357ddc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.845489 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7414eafc9044de28063237176e3435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.846973 25608 tablet_service.cc:1511] Processing CreateTablet for tablet 6640372ef1e64554b6b1025b28173499 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.848399 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6640372ef1e64554b6b1025b28173499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.851653 25607 tablet_service.cc:1511] Processing CreateTablet for tablet 2eaf15c7f3ab41eea32890f20f50b4fd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.851856 25676 tablet_service.cc:1511] Processing CreateTablet for tablet 60795798854e400987349043af926b8a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.853122 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaf15c7f3ab41eea32890f20f50b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.853322 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60795798854e400987349043af926b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.821663 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff1240c7107404994c96234274c5e64 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.822384 25682 tablet_service.cc:1511] Processing CreateTablet for tablet 2eaf15c7f3ab41eea32890f20f50b4fd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.855297 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaf15c7f3ab41eea32890f20f50b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.855100 25606 tablet_service.cc:1511] Processing CreateTablet for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.856068 25675 tablet_service.cc:1511] Processing CreateTablet for tablet 460a9cbf9985461f9237f09b4f5ca854 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.856536 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.857347 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460a9cbf9985461f9237f09b4f5ca854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.860828 25603 tablet_service.cc:1511] Processing CreateTablet for tablet e7414eafc9044de28063237176e3435f (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.858197 25756 tablet_service.cc:1511] Processing CreateTablet for tablet b5d5870a1cad42d2813f1ca36a619afe (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.827368 25680 tablet_service.cc:1511] Processing CreateTablet for tablet d559aa8dd6d44d11ab56eb9a423319bd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.865010 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d559aa8dd6d44d11ab56eb9a423319bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.863487 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 66ff605dcfe14eb0bba410038f643c24 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.829766 25679 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba2cd1bc7a14c19bade889bb7b32145 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.834827 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f944cbb1f9c948d88b377be34146370e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.866681 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0100a4dff40541e38cf6a72d218d3a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.866983 25605 tablet_service.cc:1511] Processing CreateTablet for tablet d559aa8dd6d44d11ab56eb9a423319bd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.868670 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d5870a1cad42d2813f1ca36a619afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.859539 25604 tablet_service.cc:1511] Processing CreateTablet for tablet 2ba2cd1bc7a14c19bade889bb7b32145 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.869649 25603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7414eafc9044de28063237176e3435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.824787 25681 tablet_service.cc:1511] Processing CreateTablet for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.871905 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e9aede281f4f4d8ad175c6b2357ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.873741 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba2cd1bc7a14c19bade889bb7b32145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.874661 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d559aa8dd6d44d11ab56eb9a423319bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.863853 25609 tablet_service.cc:1511] Processing CreateTablet for tablet 39e6df07fdde400cbbefc675d486ab4a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.876943 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e6df07fdde400cbbefc675d486ab4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.878629 25681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.878878 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff1240c7107404994c96234274c5e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.880491 25602 tablet_service.cc:1511] Processing CreateTablet for tablet 6225db99ff6d444e990645903f433cf3 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.882366 25679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba2cd1bc7a14c19bade889bb7b32145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.882601 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ff605dcfe14eb0bba410038f643c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.882645 25602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6225db99ff6d444e990645903f433cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.889187 25758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8225ffb62d4087a3a45c98cc24c581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.897552 25601 tablet_service.cc:1511] Processing CreateTablet for tablet 60795798854e400987349043af926b8a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.905395 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60795798854e400987349043af926b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.900420 25600 tablet_service.cc:1511] Processing CreateTablet for tablet 460a9cbf9985461f9237f09b4f5ca854 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.935061 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8d705bac7f4cac8af41b0b3de03011 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.936465 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8d705bac7f4cac8af41b0b3de03011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.905555 25755 tablet_service.cc:1511] Processing CreateTablet for tablet debca0eda6c649e38d13858860f6a245 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.941056 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460a9cbf9985461f9237f09b4f5ca854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.941179 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debca0eda6c649e38d13858860f6a245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.992555 25807 tablet_bootstrap.cc:492] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:16.993258 25807 ts_tablet_manager.cc:1403] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.192s	user 0.015s	sys 0.010s
I20260709 12:09:16.996438 25807 raft_consensus.cc:359] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.007376 25807 raft_consensus.cc:385] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.007833 25807 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.009682 25676 tablet_service.cc:1511] Processing CreateTablet for tablet b7b82e0d41f14cc2baa1e889ed4c7312 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.012461 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b82e0d41f14cc2baa1e889ed4c7312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.015421 25682 tablet_service.cc:1511] Processing CreateTablet for tablet 0100a4dff40541e38cf6a72d218d3a44 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.016932 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0100a4dff40541e38cf6a72d218d3a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.031186 25676 tablet_service.cc:1511] Processing CreateTablet for tablet f944cbb1f9c948d88b377be34146370e (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.032687 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f944cbb1f9c948d88b377be34146370e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.018039 25809 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:17.010663 25807 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.019730 25684 tablet_service.cc:1511] Processing CreateTablet for tablet d3e9aede281f4f4d8ad175c6b2357ddc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.025733 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 20c583a2390b4b6d955b01e778798db7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.039323 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c583a2390b4b6d955b01e778798db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.006589 25683 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff1240c7107404994c96234274c5e64 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.041229 25683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff1240c7107404994c96234274c5e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.042801 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e9aede281f4f4d8ad175c6b2357ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.052472 25807 ts_tablet_manager.cc:1434] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.012s
W20260709 12:09:17.052963 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.055100 25793 heartbeater.cc:499] Master 127.23.222.190:33735 was elected leader, sending a full tablet report...
I20260709 12:09:17.046038 25681 tablet_service.cc:1511] Processing CreateTablet for tablet 7a8225ffb62d4087a3a45c98cc24c581 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.058624 25681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8225ffb62d4087a3a45c98cc24c581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.060101 25807 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:17.064850 25675 tablet_service.cc:1511] Processing CreateTablet for tablet b5d5870a1cad42d2813f1ca36a619afe (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.072822 25678 tablet_service.cc:1511] Processing CreateTablet for tablet 66ff605dcfe14eb0bba410038f643c24 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.075645 25679 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8d705bac7f4cac8af41b0b3de03011 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.080370 25809 tablet_bootstrap.cc:654] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.081761 25680 tablet_service.cc:1511] Processing CreateTablet for tablet 20c583a2390b4b6d955b01e778798db7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.084668 25677 tablet_service.cc:1511] Processing CreateTablet for tablet debca0eda6c649e38d13858860f6a245 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.085314 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d5870a1cad42d2813f1ca36a619afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.093217 25757 tablet_service.cc:1511] Processing CreateTablet for tablet 4081aaa0ccdd4b4bb28382a955fcd9fc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.094215 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c583a2390b4b6d955b01e778798db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.094607 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4081aaa0ccdd4b4bb28382a955fcd9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.094929 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ff605dcfe14eb0bba410038f643c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.095952 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debca0eda6c649e38d13858860f6a245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.096652 25679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8d705bac7f4cac8af41b0b3de03011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.086042 25807 tablet_bootstrap.cc:654] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.104498 25809 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:17.105044 25809 ts_tablet_manager.cc:1403] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.000s
I20260709 12:09:17.116544 25809 raft_consensus.cc:359] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.125376 25676 tablet_service.cc:1511] Processing CreateTablet for tablet 4081aaa0ccdd4b4bb28382a955fcd9fc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.117308 25809 raft_consensus.cc:385] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.127211 25809 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.130517 25608 tablet_service.cc:1511] Processing CreateTablet for tablet b7b82e0d41f14cc2baa1e889ed4c7312 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.135345 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 84aa327d1e74484291d8031bfc9a9463 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.148993 25602 tablet_service.cc:1511] Processing CreateTablet for tablet f944cbb1f9c948d88b377be34146370e (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.151829 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4081aaa0ccdd4b4bb28382a955fcd9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.152371 25809 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.154992 25604 tablet_service.cc:1511] Processing CreateTablet for tablet 20c583a2390b4b6d955b01e778798db7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.155990 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aa327d1e74484291d8031bfc9a9463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.157845 25606 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff1240c7107404994c96234274c5e64 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.159145 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b82e0d41f14cc2baa1e889ed4c7312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.160619 25719 heartbeater.cc:499] Master 127.23.222.190:33735 was elected leader, sending a full tablet report...
I20260709 12:09:17.167315 25809 ts_tablet_manager.cc:1434] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.003s
I20260709 12:09:17.174909 25809 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:17.136385 25609 tablet_service.cc:1511] Processing CreateTablet for tablet 0100a4dff40541e38cf6a72d218d3a44 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.142056 25811 tablet_bootstrap.cc:492] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:17.145905 25807 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:17.179263 25807 ts_tablet_manager.cc:1403] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.005s
I20260709 12:09:17.182443 25807 raft_consensus.cc:359] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.183216 25807 raft_consensus.cc:385] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.183521 25807 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.184422 25807 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.187095 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0100a4dff40541e38cf6a72d218d3a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.187796 25809 tablet_bootstrap.cc:654] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.189762 25807 ts_tablet_manager.cc:1434] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:09:17.191056 25807 tablet_bootstrap.cc:492] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:17.197857 25807 tablet_bootstrap.cc:654] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.198675 25605 tablet_service.cc:1511] Processing CreateTablet for tablet d3e9aede281f4f4d8ad175c6b2357ddc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.200186 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3e9aede281f4f4d8ad175c6b2357ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.200740 25603 tablet_service.cc:1511] Processing CreateTablet for tablet 66ff605dcfe14eb0bba410038f643c24 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.208189 25601 tablet_service.cc:1511] Processing CreateTablet for tablet b5d5870a1cad42d2813f1ca36a619afe (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.211007 25807 tablet_bootstrap.cc:492] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:17.211988 25807 ts_tablet_manager.cc:1403] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:09:17.195111 25607 tablet_service.cc:1511] Processing CreateTablet for tablet 7a8225ffb62d4087a3a45c98cc24c581 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.215412 25807 raft_consensus.cc:359] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.216225 25807 raft_consensus.cc:385] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.216529 25807 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.217484 25807 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.220161 25807 ts_tablet_manager.cc:1434] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:17.221208 25807 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:17.222373 25605 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8d705bac7f4cac8af41b0b3de03011 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.226850 25603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ff605dcfe14eb0bba410038f643c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.227728 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c583a2390b4b6d955b01e778798db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.229727 25807 tablet_bootstrap.cc:654] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.230829 25602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f944cbb1f9c948d88b377be34146370e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.233644 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff1240c7107404994c96234274c5e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.235545 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8225ffb62d4087a3a45c98cc24c581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.236479 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8d705bac7f4cac8af41b0b3de03011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.242823 25807 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:17.243491 25600 tablet_service.cc:1511] Processing CreateTablet for tablet debca0eda6c649e38d13858860f6a245 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.245476 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debca0eda6c649e38d13858860f6a245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.243541 25807 ts_tablet_manager.cc:1403] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.014s
I20260709 12:09:17.262225 25757 tablet_service.cc:1511] Processing CreateTablet for tablet 84aa327d1e74484291d8031bfc9a9463 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.263659 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aa327d1e74484291d8031bfc9a9463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.268107 25811 tablet_bootstrap.cc:654] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.270566 25644 heartbeater.cc:499] Master 127.23.222.190:33735 was elected leader, sending a full tablet report...
I20260709 12:09:17.274930 25676 tablet_service.cc:1511] Processing CreateTablet for tablet d5b02303361d43d1903c3e943b866b64 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.276486 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b02303361d43d1903c3e943b866b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.284643 25606 tablet_service.cc:1511] Processing CreateTablet for tablet 84aa327d1e74484291d8031bfc9a9463 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.287271 25608 tablet_service.cc:1511] Processing CreateTablet for tablet d5b02303361d43d1903c3e943b866b64 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.289002 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d5870a1cad42d2813f1ca36a619afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.291527 25755 tablet_service.cc:1511] Processing CreateTablet for tablet d5b02303361d43d1903c3e943b866b64 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.292887 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b02303361d43d1903c3e943b866b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.294068 25605 tablet_service.cc:1511] Processing CreateTablet for tablet 4081aaa0ccdd4b4bb28382a955fcd9fc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.290640 25807 raft_consensus.cc:359] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.296805 25807 raft_consensus.cc:385] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.297130 25807 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.298489 25807 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.299455 25604 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4bcd027c7e4c85bf47844eba789061 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.302237 25807 ts_tablet_manager.cc:1434] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 12:09:17.302807 25809 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:17.303306 25809 ts_tablet_manager.cc:1403] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.129s	user 0.047s	sys 0.049s
I20260709 12:09:17.303918 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b02303361d43d1903c3e943b866b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.304586 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aa327d1e74484291d8031bfc9a9463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.306638 25809 raft_consensus.cc:359] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.307389 25809 raft_consensus.cc:385] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.307693 25809 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.308465 25809 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.312072 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4bcd027c7e4c85bf47844eba789061 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.313479 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4bcd027c7e4c85bf47844eba789061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.314541 25810 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.315150 25810 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.318912 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4081aaa0ccdd4b4bb28382a955fcd9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.324257 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4bcd027c7e4c85bf47844eba789061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.326691 25809 ts_tablet_manager.cc:1434] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:09:17.327035 25811 tablet_bootstrap.cc:492] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:17.327570 25811 ts_tablet_manager.cc:1403] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.000s
I20260709 12:09:17.327798 25809 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:17.327909 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 0a4bcd027c7e4c85bf47844eba789061 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.329299 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a4bcd027c7e4c85bf47844eba789061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.331105 25807 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:17.333410 25810 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:17.341079 25681 tablet_service.cc:1511] Processing CreateTablet for tablet 6c38995c6d4645379acd1dcc03a8a65f (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.342667 25681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c38995c6d4645379acd1dcc03a8a65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.342671 25811 raft_consensus.cc:359] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.351209 25811 raft_consensus.cc:385] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.350978 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 6c38995c6d4645379acd1dcc03a8a65f (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.351538 25811 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.352447 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c38995c6d4645379acd1dcc03a8a65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.354104 25680 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.355472 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec1ea6ba3c44e1fb40c2cf3a43f0da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.361467 25754 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.362918 25754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec1ea6ba3c44e1fb40c2cf3a43f0da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.376935 25677 tablet_service.cc:1511] Processing CreateTablet for tablet a1f7a89fe9fd4bf0b5efc34622f42d69 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.378727 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f7a89fe9fd4bf0b5efc34622f42d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.381939 25807 tablet_bootstrap.cc:654] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.382357 25811 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.390530 25758 tablet_service.cc:1511] Processing CreateTablet for tablet a1f7a89fe9fd4bf0b5efc34622f42d69 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.391377 25609 tablet_service.cc:1511] Processing CreateTablet for tablet 6c38995c6d4645379acd1dcc03a8a65f (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.392066 25758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f7a89fe9fd4bf0b5efc34622f42d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.392673 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c38995c6d4645379acd1dcc03a8a65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.398020 25676 tablet_service.cc:1511] Processing CreateTablet for tablet c287ffad962949a7a7a740c373130b71 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.399644 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c287ffad962949a7a7a740c373130b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.415098 25810 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.415691 25810 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.421957 25607 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.423013 25810 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:17.423440 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec1ea6ba3c44e1fb40c2cf3a43f0da6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.423276 25606 tablet_service.cc:1511] Processing CreateTablet for tablet a1f7a89fe9fd4bf0b5efc34622f42d69 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.423954 25603 tablet_service.cc:1511] Processing CreateTablet for tablet c287ffad962949a7a7a740c373130b71 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.425604 25679 tablet_service.cc:1511] Processing CreateTablet for tablet e4e477d5c41447338e4490daf6af0473 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.426867 25679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e477d5c41447338e4490daf6af0473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.430825 25814 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.431447 25814 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.436359 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f7a89fe9fd4bf0b5efc34622f42d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.437654 25814 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:17.461448 25603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c287ffad962949a7a7a740c373130b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.471163 25757 tablet_service.cc:1511] Processing CreateTablet for tablet e4e477d5c41447338e4490daf6af0473 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.472883 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e477d5c41447338e4490daf6af0473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.478307 25675 tablet_service.cc:1511] Processing CreateTablet for tablet 830afb4bf9c747ab89c652d34a9aedef (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.478775 25756 tablet_service.cc:1511] Processing CreateTablet for tablet c287ffad962949a7a7a740c373130b71 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.479714 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830afb4bf9c747ab89c652d34a9aedef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.480334 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c287ffad962949a7a7a740c373130b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.483513 25811 ts_tablet_manager.cc:1434] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.017s
I20260709 12:09:17.484760 25811 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:17.482132 25807 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:17.486517 25807 ts_tablet_manager.cc:1403] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.015s
I20260709 12:09:17.436590 25602 tablet_service.cc:1511] Processing CreateTablet for tablet e4e477d5c41447338e4490daf6af0473 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.490335 25602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4e477d5c41447338e4490daf6af0473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.489672 25807 raft_consensus.cc:359] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.478124 25809 tablet_bootstrap.cc:654] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.500322 25680 tablet_service.cc:1511] Processing CreateTablet for tablet 75613106563e4abcbdf42d2200d80af5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.503980 25810 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.495560 25807 raft_consensus.cc:385] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.513859 25752 tablet_service.cc:1511] Processing CreateTablet for tablet bbb8bd60a08b47bdb117f89304e5dda7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.516955 25822 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.517540 25811 tablet_bootstrap.cc:654] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.518360 25810 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.525712 25677 tablet_service.cc:1511] Processing CreateTablet for tablet e8ccce4d8eb845e4b0f90ae503e00da5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.530028 25684 tablet_service.cc:1511] Processing CreateTablet for tablet bbb8bd60a08b47bdb117f89304e5dda7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.544806 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75613106563e4abcbdf42d2200d80af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.547307 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 830afb4bf9c747ab89c652d34a9aedef (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.538041 25807 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.559262 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ccce4d8eb845e4b0f90ae503e00da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.561170 25810 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:17.551743 25822 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.563829 25678 tablet_service.cc:1511] Processing CreateTablet for tablet 2842bb8137e14414992e2306de44989b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.565680 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2842bb8137e14414992e2306de44989b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.580081 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830afb4bf9c747ab89c652d34a9aedef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.561924 25810 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.590745 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:17.592454 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:17.594096 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb8bd60a08b47bdb117f89304e5dda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.593755 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:17.593916 25732 leader_election.cc:343] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.594937 25732 leader_election.cc:343] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.595623 25732 leader_election.cc:343] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.595814 25753 tablet_service.cc:1511] Processing CreateTablet for tablet 75613106563e4abcbdf42d2200d80af5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.598810 25682 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec4f9939ba74a4a8a5bcc35720a5e31 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.600428 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec4f9939ba74a4a8a5bcc35720a5e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.603608 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:17.605245 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:17.606642 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:17.607986 25732 leader_election.cc:343] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.608495 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:17.609997 25732 leader_election.cc:343] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.610481 25732 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:17.624248 25751 tablet_service.cc:1511] Processing CreateTablet for tablet e8ccce4d8eb845e4b0f90ae503e00da5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.627240 25753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75613106563e4abcbdf42d2200d80af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.627348 25829 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.628129 25829 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.636828 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:17.639266 25658 leader_election.cc:343] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.640394 25605 tablet_service.cc:1511] Processing CreateTablet for tablet 830afb4bf9c747ab89c652d34a9aedef (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.641819 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830afb4bf9c747ab89c652d34a9aedef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.618964 25807 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.650170 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 2842bb8137e14414992e2306de44989b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.650906 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ccce4d8eb845e4b0f90ae503e00da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.651746 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2842bb8137e14414992e2306de44989b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.659919 25822 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:17.587316 25810 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.647238 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb8bd60a08b47bdb117f89304e5dda7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.669987 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60011us
W20260709 12:09:17.671034 25732 leader_election.cc:343] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.671479 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:17.672119 25809 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:17.672667 25809 ts_tablet_manager.cc:1403] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.345s	user 0.036s	sys 0.019s
I20260709 12:09:17.673007 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec4f9939ba74a4a8a5bcc35720a5e31 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.674973 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec4f9939ba74a4a8a5bcc35720a5e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.675877 25809 raft_consensus.cc:359] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.676608 25809 raft_consensus.cc:385] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.676925 25809 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.677807 25809 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.689662 25807 ts_tablet_manager.cc:1434] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.203s	user 0.009s	sys 0.000s
I20260709 12:09:17.691010 25807 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:17.691131 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:17.679811 25601 tablet_service.cc:1511] Processing CreateTablet for tablet bbb8bd60a08b47bdb117f89304e5dda7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.691876 25692 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:17.692898 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb8bd60a08b47bdb117f89304e5dda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.693499 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:17.694572 25829 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.695019 25829 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.688503 25810 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:17.695428 25829 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.706470 25830 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.679808 25604 tablet_service.cc:1511] Processing CreateTablet for tablet 75613106563e4abcbdf42d2200d80af5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.711583 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75613106563e4abcbdf42d2200d80af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.711587 25809 ts_tablet_manager.cc:1434] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:09:17.734990 25807 tablet_bootstrap.cc:654] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.735833 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:17.737264 25677 tablet_service.cc:1511] Processing CreateTablet for tablet 085a5eec03e94a80b662d7995cbee18c (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.738705 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085a5eec03e94a80b662d7995cbee18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.739051 25681 tablet_service.cc:1511] Processing CreateTablet for tablet b57ef007401b4e88884bfaefab8e512b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.740329 25681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57ef007401b4e88884bfaefab8e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.756726 25809 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:17.758109 25758 tablet_service.cc:1511] Processing CreateTablet for tablet b57ef007401b4e88884bfaefab8e512b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.759785 25758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57ef007401b4e88884bfaefab8e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.764103 25603 tablet_service.cc:1511] Processing CreateTablet for tablet e8ccce4d8eb845e4b0f90ae503e00da5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.765580 25603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ccce4d8eb845e4b0f90ae503e00da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.765847 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 085a5eec03e94a80b662d7995cbee18c (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.767174 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085a5eec03e94a80b662d7995cbee18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.751528 25830 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:17.770562 25732 leader_election.cc:343] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.770732 25830 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.773298 25830 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:17.775189 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:17.776716 25732 leader_election.cc:343] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.780834 25606 tablet_service.cc:1511] Processing CreateTablet for tablet 2842bb8137e14414992e2306de44989b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.784603 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:17.785709 25829 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.787003 25768 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:17.794096 25814 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.795480 25814 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.797816 25814 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:17.797991 25678 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcae3b0851948f58bc6dc5970b11943 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.799423 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcae3b0851948f58bc6dc5970b11943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.799469 25601 tablet_service.cc:1511] Processing CreateTablet for tablet 8ec4f9939ba74a4a8a5bcc35720a5e31 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.801044 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:17.802940 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:17.822530 25757 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcae3b0851948f58bc6dc5970b11943 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:09:17.824717 25732 leader_election.cc:343] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.825425 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:17.830790 25830 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.832479 25809 tablet_bootstrap.cc:654] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.827057 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2842bb8137e14414992e2306de44989b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.836035 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:17.807312 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:17.841641 25829 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:17.847815 25608 tablet_service.cc:1511] Processing CreateTablet for tablet b57ef007401b4e88884bfaefab8e512b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.855888 25609 tablet_service.cc:1511] Processing CreateTablet for tablet 085a5eec03e94a80b662d7995cbee18c (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.857184 25814 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.858404 25679 tablet_service.cc:1511] Processing CreateTablet for tablet fa0600a571a0457f804bf9bf88fd9fd4 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.859766 25679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0600a571a0457f804bf9bf88fd9fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.862665 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:17.863936 25658 leader_election.cc:343] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.863704 25602 tablet_service.cc:1511] Processing CreateTablet for tablet fa0600a571a0457f804bf9bf88fd9fd4 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:09:17.865460 25583 leader_election.cc:343] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.859433 25750 tablet_service.cc:1511] Processing CreateTablet for tablet fa0600a571a0457f804bf9bf88fd9fd4 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.866798 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0600a571a0457f804bf9bf88fd9fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.868466 25814 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.855038 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ec4f9939ba74a4a8a5bcc35720a5e31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.879047 25657 leader_election.cc:343] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.879585 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:17.881626 25755 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.883097 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.884608 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:17.886291 25582 leader_election.cc:343] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.886740 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:17.887187 25600 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcae3b0851948f58bc6dc5970b11943 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.887849 25822 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.888561 25680 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.890048 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.890748 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085a5eec03e94a80b662d7995cbee18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.891616 25602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0600a571a0457f804bf9bf88fd9fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.892486 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcae3b0851948f58bc6dc5970b11943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.892627 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcae3b0851948f58bc6dc5970b11943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.893394 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57ef007401b4e88884bfaefab8e512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.896239 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:17.898797 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:17.904922 25692 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:17.907611 25605 tablet_service.cc:1511] Processing CreateTablet for tablet f44656354a354842bb48b4fd32f2c39b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.909240 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44656354a354842bb48b4fd32f2c39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.914489 25814 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.914815 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:17.915948 25829 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.917387 25829 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:17.918483 25829 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:17.920106 25811 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:17.926647 25811 ts_tablet_manager.cc:1403] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.442s	user 0.019s	sys 0.018s
I20260709 12:09:17.928113 25807 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:17.928045 25677 tablet_service.cc:1511] Processing CreateTablet for tablet f44656354a354842bb48b4fd32f2c39b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.928740 25807 ts_tablet_manager.cc:1403] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.238s	user 0.026s	sys 0.026s
I20260709 12:09:17.929561 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44656354a354842bb48b4fd32f2c39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.930176 25607 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.931725 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.940716 25682 tablet_service.cc:1511] Processing CreateTablet for tablet badc1c7146be42a1bb728a36f96a38ab (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:09:17.941918 25732 leader_election.cc:343] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.942400 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc1c7146be42a1bb728a36f96a38ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.951508 25752 tablet_service.cc:1511] Processing CreateTablet for tablet f44656354a354842bb48b4fd32f2c39b (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.952997 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44656354a354842bb48b4fd32f2c39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.961699 25749 tablet_service.cc:1511] Processing CreateTablet for tablet badc1c7146be42a1bb728a36f96a38ab (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.963161 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc1c7146be42a1bb728a36f96a38ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.967958 25604 tablet_service.cc:1511] Processing CreateTablet for tablet badc1c7146be42a1bb728a36f96a38ab (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.969362 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc1c7146be42a1bb728a36f96a38ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.973363 25807 raft_consensus.cc:359] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.930090 25811 raft_consensus.cc:359] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.976962 25811 raft_consensus.cc:385] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.977413 25811 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.978430 25811 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:17.997243 25516 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.974175 25807 raft_consensus.cc:385] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.012758 25600 tablet_service.cc:1511] Processing CreateTablet for tablet a019a0a19861420b8da3d57b0d23ebbd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.014326 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a019a0a19861420b8da3d57b0d23ebbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.000800 25807 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.019016 25807 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.021557 25807 ts_tablet_manager.cc:1434] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.000s
I20260709 12:09:18.025790 25809 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:18.026463 25809 ts_tablet_manager.cc:1403] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.270s	user 0.018s	sys 0.018s
I20260709 12:09:18.029464 25809 raft_consensus.cc:359] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.030206 25809 raft_consensus.cc:385] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.030642 25809 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.031555 25809 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.039434 25811 ts_tablet_manager.cc:1434] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.002s
I20260709 12:09:18.040082 25822 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.040570 25822 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.042804 25822 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.044642 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:18.045326 25767 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:18.047317 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:18.047962 25692 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:18.049304 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:18.052124 25822 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.052512 25822 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.052855 25822 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.055500 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.058097 25809 ts_tablet_manager.cc:1434] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
I20260709 12:09:18.064973 25822 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.081024 25811 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:18.090339 25822 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.090372 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:18.091912 25692 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.092098 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:18.092868 25767 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.098289 25750 tablet_service.cc:1511] Processing CreateTablet for tablet a019a0a19861420b8da3d57b0d23ebbd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.099323 25677 tablet_service.cc:1511] Processing CreateTablet for tablet a019a0a19861420b8da3d57b0d23ebbd (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.100685 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a019a0a19861420b8da3d57b0d23ebbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.102962 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 969280fd738b40ab84e4cf910d39f1dc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.106173 25678 tablet_service.cc:1511] Processing CreateTablet for tablet 969280fd738b40ab84e4cf910d39f1dc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.107559 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969280fd738b40ab84e4cf910d39f1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.099792 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a019a0a19861420b8da3d57b0d23ebbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.109948 25608 tablet_service.cc:1511] Processing CreateTablet for tablet 34f7287caa8a4b84a342ecc197b9fabc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.112871 25692 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:18.129885 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f7287caa8a4b84a342ecc197b9fabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.113843 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969280fd738b40ab84e4cf910d39f1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.120105 25680 tablet_service.cc:1511] Processing CreateTablet for tablet 34f7287caa8a4b84a342ecc197b9fabc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.120937 25807 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.134141 25811 tablet_bootstrap.cc:654] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.134660 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f7287caa8a4b84a342ecc197b9fabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.125718 25600 tablet_service.cc:1511] Processing CreateTablet for tablet 969280fd738b40ab84e4cf910d39f1dc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:09:18.126444 25720 tablet.cc:2406] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:18.129616 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:18.113224 25809 tablet_bootstrap.cc:492] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:18.144436 25822 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.145848 25606 tablet_service.cc:1511] Processing CreateTablet for tablet fca1ee2242e042518b1c8986c3bd8955 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.147073 25767 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:18.147877 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 34f7287caa8a4b84a342ecc197b9fabc (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.151876 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1ee2242e042518b1c8986c3bd8955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.154632 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34f7287caa8a4b84a342ecc197b9fabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.164686 25809 tablet_bootstrap.cc:654] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.175858 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969280fd738b40ab84e4cf910d39f1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.177994 25679 tablet_service.cc:1511] Processing CreateTablet for tablet fca1ee2242e042518b1c8986c3bd8955 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.180655 25822 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:18.187636 25679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1ee2242e042518b1c8986c3bd8955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.187927 25822 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.190927 25604 tablet_service.cc:1511] Processing CreateTablet for tablet bed4e4bd0407478d9750209db4d90dca (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.192338 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4e4bd0407478d9750209db4d90dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.194394 25752 tablet_service.cc:1511] Processing CreateTablet for tablet bed4e4bd0407478d9750209db4d90dca (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.195808 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4e4bd0407478d9750209db4d90dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.196431 25605 tablet_service.cc:1511] Processing CreateTablet for tablet 2103e4c71b8f462bbb8a59f34359b34a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.197703 25811 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:18.197886 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2103e4c71b8f462bbb8a59f34359b34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.198553 25811 ts_tablet_manager.cc:1403] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.118s	user 0.013s	sys 0.014s
I20260709 12:09:18.198966 25682 tablet_service.cc:1511] Processing CreateTablet for tablet bed4e4bd0407478d9750209db4d90dca (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.189589 25807 tablet_bootstrap.cc:654] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.205958 25678 tablet_service.cc:1511] Processing CreateTablet for tablet 2103e4c71b8f462bbb8a59f34359b34a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.210882 25756 tablet_service.cc:1511] Processing CreateTablet for tablet fca1ee2242e042518b1c8986c3bd8955 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.212198 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1ee2242e042518b1c8986c3bd8955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.224027 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 2103e4c71b8f462bbb8a59f34359b34a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.222043 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4e4bd0407478d9750209db4d90dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.230593 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2103e4c71b8f462bbb8a59f34359b34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.230288 25608 tablet_service.cc:1511] Processing CreateTablet for tablet b1deffe0cca244839dc0d8c35e1c9292 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.231817 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1deffe0cca244839dc0d8c35e1c9292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.235307 25809 tablet_bootstrap.cc:492] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:18.236048 25809 ts_tablet_manager.cc:1403] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.006s
I20260709 12:09:18.241678 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2103e4c71b8f462bbb8a59f34359b34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.241714 25811 raft_consensus.cc:359] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:18.243040 25811 raft_consensus.cc:385] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.243343 25811 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.249419 25677 tablet_service.cc:1511] Processing CreateTablet for tablet b1deffe0cca244839dc0d8c35e1c9292 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.250895 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1deffe0cca244839dc0d8c35e1c9292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.256034 25814 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.256565 25814 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.257170 25755 tablet_service.cc:1511] Processing CreateTablet for tablet b1deffe0cca244839dc0d8c35e1c9292 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.258469 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1deffe0cca244839dc0d8c35e1c9292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.258849 25814 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.260944 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:18.261405 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:18.262509 25658 leader_election.cc:343] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.263015 25657 leader_election.cc:343] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.263443 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:18.264564 25814 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.271054 25807 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:18.271728 25807 ts_tablet_manager.cc:1403] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.197s	user 0.018s	sys 0.003s
I20260709 12:09:18.290437 25811 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:18.292819 25809 raft_consensus.cc:359] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.301241 25809 raft_consensus.cc:385] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.301321 25749 tablet_service.cc:1511] Processing CreateTablet for tablet dcdef7196c6a445c945bb47541d7d3ac (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.301725 25809 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.302729 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcdef7196c6a445c945bb47541d7d3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.305567 25680 tablet_service.cc:1511] Processing CreateTablet for tablet dcdef7196c6a445c945bb47541d7d3ac (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.297457 25811 ts_tablet_manager.cc:1434] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.004s
I20260709 12:09:18.306489 25807 raft_consensus.cc:359] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.299523 25606 tablet_service.cc:1511] Processing CreateTablet for tablet dcdef7196c6a445c945bb47541d7d3ac (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.307288 25807 raft_consensus.cc:385] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.307606 25807 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.307006 25517 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.308161 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcdef7196c6a445c945bb47541d7d3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.308386 25807 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.306926 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcdef7196c6a445c945bb47541d7d3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.316727 25811 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:18.309772 25809 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.328964 25809 ts_tablet_manager.cc:1434] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 12:09:18.330233 25809 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:18.332867 25807 ts_tablet_manager.cc:1434] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.003s
I20260709 12:09:18.344514 25807 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.345942 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 05b25fb15a3f49599d4e372d287c828a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.352666 25807 tablet_bootstrap.cc:654] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.334226 25607 tablet_service.cc:1511] Processing CreateTablet for tablet 05b25fb15a3f49599d4e372d287c828a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.371991 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b25fb15a3f49599d4e372d287c828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.372457 25680 tablet_service.cc:1511] Processing CreateTablet for tablet 5de0ecbf35224b6aa22571e4a88d71c0 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.372913 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 5de0ecbf35224b6aa22571e4a88d71c0 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.342700 25682 tablet_service.cc:1511] Processing CreateTablet for tablet 05b25fb15a3f49599d4e372d287c828a (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.374456 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0ecbf35224b6aa22571e4a88d71c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.375070 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b25fb15a3f49599d4e372d287c828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.378029 25678 tablet_service.cc:1511] Processing CreateTablet for tablet d430da6a4c644f538698b570759feb1e (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.366158 25604 tablet_service.cc:1511] Processing CreateTablet for tablet 5de0ecbf35224b6aa22571e4a88d71c0 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.370790 25811 tablet_bootstrap.cc:654] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.365123 25809 tablet_bootstrap.cc:654] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.379734 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0ecbf35224b6aa22571e4a88d71c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.382508 25604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0ecbf35224b6aa22571e4a88d71c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.384559 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b25fb15a3f49599d4e372d287c828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.384783 25679 tablet_service.cc:1511] Processing CreateTablet for tablet 3637b70d215243c283e2280b99045ced (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.386008 25679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3637b70d215243c283e2280b99045ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.379261 25755 tablet_service.cc:1511] Processing CreateTablet for tablet d430da6a4c644f538698b570759feb1e (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.385916 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 3637b70d215243c283e2280b99045ced (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.387040 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d430da6a4c644f538698b570759feb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.387640 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3637b70d215243c283e2280b99045ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.379537 25606 tablet_service.cc:1511] Processing CreateTablet for tablet d430da6a4c644f538698b570759feb1e (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.392954 25608 tablet_service.cc:1511] Processing CreateTablet for tablet 3637b70d215243c283e2280b99045ced (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.394217 25608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3637b70d215243c283e2280b99045ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.399114 25605 tablet_service.cc:1511] Processing CreateTablet for tablet 481bb8b350a240b0a487c38c13791369 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.400488 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bb8b350a240b0a487c38c13791369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.410573 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d430da6a4c644f538698b570759feb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.411331 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 481bb8b350a240b0a487c38c13791369 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.412720 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bb8b350a240b0a487c38c13791369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.415248 25677 tablet_service.cc:1511] Processing CreateTablet for tablet 481bb8b350a240b0a487c38c13791369 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.416541 25677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bb8b350a240b0a487c38c13791369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.425994 25678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d430da6a4c644f538698b570759feb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.431077 25600 tablet_service.cc:1511] Processing CreateTablet for tablet 594f26e3426243d5b79945733b1f2dd5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.432843 25600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594f26e3426243d5b79945733b1f2dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.443559 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 594f26e3426243d5b79945733b1f2dd5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.445029 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594f26e3426243d5b79945733b1f2dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.445638 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 594f26e3426243d5b79945733b1f2dd5 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.446882 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 594f26e3426243d5b79945733b1f2dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.447449 25829 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.447814 25603 tablet_service.cc:1511] Processing CreateTablet for tablet f692b35e5aaf426dbfdc5ec7efe47cc3 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.449070 25603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f692b35e5aaf426dbfdc5ec7efe47cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.465847 25809 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:18.466498 25809 ts_tablet_manager.cc:1403] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.007s
I20260709 12:09:18.483426 25807 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:18.487865 25680 tablet_service.cc:1511] Processing CreateTablet for tablet f692b35e5aaf426dbfdc5ec7efe47cc3 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.489362 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f692b35e5aaf426dbfdc5ec7efe47cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.484166 25807 ts_tablet_manager.cc:1403] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.014s
I20260709 12:09:18.498332 25822 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.498859 25822 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } }
I20260709 12:09:18.501014 25822 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:18.501948 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:18.502903 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:18.504772 25583 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:18.506325 25822 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.508765 25617 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.512578 25807 raft_consensus.cc:359] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.513087 25807 raft_consensus.cc:385] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.511090 25829 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.513967 25829 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.516173 25829 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:18.517267 25809 raft_consensus.cc:359] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.518419 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:18.513423 25807 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.519793 25811 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:18.527886 25756 tablet_service.cc:1511] Processing CreateTablet for tablet f692b35e5aaf426dbfdc5ec7efe47cc3 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.528920 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f692b35e5aaf426dbfdc5ec7efe47cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.526713 25807 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:18.532167 25732 leader_election.cc:343] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.532550 25811 ts_tablet_manager.cc:1403] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.226s	user 0.019s	sys 0.021s
I20260709 12:09:18.533437 25750 tablet_service.cc:1511] Processing CreateTablet for tablet b28e719d6586469e8c186ce7b5af6bc7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.534817 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e719d6586469e8c186ce7b5af6bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.536095 25811 raft_consensus.cc:359] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.536839 25811 raft_consensus.cc:385] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.537117 25811 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.539374 25682 tablet_service.cc:1511] Processing CreateTablet for tablet b28e719d6586469e8c186ce7b5af6bc7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.525738 25809 raft_consensus.cc:385] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.542548 25809 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.543651 25809 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.552261 25807 ts_tablet_manager.cc:1434] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.008s
I20260709 12:09:18.556299 25607 tablet_service.cc:1511] Processing CreateTablet for tablet b28e719d6586469e8c186ce7b5af6bc7 (DEFAULT_TABLE table=test-workload [id=bac210690ba94fa0b2250fd51b0472a8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.557742 25607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e719d6586469e8c186ce7b5af6bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.562337 25807 tablet_bootstrap.cc:492] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.537911 25811 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.562909 25809 ts_tablet_manager.cc:1434] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.001s
I20260709 12:09:18.565490 25811 ts_tablet_manager.cc:1434] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:18.566502 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:18.569466 25692 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:18.571412 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e719d6586469e8c186ce7b5af6bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.571460 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:18.574988 25852 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.575377 25852 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.575724 25852 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.582839 25811 tablet_bootstrap.cc:492] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:18.596203 25807 tablet_bootstrap.cc:654] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.596487 25809 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:18.601107 25829 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.605880 25811 tablet_bootstrap.cc:654] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.603857 25852 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.608417 25852 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:18.609143 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:18.611481 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:18.612083 25693 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.618835 25732 leader_election.cc:343] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.622889 25693 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:18.624946 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:18.626408 25814 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.627004 25814 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.628299 25852 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.632802 25852 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:18.651538 25852 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:18.680521 25501 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 56993.7us
W20260709 12:09:18.680938 25502 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56274.8us
I20260709 12:09:18.688673 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:18.689416 25767 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:18.686693 25807 tablet_bootstrap.cc:492] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:18.686450 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:18.687394 25814 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.690414 25807 ts_tablet_manager.cc:1403] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.006s
I20260709 12:09:18.689841 25809 tablet_bootstrap.cc:654] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.692651 25658 leader_election.cc:343] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.696349 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:18.686725 25811 tablet_bootstrap.cc:492] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:18.698876 25811 ts_tablet_manager.cc:1403] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.116s	user 0.024s	sys 0.013s
I20260709 12:09:18.699580 25814 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.700143 25814 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.700598 25814 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.705300 25807 raft_consensus.cc:359] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.705905 25807 raft_consensus.cc:385] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.706141 25807 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.708364 25807 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.713128 25807 ts_tablet_manager.cc:1434] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:09:18.713608 25822 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.714171 25807 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.724252 25807 tablet_bootstrap.cc:654] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.729924 25517 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.738890 25811 raft_consensus.cc:359] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.740262 25811 raft_consensus.cc:385] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.740747 25811 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.741813 25811 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.758039 25811 ts_tablet_manager.cc:1434] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.000s
I20260709 12:09:18.759656 25811 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:18.761492 25814 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.764705 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:18.766085 25658 leader_election.cc:343] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.768347 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:18.768985 25767 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.776125 25807 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:18.777017 25807 ts_tablet_manager.cc:1403] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.010s
I20260709 12:09:18.780689 25807 raft_consensus.cc:359] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.784965 25807 raft_consensus.cc:385] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.785724 25807 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.787307 25807 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.790684 25767 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:18.792294 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:18.770947 25814 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.793419 25860 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.794308 25860 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:18.795392 25860 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.796715 25811 tablet_bootstrap.cc:654] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.792704 25807 ts_tablet_manager.cc:1434] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:09:18.800572 25807 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.816520 25809 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:18.817605 25809 ts_tablet_manager.cc:1403] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.221s	user 0.042s	sys 0.030s
I20260709 12:09:18.816622 25865 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.819857 25865 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.821928 25809 raft_consensus.cc:359] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.823010 25809 raft_consensus.cc:385] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.823411 25809 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.823647 25865 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.829119 25807 tablet_bootstrap.cc:654] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.825759 25809 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.832088 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:18.832985 25767 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:18.834679 25582 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:18.835095 25809 ts_tablet_manager.cc:1434] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 12:09:18.841295 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:18.842334 25811 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:18.842932 25811 ts_tablet_manager.cc:1403] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.016s
I20260709 12:09:18.843818 25867 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.842018 25693 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:18.838479 25822 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.845860 25809 tablet_bootstrap.cc:492] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:18.856182 25807 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:18.856818 25807 ts_tablet_manager.cc:1403] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.002s
I20260709 12:09:18.845346 25822 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.864374 25822 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.866187 25514 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.859186 25811 raft_consensus.cc:359] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.872453 25811 raft_consensus.cc:385] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.872844 25811 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.873468 25807 raft_consensus.cc:359] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.873705 25811 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.881628 25822 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.882534 25811 ts_tablet_manager.cc:1434] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:09:18.883594 25811 tablet_bootstrap.cc:492] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:18.884687 25822 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.886307 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:18.886924 25693 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.887619 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:18.888264 25767 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.880136 25809 tablet_bootstrap.cc:654] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.898643 25693 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:18.900194 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:18.901161 25869 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.901211 25822 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.901959 25822 raft_consensus.cc:697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:18.901779 25869 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.903052 25822 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.904742 25807 raft_consensus.cc:385] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.905053 25807 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.905815 25807 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.906215 25869 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.906109 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:18.906503 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:18.907681 25767 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
W20260709 12:09:18.908191 25582 leader_election.cc:343] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.908773 25811 tablet_bootstrap.cc:654] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.909759 25583 leader_election.cc:343] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.910228 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:18.911909 25869 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.908197 25807 ts_tablet_manager.cc:1434] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:09:18.912849 25809 tablet_bootstrap.cc:492] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:18.913094 25807 tablet_bootstrap.cc:492] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.913470 25809 ts_tablet_manager.cc:1403] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.006s
I20260709 12:09:18.919477 25852 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.920061 25852 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.922222 25852 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:18.924361 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:18.923946 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:18.925058 25693 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:18.924505 25807 tablet_bootstrap.cc:654] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.925354 25617 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:18.919142 25809 raft_consensus.cc:359] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.926630 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:18.927438 25852 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.927856 25852 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.928207 25852 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.927117 25809 raft_consensus.cc:385] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.933508 25809 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.934413 25809 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.934952 25852 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.937671 25809 ts_tablet_manager.cc:1434] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:09:18.938597 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:18.939294 25617 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.939905 25811 tablet_bootstrap.cc:492] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:18.940444 25811 ts_tablet_manager.cc:1403] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.007s
I20260709 12:09:18.941337 25860 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.943864 25811 raft_consensus.cc:359] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.944659 25811 raft_consensus.cc:385] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.944952 25811 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.945013 25852 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:18.941821 25860 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.947250 25807 tablet_bootstrap.cc:492] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:18.947775 25807 ts_tablet_manager.cc:1403] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 12:09:18.948423 25860 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:18.947688 25515 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.950770 25807 raft_consensus.cc:359] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.950941 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:18.950992 25617 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:18.951476 25807 raft_consensus.cc:385] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.951812 25807 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.952768 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:18.952952 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:18.952816 25811 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.953557 25693 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.954375 25657 leader_election.cc:343] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.955849 25811 ts_tablet_manager.cc:1434] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:18.956934 25811 tablet_bootstrap.cc:492] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:18.957691 25809 tablet_bootstrap.cc:492] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:18.958557 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:18.960129 25658 leader_election.cc:343] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.960583 25658 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:18.961082 25693 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:18.962059 25860 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.963100 25852 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.964186 25809 tablet_bootstrap.cc:654] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.964390 25852 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:18.964519 25807 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.965315 25852 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.966828 25807 ts_tablet_manager.cc:1434] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:18.964181 25811 tablet_bootstrap.cc:654] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.967851 25807 tablet_bootstrap.cc:492] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:18.974947 25807 tablet_bootstrap.cc:654] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.988776 25811 tablet_bootstrap.cc:492] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:18.989468 25811 ts_tablet_manager.cc:1403] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.009s
I20260709 12:09:18.993062 25811 raft_consensus.cc:359] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.993839 25811 raft_consensus.cc:385] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.994177 25811 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.993933 25515 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.995065 25811 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:18.996659 25809 tablet_bootstrap.cc:492] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:18.997218 25809 ts_tablet_manager.cc:1403] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260709 12:09:18.997171 25811 ts_tablet_manager.cc:1434] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.000561 25809 raft_consensus.cc:359] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.001421 25809 raft_consensus.cc:385] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.001636 25811 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.002797 25807 tablet_bootstrap.cc:492] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.001717 25809 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.003364 25807 ts_tablet_manager.cc:1403] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.012s
I20260709 12:09:19.003839 25809 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.008139 25809 ts_tablet_manager.cc:1434] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:19.009234 25809 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.011822 25822 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.012365 25822 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.014652 25822 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.015754 25809 tablet_bootstrap.cc:654] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.016399 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.017104 25767 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:19.018884 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:19.019775 25822 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.020156 25822 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.020556 25822 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.020342 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.022536 25811 tablet_bootstrap.cc:654] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.022433 25583 leader_election.cc:343] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.025807 25807 raft_consensus.cc:359] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.032099 25807 raft_consensus.cc:385] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.032509 25807 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.033850 25807 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.035851 25852 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.036299 25852 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.036780 25807 ts_tablet_manager.cc:1434] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:09:19.037745 25807 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.038424 25852 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.040398 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.040436 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:19.043534 25732 leader_election.cc:343] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.044296 25732 leader_election.cc:343] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.044724 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.045851 25852 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.046305 25809 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:19.046775 25809 ts_tablet_manager.cc:1403] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.007s
I20260709 12:09:19.046859 25807 tablet_bootstrap.cc:654] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.047824 25811 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.048331 25811 ts_tablet_manager.cc:1403] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.016s
I20260709 12:09:19.049808 25809 raft_consensus.cc:359] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.051235 25811 raft_consensus.cc:359] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.052012 25811 raft_consensus.cc:385] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.052326 25811 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.051256 25809 raft_consensus.cc:385] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.052819 25809 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.053154 25811 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.053610 25809 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.055321 25811 ts_tablet_manager.cc:1434] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:09:19.056151 25809 ts_tablet_manager.cc:1434] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:19.057462 25807 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.058084 25807 ts_tablet_manager.cc:1403] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 12:09:19.059904 25822 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.059160 25809 tablet_bootstrap.cc:492] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.062911 25822 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:19.064761 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.064898 25807 raft_consensus.cc:359] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.065625 25811 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.067253 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:19.065716 25807 raft_consensus.cc:385] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.067849 25767 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.068012 25807 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.069243 25807 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.073143 25811 tablet_bootstrap.cc:654] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.070539 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:19.075135 25807 ts_tablet_manager.cc:1434] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:09:19.073143 25809 tablet_bootstrap.cc:654] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.075563 25583 leader_election.cc:343] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.084602 25767 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:19.078424 25807 tablet_bootstrap.cc:492] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.088927 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.090386 25822 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.090873 25822 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:19.092499 25807 tablet_bootstrap.cc:654] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.092180 25822 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.105842 25807 tablet_bootstrap.cc:492] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.106567 25807 ts_tablet_manager.cc:1403] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.001s
I20260709 12:09:19.109684 25807 raft_consensus.cc:359] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.110244 25807 raft_consensus.cc:385] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.110524 25807 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.111168 25811 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.111171 25807 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.111939 25811 ts_tablet_manager.cc:1403] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.020s
I20260709 12:09:19.114077 25807 ts_tablet_manager.cc:1434] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:19.115572 25807 tablet_bootstrap.cc:492] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.115319 25811 raft_consensus.cc:359] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.116035 25811 raft_consensus.cc:385] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.116314 25811 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.118069 25811 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.119745 25809 tablet_bootstrap.cc:492] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:19.119089 25517 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.120343 25809 ts_tablet_manager.cc:1403] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.011s
I20260709 12:09:19.120489 25811 ts_tablet_manager.cc:1434] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:19.121490 25811 tablet_bootstrap.cc:492] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.122105 25807 tablet_bootstrap.cc:654] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.123580 25809 raft_consensus.cc:359] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.124377 25809 raft_consensus.cc:385] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.124768 25809 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.125660 25809 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.127949 25811 tablet_bootstrap.cc:654] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.128845 25809 ts_tablet_manager.cc:1434] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:19.132948 25807 tablet_bootstrap.cc:492] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.133433 25807 ts_tablet_manager.cc:1403] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 12:09:19.138723 25809 tablet_bootstrap.cc:492] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.141913 25807 raft_consensus.cc:359] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.142683 25807 raft_consensus.cc:385] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.142941 25807 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.143656 25807 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.146138 25807 ts_tablet_manager.cc:1434] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:19.147148 25807 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.151495 25809 tablet_bootstrap.cc:654] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.153409 25807 tablet_bootstrap.cc:654] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.166587 25809 tablet_bootstrap.cc:492] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:19.166587 25807 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.166688 25811 tablet_bootstrap.cc:492] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.167228 25807 ts_tablet_manager.cc:1403] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 12:09:19.167228 25809 ts_tablet_manager.cc:1403] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 12:09:19.167446 25811 ts_tablet_manager.cc:1403] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.015s
I20260709 12:09:19.169745 25811 raft_consensus.cc:359] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.170446 25811 raft_consensus.cc:385] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.170183 25807 raft_consensus.cc:359] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.170737 25811 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.170554 25809 raft_consensus.cc:359] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.170895 25807 raft_consensus.cc:385] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.171021 25852 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.171339 25807 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.171316 25809 raft_consensus.cc:385] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.171833 25809 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.171506 25852 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.171631 25811 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.172454 25807 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.172492 25809 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.173506 25829 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.174809 25809 ts_tablet_manager.cc:1434] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:09:19.175592 25811 ts_tablet_manager.cc:1434] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:19.175792 25809 tablet_bootstrap.cc:492] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.176606 25811 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.181562 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.182407 25617 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.182862 25809 tablet_bootstrap.cc:654] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.183096 25811 tablet_bootstrap.cc:654] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.183521 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.184279 25693 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.190675 25807 ts_tablet_manager.cc:1434] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:09:19.191560 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:19.192073 25807 tablet_bootstrap.cc:492] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.193075 25853 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.193750 25853 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.196591 25853 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.197366 25853 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.173974 25829 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.208395 25829 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.210493 25853 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.211091 25853 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.173957 25852 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.214830 25860 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.215641 25860 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.219923 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.201787 25807 tablet_bootstrap.cc:654] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.205216 25809 tablet_bootstrap.cc:492] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:19.220896 25617 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.221218 25809 ts_tablet_manager.cc:1403] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.012s
I20260709 12:09:19.221438 25853 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.222609 25658 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:19.223541 25814 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.223981 25814 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.224166 25860 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.224361 25814 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.224737 25809 raft_consensus.cc:359] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.225692 25809 raft_consensus.cc:385] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.226034 25809 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.227098 25809 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.230141 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.230845 25767 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.232434 25809 ts_tablet_manager.cc:1434] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:19.233996 25853 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.238468 25809 tablet_bootstrap.cc:492] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.239423 25814 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.243057 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.243681 25617 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.245462 25809 tablet_bootstrap.cc:654] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.257968 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:19.258818 25767 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.263470 25895 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.264215 25895 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.268213 25811 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.269773 25807 tablet_bootstrap.cc:492] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.270457 25807 ts_tablet_manager.cc:1403] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.000s
I20260709 12:09:19.274384 25811 ts_tablet_manager.cc:1403] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.019s
I20260709 12:09:19.275897 25895 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.276036 25853 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.276710 25853 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.277432 25767 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:19.278844 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:19.279444 25853 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.279649 25860 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.273999 25814 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:19.280701 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 89244.3us
I20260709 12:09:19.281209 25807 raft_consensus.cc:359] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.282179 25807 raft_consensus.cc:385] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.282548 25807 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.282971 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.283270 25807 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.284631 25811 raft_consensus.cc:359] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.285326 25811 raft_consensus.cc:385] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.285585 25811 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.286343 25811 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.292985 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.294909 25811 ts_tablet_manager.cc:1434] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:09:19.295398 25807 ts_tablet_manager.cc:1434] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:09:19.296394 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.298609 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.302757 25811 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.314790 25814 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.315313 25814 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.303269 25619 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.318778 25814 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.309641 25617 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:19.301162 25853 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.324681 25814 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.323640 25853 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.326078 25860 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:19.330842 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.334195 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:19.336831 25657 leader_election.cc:343] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.332125 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.337852 25618 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.336484 25860 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.331414 25807 tablet_bootstrap.cc:492] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.334808 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:19.338958 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.341290 25692 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.341393 25617 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.342721 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:19.330031 25814 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.347853 25853 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.355279 25809 tablet_bootstrap.cc:492] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:19.356042 25809 ts_tablet_manager.cc:1403] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.118s	user 0.039s	sys 0.035s
I20260709 12:09:19.359758 25811 tablet_bootstrap.cc:654] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.361351 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.359381 25860 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:19.363096 25693 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.363139 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.363840 25860 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.367065 25807 tablet_bootstrap.cc:654] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.368151 25814 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.373081 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.373431 25619 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.373960 25768 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:09:19.372159 25732 leader_election.cc:343] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.378196 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.384917 25867 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.385699 25867 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:19.388329 25732 leader_election.cc:343] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.390751 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.391364 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:19.387311 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:19.392576 25732 leader_election.cc:343] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.393082 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.394658 25853 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.395277 25853 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.396328 25894 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.395936 25869 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.395789 25853 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.401901 25809 raft_consensus.cc:359] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.402659 25809 raft_consensus.cc:385] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.402956 25809 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.404266 25867 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.404819 25898 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.405201 25898 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.405536 25898 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.407437 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.410931 25894 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.411445 25894 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.413467 25618 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:19.396482 25895 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:09:19.413864 25515 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.415767 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.418412 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.419090 25693 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:19.418977 25869 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.403637 25809 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:19.420508 25732 leader_election.cc:343] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.421898 25860 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.422109 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.422454 25860 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.423290 25895 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.423659 25809 ts_tablet_manager.cc:1434] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.001s
I20260709 12:09:19.424659 25809 tablet_bootstrap.cc:492] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.425428 25829 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.425882 25829 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.427948 25829 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.422122 25658 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:19.429697 25894 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.424592 25860 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.434024 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:19.437152 25860 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.438128 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.439077 25618 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.438468 25869 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:19.439728 25869 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.440171 25869 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.440886 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:19.442166 25732 leader_election.cc:343] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.444454 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.464038 25807 tablet_bootstrap.cc:492] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.464612 25807 ts_tablet_manager.cc:1403] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.001s
I20260709 12:09:19.470038 25853 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.448586 25894 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.473016 25900 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.477409 25807 raft_consensus.cc:359] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.478487 25807 raft_consensus.cc:385] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.478849 25807 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.480780 25811 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.479882 25807 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.481362 25811 ts_tablet_manager.cc:1403] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.179s	user 0.026s	sys 0.030s
W20260709 12:09:19.482501 25732 leader_election.cc:343] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.473076 25894 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.492154 25811 raft_consensus.cc:359] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.495666 25811 raft_consensus.cc:385] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.496243 25807 ts_tablet_manager.cc:1434] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:09:19.496243 25811 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.497797 25807 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.497458 25811 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.473577 25900 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:19.483537 25732 leader_election.cc:343] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.516985 25811 ts_tablet_manager.cc:1434] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 12:09:19.518488 25811 tablet_bootstrap.cc:492] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.508729 25766 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.511968 25895 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.534987 25822 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.534792 25895 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.535533 25822 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.537948 25895 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.508988 25900 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.507709 25894 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.563230 25895 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 12:09:19.579157 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 106772us
I20260709 12:09:19.512781 25898 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.582844 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:19.599181 25895 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.599720 25895 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:19.600680 25895 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.602736 25811 tablet_bootstrap.cc:654] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.605504 25732 leader_election.cc:343] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.607645 25809 tablet_bootstrap.cc:654] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.591346 25853 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.606009 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.617218 25822 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.602649 25692 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:19.627949 25860 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.619153 25829 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.630024 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.620486 25869 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.659888 25807 tablet_bootstrap.cc:654] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.644503 25869 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.663640 25898 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.623072 25900 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:19.661850 25732 leader_election.cc:343] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.672950 25914 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.693171 25811 tablet_bootstrap.cc:492] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.693815 25811 ts_tablet_manager.cc:1403] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.176s	user 0.011s	sys 0.015s
I20260709 12:09:19.697149 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.698024 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.700346 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.700942 25619 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.695796 25898 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.702602 25898 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.690346 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.707620 25898 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:19.708962 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49645.7us
I20260709 12:09:19.698745 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.711498 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.695312 25914 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.716221 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.716595 25616 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:19.716027 25517 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.724433 25809 tablet_bootstrap.cc:492] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:19.707652 25900 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.725173 25809 ts_tablet_manager.cc:1403] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.301s	user 0.014s	sys 0.025s
I20260709 12:09:19.720830 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.719931 25895 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.732036 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.734911 25811 raft_consensus.cc:359] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.735661 25811 raft_consensus.cc:385] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.736018 25811 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.735730 25615 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.736763 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.737128 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.736816 25811 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.727656 25694 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.737854 25691 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.740949 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.742709 25619 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:19.744807 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.745719 25694 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:19.746546 25618 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:19.745735 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:19.748494 25691 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.748449 25583 leader_election.cc:343] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.752007 25811 ts_tablet_manager.cc:1434] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 12:09:19.753031 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:19.753935 25768 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.754122 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:19.754201 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.755081 25767 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.758172 25811 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.751041 25693 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:19.756783 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.760921 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:19.762619 25900 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.763190 25900 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:19.764017 25900 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.767601 25829 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 12:09:19.781571 25895 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:09:19.811666 25895 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:19.812151 25895 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:09:19.767463 25732 leader_election.cc:343] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.812937 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45517.9us
I20260709 12:09:19.813576 25811 tablet_bootstrap.cc:654] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.820410 25768 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:19.821534 25869 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.822846 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:19.824497 25809 raft_consensus.cc:359] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.825248 25809 raft_consensus.cc:385] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.825523 25809 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.824857 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:19.824518 25829 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.826781 25829 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.826818 25853 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.827204 25829 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.827286 25853 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.827733 25853 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.828574 25811 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.829068 25811 ts_tablet_manager.cc:1403] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.001s
I20260709 12:09:19.764550 25914 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.831259 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:19.832089 25814 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.832527 25814 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.832885 25814 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.833470 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:19.815107 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:19.834695 25767 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.834743 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.835938 25691 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:19.836647 25809 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:19.838680 25658 leader_election.cc:343] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.839046 25809 ts_tablet_manager.cc:1434] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.112s	user 0.005s	sys 0.002s
W20260709 12:09:19.817245 25582 leader_election.cc:343] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.839609 25807 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:19.764751 25618 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.840071 25809 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:19.839514 25582 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.813231 25895 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.842674 25895 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.847311 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.850791 25869 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.851258 25807 ts_tablet_manager.cc:1403] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.354s	user 0.016s	sys 0.011s
I20260709 12:09:19.850775 25894 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.852787 25811 raft_consensus.cc:359] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.853820 25811 raft_consensus.cc:385] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.854104 25811 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
W20260709 12:09:19.854794 25732 leader_election.cc:343] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.854914 25811 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.845824 25814 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.856303 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.856621 25913 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.856781 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.857113 25913 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.853458 25767 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:19.859301 25913 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.859974 25867 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:19.862071 25853 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.860416 25869 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.863473 25766 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:19.861304 25618 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:19.864298 25811 ts_tablet_manager.cc:1434] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.002s
I20260709 12:09:19.863849 25894 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.865330 25811 tablet_bootstrap.cc:492] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:19.864259 25853 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.867007 25814 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.849618 25517 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.874704 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:19.875787 25900 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.877563 25900 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.878139 25900 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:19.882377 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:19.874184 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:19.882130 25900 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.883703 25693 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:19.885669 25811 tablet_bootstrap.cc:654] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.887032 25657 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:19.889123 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:19.889503 25914 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.889984 25766 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:19.891388 25829 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.894085 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.894801 25767 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:19.895012 25619 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.872972 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:19.899876 25582 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.900559 25853 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.900682 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:19.900918 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:19.908265 25869 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.891808 25814 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.904264 25829 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:19.913594 25807 raft_consensus.cc:359] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.914345 25807 raft_consensus.cc:385] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.914592 25807 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.915244 25807 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.916493 25814 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:19.948195 25807 ts_tablet_manager.cc:1434] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.001s
I20260709 12:09:19.952270 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:19.977134 25807 tablet_bootstrap.cc:492] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:19.976440 25900 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:19.978749 25811 tablet_bootstrap.cc:492] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:19.979401 25811 ts_tablet_manager.cc:1403] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.006s
I20260709 12:09:19.920022 25829 raft_consensus.cc:2764] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:09:19.950991 25853 raft_consensus.cc:697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:19.992434 25809 tablet_bootstrap.cc:654] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.991279 25853 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:19.995075 25924 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:09:19.997354 25814 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:19.997632 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:19.999667 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.000324 25767 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:19.988837 25867 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.955871 25619 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
W20260709 12:09:20.017211 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 116589us
I20260709 12:09:20.019263 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:20.039206 25811 raft_consensus.cc:359] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.069448 25811 raft_consensus.cc:385] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.069743 25811 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.070423 25811 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:20.075371 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62090.6us
I20260709 12:09:20.034526 25914 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.034526 25869 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.048867 25926 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.076051 25814 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.084594 25814 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.085000 25814 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.025393 25658 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:20.087944 25898 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.088527 25898 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:20.089512 25898 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.092065 25693 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:20.019979 25867 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.097201 25811 ts_tablet_manager.cc:1434] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.117s	user 0.011s	sys 0.000s
I20260709 12:09:20.102134 25811 tablet_bootstrap.cc:492] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
W20260709 12:09:20.096438 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71162.6us
W20260709 12:09:20.103441 25732 leader_election.cc:343] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.096835 25926 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:20.116406 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:09:20.109759 25658 leader_election.cc:343] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.131847 25814 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.132084 25515 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.140556 25811 tablet_bootstrap.cc:654] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.140710 25807 tablet_bootstrap.cc:654] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.144335 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:20.144232 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.145025 25766 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
W20260709 12:09:20.145780 25583 leader_election.cc:343] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.148752 25926 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:20.143193 25867 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.148393 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:20.149748 25617 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.150527 25814 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.151461 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.153498 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:20.155457 25766 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.156536 25809 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:20.157035 25809 ts_tablet_manager.cc:1403] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.317s	user 0.017s	sys 0.014s
I20260709 12:09:20.155596 25867 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.160061 25867 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.160655 25867 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.164398 25514 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.136325 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:20.182533 25926 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.183429 25809 raft_consensus.cc:359] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.184120 25809 raft_consensus.cc:385] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.184372 25809 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.183429 25926 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:20.186110 25926 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.187561 25766 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:20.188771 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:20.188712 25809 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.182189 25617 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:20.190630 25898 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.191228 25898 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:20.192263 25898 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.193810 25809 ts_tablet_manager.cc:1434] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 12:09:20.194890 25809 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:20.195606 25811 tablet_bootstrap.cc:492] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:20.196249 25811 ts_tablet_manager.cc:1403] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.005s
I20260709 12:09:20.198457 25807 tablet_bootstrap.cc:492] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:20.199188 25807 ts_tablet_manager.cc:1403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.013s
I20260709 12:09:20.196220 25867 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.203179 25867 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.205269 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:20.205757 25809 tablet_bootstrap.cc:654] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.197685 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67952.9us
W20260709 12:09:20.206982 25583 leader_election.cc:343] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.209583 25811 raft_consensus.cc:359] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.210929 25811 raft_consensus.cc:385] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.211179 25811 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.211843 25811 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.201766 25517 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.217669 25807 raft_consensus.cc:359] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.218353 25807 raft_consensus.cc:385] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.218645 25807 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.210350 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:20.221252 25811 ts_tablet_manager.cc:1434] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:09:20.222512 25811 tablet_bootstrap.cc:492] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:20.219441 25807 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.220655 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:20.223958 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:20.224596 25619 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:20.221745 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:20.225392 25617 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:20.219879 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:20.229660 25766 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.231297 25807 ts_tablet_manager.cc:1434] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:09:20.232291 25807 tablet_bootstrap.cc:492] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
W20260709 12:09:20.234025 25732 leader_election.cc:343] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.234395 25853 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.236789 25829 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.237962 25514 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.241153 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.242865 25829 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.243261 25829 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.243621 25829 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.244694 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.245859 25930 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.251282 25766 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:20.256196 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.256563 25811 tablet_bootstrap.cc:654] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.258375 25829 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.257800 25867 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.260413 25807 tablet_bootstrap.cc:654] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.261334 25867 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:20.265677 25867 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.274220 25809 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:20.275015 25809 ts_tablet_manager.cc:1403] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.009s
I20260709 12:09:20.287211 25809 raft_consensus.cc:359] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.288229 25809 raft_consensus.cc:385] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.288380 25829 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:20.288614 25809 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.291501 25809 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.295393 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:20.295393 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:20.301175 25617 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.309134 25732 leader_election.cc:343] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.311357 25898 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.320729 25809 ts_tablet_manager.cc:1434] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.002s
I20260709 12:09:20.322715 25809 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:20.331380 25807 tablet_bootstrap.cc:492] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:20.332082 25807 ts_tablet_manager.cc:1403] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.004s
I20260709 12:09:20.335974 25811 tablet_bootstrap.cc:492] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:20.329959 25514 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.336828 25811 ts_tablet_manager.cc:1403] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.115s	user 0.028s	sys 0.030s
I20260709 12:09:20.338587 25617 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:20.340229 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.341571 25853 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.342088 25853 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:20.342939 25853 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.343971 25809 tablet_bootstrap.cc:654] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.361173 25807 raft_consensus.cc:359] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.361991 25807 raft_consensus.cc:385] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.362282 25807 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.363828 25807 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.366243 25900 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.367870 25807 ts_tablet_manager.cc:1434] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 12:09:20.366509 25811 raft_consensus.cc:359] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.369033 25811 raft_consensus.cc:385] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.370800 25811 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.372623 25807 tablet_bootstrap.cc:492] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:20.377267 25811 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.380087 25811 ts_tablet_manager.cc:1434] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:09:20.382740 25900 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.390424 25811 tablet_bootstrap.cc:492] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:20.400369 25517 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.409399 25807 tablet_bootstrap.cc:654] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.412612 25809 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:20.413349 25809 ts_tablet_manager.cc:1403] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.004s
I20260709 12:09:20.402145 25900 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:20.426198 25900 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.427402 25900 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.426870 25514 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.432813 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:20.439267 25809 raft_consensus.cc:359] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.440084 25809 raft_consensus.cc:385] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.440366 25809 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.441044 25809 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.444038 25809 ts_tablet_manager.cc:1434] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.003s
W20260709 12:09:20.441032 25658 leader_election.cc:343] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.448529 25809 tablet_bootstrap.cc:492] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:20.449363 25900 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.459574 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.461962 25765 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:20.463707 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:20.465034 25914 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.465430 25914 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.465582 25860 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.465826 25914 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.466933 25860 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.469285 25860 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.475826 25869 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.476688 25869 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.479435 25869 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.480326 25811 tablet_bootstrap.cc:654] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.475639 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.483009 25766 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:20.483433 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.485611 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:20.486083 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:20.486986 25692 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:20.487238 25860 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.487576 25814 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.487996 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.488268 25867 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.488735 25867 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.489288 25822 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.487581 25860 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.495812 25860 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.497265 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:20.498854 25658 leader_election.cc:343] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.498929 25914 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.501281 25914 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.502390 25867 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.503572 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:20.503713 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.504535 25767 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:20.498812 25822 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.506588 25658 leader_election.cc:343] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.506043 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:20.514683 25822 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.515110 25822 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.515158 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:20.515504 25822 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.515889 25767 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.518563 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:20.524657 25583 leader_election.cc:343] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.527900 25853 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.528527 25853 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.531859 25853 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:20.527923 25822 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.533958 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:20.535971 25732 leader_election.cc:343] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.532501 25809 tablet_bootstrap.cc:654] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.540378 25811 tablet_bootstrap.cc:492] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:20.539711 25860 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.540903 25811 ts_tablet_manager.cc:1403] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.006s
I20260709 12:09:20.542748 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:20.543018 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:20.544409 25732 leader_election.cc:343] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.544622 25583 leader_election.cc:343] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.544893 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.545454 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:20.546454 25853 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.549032 25658 leader_election.cc:343] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.549088 25814 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:20.551646 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:20.552006 25767 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:20.552413 25766 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.552888 25822 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.553370 25811 raft_consensus.cc:359] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.553840 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:20.554348 25811 raft_consensus.cc:385] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.554895 25811 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.555042 25814 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.557294 25814 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:20.558331 25814 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.558924 25811 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.563199 25811 ts_tablet_manager.cc:1434] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 12:09:20.584393 25766 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:20.585901 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.589779 25822 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.590325 25822 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:20.591985 25822 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.593853 25514 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.599498 25807 tablet_bootstrap.cc:492] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:20.600044 25807 ts_tablet_manager.cc:1403] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.228s	user 0.013s	sys 0.024s
I20260709 12:09:20.600401 25860 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.602629 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:20.603227 25765 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.603811 25807 raft_consensus.cc:359] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.604516 25807 raft_consensus.cc:385] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.604774 25807 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.605445 25807 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.608068 25807 ts_tablet_manager.cc:1434] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:20.605458 25811 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:20.616341 25853 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.616669 25807 tablet_bootstrap.cc:492] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:20.618079 25765 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:20.619330 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:20.620471 25860 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.620959 25860 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:20.622653 25860 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.625762 25807 tablet_bootstrap.cc:654] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.640460 25853 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.646561 25853 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.667234 25514 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.668309 25517 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.681344 25914 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.721071 25809 tablet_bootstrap.cc:492] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:20.721715 25809 ts_tablet_manager.cc:1403] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.277s	user 0.020s	sys 0.018s
I20260709 12:09:20.729396 25809 raft_consensus.cc:359] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.730392 25809 raft_consensus.cc:385] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.730659 25809 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.731225 25811 tablet_bootstrap.cc:654] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.731370 25809 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.733827 25809 ts_tablet_manager.cc:1434] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 12:09:20.733628 25894 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.734942 25809 tablet_bootstrap.cc:492] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:20.735719 25914 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.736210 25914 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.746706 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:20.750546 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.751783 25765 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:20.755923 25658 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:20.758332 25860 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.762406 25914 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.726082 25926 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.764699 25926 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.767692 25926 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:20.770862 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:20.771754 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:20.771890 25692 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:20.778034 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:20.779986 25853 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.780493 25853 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.780927 25853 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.784205 25732 leader_election.cc:343] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.791702 25914 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.803561 25894 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.804379 25894 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.808369 25894 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:20.807919 25853 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.816696 25822 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.817845 25822 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.822876 25822 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:20.824518 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:20.826213 25809 tablet_bootstrap.cc:654] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.824518 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:20.838783 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:20.846940 25583 leader_election.cc:343] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.847719 25732 leader_election.cc:343] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.848153 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:20.875319 25582 leader_election.cc:343] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.876012 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.924870 25867 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.930800 25807 tablet_bootstrap.cc:492] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:20.931339 25807 ts_tablet_manager.cc:1403] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.315s	user 0.048s	sys 0.079s
I20260709 12:09:20.891151 25853 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:20.933964 25807 raft_consensus.cc:359] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.935563 25807 raft_consensus.cc:385] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.935878 25807 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.936539 25807 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:20.939910 25807 ts_tablet_manager.cc:1434] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:20.943076 25807 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
W20260709 12:09:20.907986 25732 leader_election.cc:343] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.954471 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:20.955521 25894 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.956487 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57852us
I20260709 12:09:20.960124 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:20.960770 25693 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.969475 25860 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.926025 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50789.4us
I20260709 12:09:20.975939 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:20.981068 25867 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:20.990690 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.000644 25693 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:21.007314 25811 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.007880 25811 ts_tablet_manager.cc:1403] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.403s	user 0.020s	sys 0.023s
I20260709 12:09:21.011914 25811 raft_consensus.cc:359] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.012212 25867 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.012682 25811 raft_consensus.cc:385] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.012992 25811 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
W20260709 12:09:21.013345 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.013660 25811 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.017472 25811 ts_tablet_manager.cc:1434] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:21.018671 25811 tablet_bootstrap.cc:492] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.019133 25809 tablet_bootstrap.cc:492] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.019655 25809 ts_tablet_manager.cc:1403] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.285s	user 0.021s	sys 0.047s
I20260709 12:09:21.021502 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:21.022675 25894 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:21.022733 25732 leader_election.cc:343] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.023303 25894 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:21.024338 25829 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.024099 25809 raft_consensus.cc:359] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.024979 25809 raft_consensus.cc:385] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.025323 25809 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.025733 25894 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.026037 25809 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.029213 25809 ts_tablet_manager.cc:1434] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:21.030381 25809 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.036648 25811 tablet_bootstrap.cc:654] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.035284 25807 tablet_bootstrap.cc:654] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.041558 25809 tablet_bootstrap.cc:654] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.060385 25692 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.081454 25822 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.082841 25867 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.083513 25867 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.095693 25867 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.098073 25809 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.098661 25809 ts_tablet_manager.cc:1403] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.000s
I20260709 12:09:21.099893 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.101594 25809 raft_consensus.cc:359] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.102337 25809 raft_consensus.cc:385] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.102630 25809 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.103276 25809 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.107481 25807 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.108093 25807 ts_tablet_manager.cc:1403] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.165s	user 0.016s	sys 0.031s
I20260709 12:09:21.110423 25867 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.111459 25807 raft_consensus.cc:359] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.112193 25807 raft_consensus.cc:385] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.112506 25807 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
W20260709 12:09:21.113276 25658 consensus_peers.cc:597] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.115687 25811 tablet_bootstrap.cc:492] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.114413 25814 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:21.116688 25811 ts_tablet_manager.cc:1403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.011s
I20260709 12:09:21.120404 25811 raft_consensus.cc:359] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.121121 25811 raft_consensus.cc:385] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.121385 25811 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.128289 25515 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.128575 25809 ts_tablet_manager.cc:1434] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:09:21.131124 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.132632 25853 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.133119 25853 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.133881 25809 tablet_bootstrap.cc:492] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.122062 25811 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.136116 25853 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.138537 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:21.140719 25732 leader_election.cc:343] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.144213 25809 tablet_bootstrap.cc:654] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.149103 25811 ts_tablet_manager.cc:1434] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:09:21.155720 25811 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.113824 25807 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.160565 25807 ts_tablet_manager.cc:1434] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 12:09:21.164335 25582 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:21.164683 25807 tablet_bootstrap.cc:492] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:21.166519 25814 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.170400 25867 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.179315 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.180327 25617 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:21.183504 25809 tablet_bootstrap.cc:492] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.186000 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:21.187574 25853 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.188138 25853 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.188514 25853 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.184176 25809 ts_tablet_manager.cc:1403] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.002s
I20260709 12:09:21.191820 25811 tablet_bootstrap.cc:654] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.200824 25853 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.199213 25814 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:21.201799 25814 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.205335 25814 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.205262 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:21.193499 25807 tablet_bootstrap.cc:654] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.206512 25853 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.206707 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.206805 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.208380 25617 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:21.208266 25765 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:21.209856 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:21.209964 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:21.210610 25617 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.211222 25860 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:21.211622 25860 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:21.212003 25860 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:21.212600 25809 raft_consensus.cc:359] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.213260 25809 raft_consensus.cc:385] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.213512 25809 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.214213 25809 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.217463 25692 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.237315 25860 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.241539 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:21.242619 25615 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:21.242864 25692 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:21.244894 25617 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:21.246536 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:21.248410 25894 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.248939 25860 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.249166 25809 ts_tablet_manager.cc:1434] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:09:21.249203 25894 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:21.250654 25894 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.256242 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:21.250754 25809 tablet_bootstrap.cc:492] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.251495 25811 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.259984 25811 ts_tablet_manager.cc:1403] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.003s
I20260709 12:09:21.267807 25809 tablet_bootstrap.cc:654] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.268985 25807 tablet_bootstrap.cc:492] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.269563 25807 ts_tablet_manager.cc:1403] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.009s
I20260709 12:09:21.273919 25767 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:21.273706 25807 raft_consensus.cc:359] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.274570 25807 raft_consensus.cc:385] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.274969 25807 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.275641 25807 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.278159 25807 ts_tablet_manager.cc:1434] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:09:21.279876 25807 tablet_bootstrap.cc:492] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
W20260709 12:09:21.279824 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.281985 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:21.286588 25809 tablet_bootstrap.cc:492] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.287101 25809 ts_tablet_manager.cc:1403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 12:09:21.287578 25807 tablet_bootstrap.cc:654] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.287190 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.289693 25811 raft_consensus.cc:359] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.290378 25811 raft_consensus.cc:385] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.290681 25811 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.291466 25811 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.293112 25807 tablet_bootstrap.cc:492] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.293576 25807 ts_tablet_manager.cc:1403] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:09:21.293743 25811 ts_tablet_manager.cc:1434] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.000s
I20260709 12:09:21.294757 25983 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:21.295379 25983 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:21.296319 25983 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.298049 25807 raft_consensus.cc:359] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.298759 25807 raft_consensus.cc:385] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.298806 25811 tablet_bootstrap.cc:492] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.305080 25809 raft_consensus.cc:359] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.306032 25809 raft_consensus.cc:385] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.306917 25809 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.307320 25811 tablet_bootstrap.cc:654] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.308080 25809 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.310286 25807 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.311965 25807 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.313323 25809 ts_tablet_manager.cc:1434] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:09:21.314553 25807 ts_tablet_manager.cc:1434] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:09:21.314682 25809 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.320472 25807 tablet_bootstrap.cc:492] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:21.323055 25809 tablet_bootstrap.cc:654] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.328491 25807 tablet_bootstrap.cc:654] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.337576 25692 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.338961 25809 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.339469 25809 ts_tablet_manager.cc:1403] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 12:09:21.339780 25867 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.340287 25867 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.342515 25867 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.342391 25809 raft_consensus.cc:359] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.343142 25809 raft_consensus.cc:385] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.343425 25809 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.344090 25809 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.344367 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.345081 25691 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:21.346580 25809 ts_tablet_manager.cc:1434] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:21.347056 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:21.348280 25809 tablet_bootstrap.cc:492] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.349097 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.349917 25767 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:21.351980 25867 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.352391 25867 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.352844 25811 tablet_bootstrap.cc:492] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.352777 25867 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.354058 25811 ts_tablet_manager.cc:1403] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.005s
I20260709 12:09:21.352910 25515 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 2, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.357049 25809 tablet_bootstrap.cc:654] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.362694 25867 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.366127 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:21.366829 25691 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.367607 25811 raft_consensus.cc:359] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.369107 25811 raft_consensus.cc:385] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.369379 25811 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.373602 25811 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.375715 25809 tablet_bootstrap.cc:492] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.376494 25809 ts_tablet_manager.cc:1403] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.003s
I20260709 12:09:21.376540 25811 ts_tablet_manager.cc:1434] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:09:21.380460 25809 raft_consensus.cc:359] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.382304 25809 raft_consensus.cc:385] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.382586 25809 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.383384 25809 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.385701 25809 ts_tablet_manager.cc:1434] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:21.386597 25809 tablet_bootstrap.cc:492] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.386395 25691 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:21.387331 25867 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.388484 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:21.390879 25867 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.388587 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:21.391404 25767 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.393174 25809 tablet_bootstrap.cc:654] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.400487 25894 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.401132 25894 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.402562 25811 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.403451 25894 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.403937 25809 tablet_bootstrap.cc:492] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.404407 25809 ts_tablet_manager.cc:1403] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:09:21.405493 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.407423 25809 raft_consensus.cc:359] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.408113 25809 raft_consensus.cc:385] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.408378 25809 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.409426 25811 tablet_bootstrap.cc:654] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.409029 25809 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:21.411083 25732 leader_election.cc:343] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.411453 25809 ts_tablet_manager.cc:1434] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:09:21.412428 25809 tablet_bootstrap.cc:492] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.412673 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.417318 25767 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
W20260709 12:09:21.418347 25732 leader_election.cc:343] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.419227 25867 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:21.422359 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:21.422991 25867 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.420395 25809 tablet_bootstrap.cc:654] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.421795 25807 tablet_bootstrap.cc:492] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.424883 25617 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.425127 25807 ts_tablet_manager.cc:1403] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.004s
I20260709 12:09:21.429713 25807 raft_consensus.cc:359] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.433476 25807 raft_consensus.cc:385] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.432201 25894 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.434767 25807 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.436517 25807 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.441425 25807 ts_tablet_manager.cc:1434] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.005s
I20260709 12:09:21.443039 25807 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:21.443080 25811 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.446646 25811 ts_tablet_manager.cc:1403] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.023s
I20260709 12:09:21.455754 25514 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.456516 25811 raft_consensus.cc:359] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.457183 25811 raft_consensus.cc:385] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.457487 25811 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
W20260709 12:09:21.458307 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.458158 25811 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.460799 25807 tablet_bootstrap.cc:654] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.465765 25811 ts_tablet_manager.cc:1434] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:09:21.466938 25811 tablet_bootstrap.cc:492] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.475438 25809 tablet_bootstrap.cc:492] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.476004 25809 ts_tablet_manager.cc:1403] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.015s
I20260709 12:09:21.479539 25809 raft_consensus.cc:359] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.480309 25809 raft_consensus.cc:385] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.480551 25809 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.481284 25809 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.482774 25853 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.483311 25853 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.484567 25809 ts_tablet_manager.cc:1434] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:21.485553 25809 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.485672 25853 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.487556 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:21.488909 25732 leader_election.cc:343] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.487592 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.492123 25692 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:21.497964 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:21.499338 25894 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.499722 25894 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.500084 25894 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.514820 25811 tablet_bootstrap.cc:654] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.517765 25807 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.523269 25807 ts_tablet_manager.cc:1403] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.014s
I20260709 12:09:21.526998 25913 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.527184 25811 tablet_bootstrap.cc:492] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.527844 25811 ts_tablet_manager.cc:1403] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.004s
I20260709 12:09:21.527563 25913 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.529789 25913 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.518177 25809 tablet_bootstrap.cc:654] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.531898 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.532104 25811 raft_consensus.cc:359] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.533661 25811 raft_consensus.cc:385] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.534008 25811 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.520694 25894 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.534795 25811 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.537194 25894 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.538182 25811 ts_tablet_manager.cc:1434] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:21.539240 25811 tablet_bootstrap.cc:492] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.539510 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.541121 25583 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:21.544831 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:21.545907 25811 tablet_bootstrap.cc:654] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.547269 25867 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.549594 25809 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.550081 25809 ts_tablet_manager.cc:1403] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.009s
I20260709 12:09:21.550861 25829 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.526245 25807 raft_consensus.cc:359] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.555079 25807 raft_consensus.cc:385] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.555411 25807 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.549264 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:21.556705 25807 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.559396 25807 ts_tablet_manager.cc:1434] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
W20260709 12:09:21.560205 25732 leader_election.cc:343] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.560736 25807 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:21.557361 25809 raft_consensus.cc:359] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.562340 25809 raft_consensus.cc:385] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.562668 25809 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.563540 25809 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.564716 25811 tablet_bootstrap.cc:492] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.565264 25811 ts_tablet_manager.cc:1403] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 12:09:21.565707 25809 ts_tablet_manager.cc:1434] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:21.566675 25809 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:21.569088 25807 tablet_bootstrap.cc:654] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.573524 25809 tablet_bootstrap.cc:654] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.556711 25692 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.579905 25811 raft_consensus.cc:359] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.581310 25811 raft_consensus.cc:385] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.581677 25811 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.582607 25807 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.583144 25807 ts_tablet_manager.cc:1403] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 12:09:21.584120 25829 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.583068 25615 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.584601 25829 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.584905 25811 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.587117 25811 ts_tablet_manager.cc:1434] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.006s
I20260709 12:09:21.626478 25811 tablet_bootstrap.cc:492] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.628509 25829 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.630152 25809 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.630726 25809 ts_tablet_manager.cc:1403] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.016s
I20260709 12:09:21.628649 25807 raft_consensus.cc:359] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.632423 25807 raft_consensus.cc:385] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.632776 25807 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.635715 25807 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.639183 25811 tablet_bootstrap.cc:654] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.639423 25807 ts_tablet_manager.cc:1434] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.056s	user 0.014s	sys 0.008s
I20260709 12:09:21.641273 25807 tablet_bootstrap.cc:492] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:21.647389 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.648475 25618 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:21.649272 25983 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.650074 25983 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.649554 25809 raft_consensus.cc:359] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.652180 25807 tablet_bootstrap.cc:654] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.652714 25809 raft_consensus.cc:385] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.653867 25809 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.655643 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.656473 25618 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:21.652954 25983 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.658747 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:21.661290 25983 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.661906 25983 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.662492 25983 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.663197 25867 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.663744 25867 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.665702 25809 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.681102 25867 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.723768 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.693251 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:21.733927 25766 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:21.734778 25926 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.735474 25926 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.690871 25829 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.735963 25926 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.736402 25829 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.683283 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.732340 25809 ts_tablet_manager.cc:1434] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.101s	user 0.011s	sys 0.000s
I20260709 12:09:21.745173 25809 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
W20260709 12:09:21.743387 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60150.7us
I20260709 12:09:21.745787 25860 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.746490 25767 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:21.773376 25811 tablet_bootstrap.cc:492] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.773900 25811 ts_tablet_manager.cc:1403] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.015s
I20260709 12:09:21.759410 25860 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.777446 25807 tablet_bootstrap.cc:492] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:21.777958 25807 ts_tablet_manager.cc:1403] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.137s	user 0.047s	sys 0.043s
I20260709 12:09:21.785897 25913 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.785915 25811 raft_consensus.cc:359] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.787425 25811 raft_consensus.cc:385] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.787628 25811 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.788193 25811 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.782933 25983 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.783588 25829 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.799157 25811 ts_tablet_manager.cc:1434] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:09:21.790027 25913 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.800907 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.801573 25694 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:21.802069 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.802376 25913 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.806134 25860 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.806346 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.806959 25766 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:21.795064 25926 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.811627 25809 tablet_bootstrap.cc:654] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.812088 25807 raft_consensus.cc:359] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.814479 25807 raft_consensus.cc:385] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.814759 25807 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.817134 25807 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.818503 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.819290 25811 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:21.818512 25983 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.818830 25926 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:21.822667 25582 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:21.824005 25807 ts_tablet_manager.cc:1434] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:09:21.824205 25867 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.824594 25867 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.824908 25867 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.824971 25807 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:21.824049 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:21.825829 25692 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:21.829375 25822 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.829870 25822 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.830559 25822 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.832607 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:21.833369 25618 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.829861 25658 leader_election.cc:343] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.842379 25617 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:21.846482 26010 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.847334 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.852767 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:21.860368 25767 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:21.864046 25894 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.864768 25618 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:21.864950 25822 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.866031 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:21.866950 25900 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.867156 25822 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.867703 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:21.867436 25900 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:21.868685 25767 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.869129 25900 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.869884 25617 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:21.874291 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:21.881158 25809 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:21.881726 25809 ts_tablet_manager.cc:1403] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.007s
I20260709 12:09:21.883026 25811 tablet_bootstrap.cc:654] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.882181 26010 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.885864 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:21.890775 25829 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.891546 25829 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:21.898137 25767 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:21.892498 25829 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.887632 26010 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.904102 26010 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.908658 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:21.909422 25618 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.911258 25867 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.923278 25617 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.928254 25765 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:21.924154 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:21.930990 25767 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.932809 25811 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:21.926872 25515 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.933354 25811 ts_tablet_manager.cc:1403] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.012s
I20260709 12:09:21.916385 25807 tablet_bootstrap.cc:654] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.920536 25900 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.936111 25900 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.934862 25867 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.941270 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.942113 25619 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:21.942461 25767 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:21.944651 25983 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.950786 25983 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.953033 25983 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.953908 25618 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
W20260709 12:09:21.934921 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 80327.9us
I20260709 12:09:21.942281 26010 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:21.955632 25583 leader_election.cc:343] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.943845 25900 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.956357 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:21.958344 25809 raft_consensus.cc:359] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.962903 25809 raft_consensus.cc:385] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.963316 25809 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.964275 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:21.964215 25809 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.960517 26010 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:21.961364 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:21.964856 25767 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.965688 25811 raft_consensus.cc:359] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:21.966028 25658 leader_election.cc:343] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.967394 25811 raft_consensus.cc:385] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.968241 25811 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.988511 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:21.989703 25853 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.975474 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.991309 25691 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:21.991498 25853 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.992146 25853 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:21.974458 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:21.992962 25694 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.994704 25853 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:21.996824 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:21.997714 25688 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:22.009649 25809 ts_tablet_manager.cc:1434] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.000s
I20260709 12:09:22.011185 25809 tablet_bootstrap.cc:492] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:22.075464 25811 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.080572 25517 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:22.057112 25658 leader_election.cc:343] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.086735 25811 ts_tablet_manager.cc:1434] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.153s	user 0.006s	sys 0.002s
I20260709 12:09:22.087556 25811 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
W20260709 12:09:22.075768 25799 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.23.222.190:33735, user_credentials={real_user=slave}} blocked reactor thread for 103746us
I20260709 12:09:22.097741 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:22.101415 25766 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:22.084342 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:22.131507 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:22.123930 26010 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:22.137619 25867 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.138422 25867 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:22.139474 25867 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.142839 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:22.145022 25766 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:22.166002 25807 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:22.166779 25809 tablet_bootstrap.cc:654] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.167253 25807 ts_tablet_manager.cc:1403] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.342s	user 0.026s	sys 0.013s
I20260709 12:09:22.173218 25765 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.176355 25807 raft_consensus.cc:359] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.177145 25807 raft_consensus.cc:385] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.177338 25807 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.154505 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62371.6us
W20260709 12:09:22.182214 26020 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:09:22.188907 25515 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.191083 25765 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:22.176918 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.193060 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.194075 25694 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:22.197800 25767 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:22.180315 25807 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.200086 25900 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.200400 25983 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.200893 25983 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.205996 25807 ts_tablet_manager.cc:1434] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:09:22.207557 25807 tablet_bootstrap.cc:492] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:22.202131 26010 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.212672 26010 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.209652 25811 tablet_bootstrap.cc:654] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.211315 25983 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:22.214434 26010 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.215746 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:22.221449 25658 leader_election.cc:343] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.228446 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.229357 25829 raft_consensus.cc:2764] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:09:22.232327 26015 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.232831 26015 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.237066 26015 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:22.239324 25515 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.253557 25809 tablet_bootstrap.cc:492] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:22.254132 25809 ts_tablet_manager.cc:1403] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.243s	user 0.013s	sys 0.003s
I20260709 12:09:22.255594 25807 tablet_bootstrap.cc:654] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.259619 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:22.261268 25582 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:22.264289 25809 raft_consensus.cc:359] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.265029 25809 raft_consensus.cc:385] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.265307 25809 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.266584 26014 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.268986 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:22.269810 26014 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:22.269932 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:22.268862 25809 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.270747 26014 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.298789 25900 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.296553 25809 ts_tablet_manager.cc:1434] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.003s
I20260709 12:09:22.304426 25983 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.305533 25822 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.312947 25983 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.316314 25983 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:22.316783 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:22.319180 25732 leader_election.cc:343] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.324401 25809 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:22.301519 26010 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.357259 25811 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:22.328765 25913 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.361053 25811 ts_tablet_manager.cc:1403] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.274s	user 0.007s	sys 0.015s
I20260709 12:09:22.360783 25913 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.363827 25860 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.363977 25811 raft_consensus.cc:359] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.365455 25811 raft_consensus.cc:385] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.365733 25811 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.366075 25658 leader_election.cc:343] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.366425 25811 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.333832 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:22.368259 25617 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.366775 25913 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:22.371819 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:22.373322 25689 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:22.377802 25811 ts_tablet_manager.cc:1434] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:09:22.378899 25811 tablet_bootstrap.cc:492] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:22.343986 26010 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:22.384004 25913 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.384305 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:22.404044 25583 leader_election.cc:343] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.403915 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:22.404866 25767 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:22.411847 25515 catalog_manager.cc:5697] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:22.420746 25732 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.426524 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:22.427300 25767 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.426702 25732 leader_election.cc:343] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.429600 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:22.430917 25829 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.433027 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:22.434403 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.435951 25807 tablet_bootstrap.cc:492] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:22.437879 25767 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:22.439690 25807 ts_tablet_manager.cc:1403] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.232s	user 0.022s	sys 0.004s
I20260709 12:09:22.436586 25809 tablet_bootstrap.cc:654] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.442153 25860 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.442812 25860 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:22.444032 25860 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.452435 25617 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:22.456879 25829 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.457454 25829 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.455493 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:22.463836 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:22.466207 25829 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:22.468081 25860 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:22.470528 25732 leader_election.cc:343] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.474532 25860 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:22.476790 25860 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.472877 25514 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:22.480851 25657 leader_election.cc:343] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.481395 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.485764 25807 raft_consensus.cc:359] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.486375 25807 raft_consensus.cc:385] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.486616 25807 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.486831 26010 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.487668 25807 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.489678 25811 tablet_bootstrap.cc:654] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.493263 25657 leader_election.cc:343] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.494537 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.495080 25807 ts_tablet_manager.cc:1434] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
W20260709 12:09:22.495718 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.496846 25807 tablet_bootstrap.cc:492] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:22.499059 25809 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:22.499549 25809 ts_tablet_manager.cc:1403] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.190s	user 0.022s	sys 0.016s
I20260709 12:09:22.512480 25914 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.513447 25894 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.513994 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:22.521545 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:22.507503 25829 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.522923 25829 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.527318 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:22.528725 25732 leader_election.cc:343] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.515308 25900 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.522887 25913 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.530802 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:22.547952 26034 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:09:22.550977 25829 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:22.555492 25809 raft_consensus.cc:359] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.556694 25809 raft_consensus.cc:385] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.557133 25809 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.558013 25913 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.558110 25809 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.561185 25807 tablet_bootstrap.cc:654] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.562826 25809 ts_tablet_manager.cc:1434] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:09:22.563261 25689 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:22.571524 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:22.574752 25811 tablet_bootstrap.cc:492] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:22.575739 25811 ts_tablet_manager.cc:1403] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.197s	user 0.005s	sys 0.017s
I20260709 12:09:22.575649 25829 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.575497 25694 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:22.577656 25809 tablet_bootstrap.cc:492] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:22.581681 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.582898 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.583611 25853 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.583973 25853 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.584404 25853 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.583801 25811 raft_consensus.cc:359] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.584942 25811 raft_consensus.cc:385] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.586009 25926 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.591200 25811 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.591341 25926 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.591912 25926 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.592242 25811 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.593497 25807 tablet_bootstrap.cc:492] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:22.593971 25807 ts_tablet_manager.cc:1403] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 12:09:22.594785 25811 ts_tablet_manager.cc:1434] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:22.595786 25811 tablet_bootstrap.cc:492] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:22.596781 25807 raft_consensus.cc:359] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.590900 25809 tablet_bootstrap.cc:654] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.597462 25807 raft_consensus.cc:385] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.597757 25807 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.598645 25807 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.600383 25926 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.602573 25926 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:22.608649 25807 ts_tablet_manager.cc:1434] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:22.609709 25807 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:22.612134 25517 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.607220 25811 tablet_bootstrap.cc:654] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.615357 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:22.618309 25732 leader_election.cc:343] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.621742 25853 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.622628 25807 tablet_bootstrap.cc:654] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.628887 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:22.633667 25809 tablet_bootstrap.cc:492] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:22.634465 25809 ts_tablet_manager.cc:1403] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.007s
I20260709 12:09:22.635213 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:09:22.635491 25732 leader_election.cc:343] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.636137 25694 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.637073 25807 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:22.637768 25807 ts_tablet_manager.cc:1403] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.001s
I20260709 12:09:22.643030 25809 raft_consensus.cc:359] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.643879 25809 raft_consensus.cc:385] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.644218 25809 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.645340 25809 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.650591 25807 raft_consensus.cc:359] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.651865 25807 raft_consensus.cc:385] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.652230 25807 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.655881 25807 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.659053 25807 ts_tablet_manager.cc:1434] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 12:09:22.661650 25809 ts_tablet_manager.cc:1434] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:09:22.663481 25809 tablet_bootstrap.cc:492] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:22.670749 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:22.671854 25689 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.675757 25694 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:22.677201 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.679045 25807 tablet_bootstrap.cc:492] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:22.679361 25926 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.650415 25853 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:22.680169 25926 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:22.681664 25926 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.687814 25689 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:22.691771 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:22.692986 26015 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.693653 26015 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:22.695187 26015 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.691665 25913 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:22.710819 25853 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.712800 26014 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.764060 25811 tablet_bootstrap.cc:492] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:22.764673 25811 ts_tablet_manager.cc:1403] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.169s	user 0.044s	sys 0.042s
I20260709 12:09:22.754076 25900 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.784987 25809 tablet_bootstrap.cc:654] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.793085 26051 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.794127 26051 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.799182 25807 tablet_bootstrap.cc:654] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.826596 26011 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.830855 25517 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.777670 25900 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.846874 25900 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:22.843045 25811 raft_consensus.cc:359] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.849010 25811 raft_consensus.cc:385] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.849306 25811 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.848220 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:22.851583 25583 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.858798 25811 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.866252 26051 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:22.868058 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:22.827648 26011 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:22.871256 25618 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
W20260709 12:09:22.874292 25732 leader_election.cc:343] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.876892 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:22.879565 25732 leader_election.cc:343] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.880123 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:22.892045 25811 ts_tablet_manager.cc:1434] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.003s
I20260709 12:09:22.893424 25811 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:22.899637 25926 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.901660 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:22.902654 25767 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:22.916371 25617 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.927662 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:22.934516 25860 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.935042 25860 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.935457 25860 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.940601 26010 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.045411 25809 tablet_bootstrap.cc:492] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.046005 25809 ts_tablet_manager.cc:1403] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.383s	user 0.024s	sys 0.028s
I20260709 12:09:23.048794 25807 tablet_bootstrap.cc:492] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.049297 25807 ts_tablet_manager.cc:1403] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.370s	user 0.008s	sys 0.022s
W20260709 12:09:23.051707 26050 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:09:23.063532 25894 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.064391 25894 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.073664 25807 raft_consensus.cc:359] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.074745 25807 raft_consensus.cc:385] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.075096 25807 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.078647 25811 tablet_bootstrap.cc:654] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.078328 26011 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.078500 26014 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.081665 25807 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.085546 25894 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.085937 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:23.046671 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 108423us
I20260709 12:09:23.095261 25807 ts_tablet_manager.cc:1434] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:09:23.102661 25807 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.096027 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.116438 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:23.119449 25765 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
W20260709 12:09:23.124415 25732 leader_election.cc:343] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.145155 25926 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.145576 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.145782 25926 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.147437 25860 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.148159 25926 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.148319 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:23.148540 25732 leader_election.cc:343] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.148674 25693 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:23.148993 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:23.154444 26014 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.155000 26014 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.155417 26014 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.156563 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.157215 25926 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:23.160053 25732 leader_election.cc:343] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.155876 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.161129 25809 raft_consensus.cc:359] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.162420 25809 raft_consensus.cc:385] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.162770 25809 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.164896 25732 leader_election.cc:343] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.165522 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:23.165475 25809 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.169041 25809 ts_tablet_manager.cc:1434] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.005s
I20260709 12:09:23.170675 25809 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.170228 25515 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.169427 25894 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.186885 26058 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:23.192816 25807 tablet_bootstrap.cc:654] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.175912 25860 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.205021 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:23.207783 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:23.208413 25765 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.214944 26014 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.227201 25617 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:23.238219 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:23.239675 26014 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.259334 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:23.260535 25689 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:23.260655 25765 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
W20260709 12:09:23.263880 25732 consensus_peers.cc:597] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.266772 25914 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.268038 25809 tablet_bootstrap.cc:654] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.269989 25914 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.275609 25811 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:23.276170 25811 ts_tablet_manager.cc:1403] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.383s	user 0.014s	sys 0.028s
W20260709 12:09:23.276687 25732 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.278185 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.279495 25914 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.280017 25914 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:23.280475 25811 raft_consensus.cc:359] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.281481 25811 raft_consensus.cc:385] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.281817 25811 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.282748 25811 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.284212 25894 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.285018 25807 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.285513 25807 ts_tablet_manager.cc:1403] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.183s	user 0.009s	sys 0.011s
I20260709 12:09:23.285665 25811 ts_tablet_manager.cc:1434] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:09:23.286690 25811 tablet_bootstrap.cc:492] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:23.288367 25807 raft_consensus.cc:359] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.289029 25807 raft_consensus.cc:385] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.289300 25807 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.289594 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:23.290036 25807 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.290905 25913 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.292275 25807 ts_tablet_manager.cc:1434] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:09:23.293212 25807 tablet_bootstrap.cc:492] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.293360 25811 tablet_bootstrap.cc:654] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.306416 25914 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.366586 25517 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.371821 25894 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.372830 25811 tablet_bootstrap.cc:492] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:23.373401 25811 ts_tablet_manager.cc:1403] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.014s
I20260709 12:09:23.379832 25811 raft_consensus.cc:359] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.381240 25811 raft_consensus.cc:385] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.381484 25811 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.384784 25809 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.385340 25809 ts_tablet_manager.cc:1403] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.010s
I20260709 12:09:23.391198 25809 raft_consensus.cc:359] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.391913 25809 raft_consensus.cc:385] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.392213 25809 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.392866 25809 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.398038 25807 tablet_bootstrap.cc:654] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.402858 25809 ts_tablet_manager.cc:1434] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:09:23.404919 25809 tablet_bootstrap.cc:492] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.410145 25811 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.416783 25811 ts_tablet_manager.cc:1434] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 12:09:23.418515 25811 tablet_bootstrap.cc:492] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:23.420014 25900 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.420660 25900 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.422887 25900 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.434571 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:23.436898 25658 leader_election.cc:343] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.441064 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:23.442574 25657 leader_election.cc:343] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.443035 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.443748 25900 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.464164 25809 tablet_bootstrap.cc:654] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.465602 25807 tablet_bootstrap.cc:492] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.466135 25807 ts_tablet_manager.cc:1403] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.008s
I20260709 12:09:23.479759 25807 raft_consensus.cc:359] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.480640 25807 raft_consensus.cc:385] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.480919 25807 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.481691 25807 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.482959 25811 tablet_bootstrap.cc:654] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.484012 25807 ts_tablet_manager.cc:1434] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:23.484349 25809 tablet_bootstrap.cc:492] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.484848 25809 ts_tablet_manager.cc:1403] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.002s
I20260709 12:09:23.485096 25807 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.487999 25809 raft_consensus.cc:359] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.488701 25809 raft_consensus.cc:385] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.488953 25809 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.489666 25809 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.491791 26058 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.492237 26058 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.494608 26058 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.495216 25807 tablet_bootstrap.cc:654] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.496904 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:23.498883 25658 leader_election.cc:343] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.502600 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:23.503263 25767 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:23.506565 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.507743 26058 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.508131 26058 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.508487 26058 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.514842 25809 ts_tablet_manager.cc:1434] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:09:23.517812 25809 tablet_bootstrap.cc:492] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.527858 25807 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.534662 25807 ts_tablet_manager.cc:1403] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.050s	user 0.033s	sys 0.003s
I20260709 12:09:23.542542 25809 tablet_bootstrap.cc:654] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.542241 25807 raft_consensus.cc:359] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.543032 25807 raft_consensus.cc:385] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.531749 26058 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.543334 25811 tablet_bootstrap.cc:492] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:23.543936 25811 ts_tablet_manager.cc:1403] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.013s
I20260709 12:09:23.546175 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:23.543337 25807 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.546904 25765 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.548422 25807 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.549383 25811 raft_consensus.cc:359] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.551405 25811 raft_consensus.cc:385] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.551832 25811 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.546046 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:23.553550 25807 ts_tablet_manager.cc:1434] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
W20260709 12:09:23.554013 25658 leader_election.cc:343] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.556090 25811 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.562988 25807 tablet_bootstrap.cc:492] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.570853 25765 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:23.572160 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.573282 25914 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.573985 25914 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:23.575057 26058 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.579123 25811 ts_tablet_manager.cc:1434] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:09:23.580329 25811 tablet_bootstrap.cc:492] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:23.588156 25913 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.584900 25914 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.588697 25913 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.595786 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.596217 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:23.597810 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:23.598964 26014 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.598294 25913 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.600242 25807 tablet_bootstrap.cc:654] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.595827 25809 tablet_bootstrap.cc:492] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.607630 25619 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.619451 25515 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:23.620890 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.620961 25894 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.622128 25809 ts_tablet_manager.cc:1403] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.017s
I20260709 12:09:23.621989 25894 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.625083 25894 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.625952 25809 raft_consensus.cc:359] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.626691 25809 raft_consensus.cc:385] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.626788 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.626993 25809 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.627017 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.627840 25809 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:23.628535 25732 leader_election.cc:343] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.610666 25811 tablet_bootstrap.cc:654] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.629221 25732 leader_election.cc:343] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.629591 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:23.630327 25894 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.638103 25809 ts_tablet_manager.cc:1434] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:09:23.640012 25811 tablet_bootstrap.cc:492] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:23.640618 25811 ts_tablet_manager.cc:1403] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.002s
I20260709 12:09:23.641299 25809 tablet_bootstrap.cc:492] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.644652 25811 raft_consensus.cc:359] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.645406 25811 raft_consensus.cc:385] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.645763 25811 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.646641 25811 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.648923 25811 ts_tablet_manager.cc:1434] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:23.649951 25811 tablet_bootstrap.cc:492] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:23.650043 25809 tablet_bootstrap.cc:654] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.652096 25807 tablet_bootstrap.cc:492] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.652568 25807 ts_tablet_manager.cc:1403] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 12:09:23.655431 25807 raft_consensus.cc:359] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.656131 25807 raft_consensus.cc:385] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.656388 25807 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.657434 25811 tablet_bootstrap.cc:654] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.657083 25807 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.659250 25807 ts_tablet_manager.cc:1434] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:23.664517 25807 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.671666 25807 tablet_bootstrap.cc:654] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.672044 26014 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.672590 26014 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.683420 25811 tablet_bootstrap.cc:492] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:23.684013 25811 ts_tablet_manager.cc:1403] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.011s
I20260709 12:09:23.685005 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.685573 25809 tablet_bootstrap.cc:492] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.685659 25693 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:23.686064 25809 ts_tablet_manager.cc:1403] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.002s
I20260709 12:09:23.686908 25811 raft_consensus.cc:359] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.687463 25811 raft_consensus.cc:385] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.687688 25811 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.690258 26014 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.690145 25583 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:23.691761 26014 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.692111 26014 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.692063 25809 raft_consensus.cc:359] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.692857 25809 raft_consensus.cc:385] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.692535 26014 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.693238 25809 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.693189 25811 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.694108 25809 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.693079 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:23.695447 25765 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:23.696094 25811 ts_tablet_manager.cc:1434] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:23.696574 25809 ts_tablet_manager.cc:1434] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:09:23.697117 25811 tablet_bootstrap.cc:492] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:23.697640 25809 tablet_bootstrap.cc:492] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.704660 25809 tablet_bootstrap.cc:654] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.705848 25693 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.711887 26014 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.713701 25809 tablet_bootstrap.cc:492] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.714162 25809 ts_tablet_manager.cc:1403] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 12:09:23.714720 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:23.715822 25689 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.718153 25809 raft_consensus.cc:359] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.718834 25809 raft_consensus.cc:385] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.719103 25809 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.719776 25809 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.721845 25809 ts_tablet_manager.cc:1434] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:23.723578 25689 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:23.723877 25809 tablet_bootstrap.cc:492] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.726198 25583 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:23.727180 25913 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.727721 25913 raft_consensus.cc:697] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:23.728310 26014 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.728722 25913 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.740227 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:23.740937 25765 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.748293 25765 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:23.748459 25809 tablet_bootstrap.cc:654] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.752910 25894 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.753646 25894 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.758210 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.759186 25894 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.759323 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.760155 25689 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
W20260709 12:09:23.760541 25732 leader_election.cc:343] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.761097 26014 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.761770 26014 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.765026 25811 tablet_bootstrap.cc:654] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.766198 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:23.766956 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.767248 25767 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:23.768946 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.770937 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:23.771934 25913 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.778378 26014 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.779579 25894 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.779074 25515 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.780035 25894 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.780495 25894 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.785743 25829 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.786372 25913 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.786310 25829 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.789172 25829 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.791604 25809 tablet_bootstrap.cc:492] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.791450 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.792186 25809 ts_tablet_manager.cc:1403] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.011s
I20260709 12:09:23.792168 25619 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:23.793869 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:23.795723 25926 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.795343 25809 raft_consensus.cc:359] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.796178 25926 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.796218 25894 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.796537 25900 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.796664 25926 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.796635 25809 raft_consensus.cc:385] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.797394 25809 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.798189 25809 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.800526 25809 ts_tablet_manager.cc:1434] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:23.801512 25809 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.801743 25894 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.803714 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:23.804848 25807 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.805327 25807 ts_tablet_manager.cc:1403] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.022s
I20260709 12:09:23.806774 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:23.807406 25693 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:23.808267 25807 raft_consensus.cc:359] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.808929 25807 raft_consensus.cc:385] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:23.808961 25732 leader_election.cc:343] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.809295 25807 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.810545 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:23.811115 25807 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.811165 25693 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.813561 25807 ts_tablet_manager.cc:1434] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:23.821657 25807 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.822479 25809 tablet_bootstrap.cc:654] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.828810 25807 tablet_bootstrap.cc:654] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.807657 25926 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.859304 25926 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:23.862242 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:23.863106 25617 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.883903 25900 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.885206 25900 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.894721 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:23.895605 25689 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.900118 26058 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.904091 25693 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:23.906838 25689 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:23.912452 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.914884 25894 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.915382 25894 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:23.916211 25894 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.916815 25900 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.917788 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:23.917804 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.918540 25767 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
W20260709 12:09:23.919226 25658 leader_election.cc:343] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.919425 25807 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:23.920066 25807 ts_tablet_manager.cc:1403] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.018s
I20260709 12:09:23.920212 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.921277 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:23.921919 25900 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.922374 25900 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.922777 25900 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.922956 26057 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.923519 26057 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:23.922894 25807 raft_consensus.cc:359] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.924043 25807 raft_consensus.cc:385] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.924479 25807 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.924618 26057 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.925257 25807 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.927608 25807 ts_tablet_manager.cc:1434] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:09:23.928563 25807 tablet_bootstrap.cc:492] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:23.932153 25900 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.933163 25811 tablet_bootstrap.cc:492] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:23.933701 25811 ts_tablet_manager.cc:1403] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.237s	user 0.024s	sys 0.040s
I20260709 12:09:23.935581 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:23.908190 25617 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
W20260709 12:09:23.938067 25658 leader_election.cc:343] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.942140 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:23.942801 25767 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.940605 25900 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.945361 25811 raft_consensus.cc:359] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.946123 25811 raft_consensus.cc:385] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.946398 25811 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.949013 25767 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:23.949923 25811 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.951644 25809 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:23.952194 25811 ts_tablet_manager.cc:1434] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:23.952225 25809 ts_tablet_manager.cc:1403] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.021s
I20260709 12:09:23.953210 25811 tablet_bootstrap.cc:492] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:23.954851 25807 tablet_bootstrap.cc:654] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.955114 25809 raft_consensus.cc:359] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.955838 25809 raft_consensus.cc:385] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.956146 25809 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.960014 25811 tablet_bootstrap.cc:654] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.953943 25515 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.962168 25809 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.965413 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:23.967643 25900 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.968137 25900 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:23.968938 25900 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.971702 25809 ts_tablet_manager.cc:1434] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:09:23.972721 25809 tablet_bootstrap.cc:492] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:23.978869 25913 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.979604 25913 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.984772 26058 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.985381 26058 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:23.988080 26058 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:23.991112 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:23.992264 25617 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:23.993821 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:23.995051 26058 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.995553 26058 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.996230 26058 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.000242 25913 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.003202 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.004165 25765 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:24.008476 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:24.011091 26011 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.011601 26011 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.012035 26011 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.016327 25894 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.016882 25811 tablet_bootstrap.cc:492] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:24.016850 25894 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.018502 25811 ts_tablet_manager.cc:1403] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.007s
I20260709 12:09:24.021168 25894 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:24.020720 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:24.032061 25732 leader_election.cc:343] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.033010 25515 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.034643 25811 raft_consensus.cc:359] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.035794 25811 raft_consensus.cc:385] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.039080 25811 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.038425 26058 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.042728 25811 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.046435 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:24.048048 26014 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.048588 26014 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.050892 26014 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.053155 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:24.054555 25582 leader_election.cc:343] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.059702 25811 ts_tablet_manager.cc:1434] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 12:09:24.060739 25811 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:24.056224 26058 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.065321 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:24.066016 25766 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.072105 25811 tablet_bootstrap.cc:654] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.076202 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.077736 25693 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:24.080665 25807 tablet_bootstrap.cc:492] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:24.081245 25807 ts_tablet_manager.cc:1403] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.153s	user 0.062s	sys 0.051s
I20260709 12:09:24.081848 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.085695 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.089761 25688 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:24.084605 26011 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.095062 25617 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:24.095849 26011 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.098564 26053 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.098897 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:24.099125 26053 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.101348 26053 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:24.102859 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.104939 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.107137 25766 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:24.093693 25809 tablet_bootstrap.cc:654] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.092756 25807 raft_consensus.cc:359] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:24.108178 25732 leader_election.cc:343] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.086788 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.108129 25807 raft_consensus.cc:385] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.108886 25765 raft_consensus.cc:2376] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1. Re-sending same reply.
I20260709 12:09:24.109145 25807 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.110062 25807 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.111961 25807 ts_tablet_manager.cc:1434] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:09:24.113616 25807 tablet_bootstrap.cc:492] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:24.118110 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:24.119894 26053 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.120286 26053 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.119450 25515 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.120621 26053 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.121300 25583 leader_election.cc:343] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.121658 25732 leader_election.cc:343] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.121769 25583 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.122076 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.123023 26057 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.123693 25913 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.129027 25807 tablet_bootstrap.cc:654] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.123728 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:24.134922 25809 tablet_bootstrap.cc:492] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:24.138046 25809 ts_tablet_manager.cc:1403] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.166s	user 0.010s	sys 0.002s
I20260709 12:09:24.138502 25900 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.139081 25900 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:24.139878 25811 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:24.139992 25900 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.140844 25811 ts_tablet_manager.cc:1403] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.020s
I20260709 12:09:24.141041 25809 raft_consensus.cc:359] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.141722 25809 raft_consensus.cc:385] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.141963 25809 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.136366 26053 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.144438 25811 raft_consensus.cc:359] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.144713 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:24.146101 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:24.146543 25809 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.147863 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.148574 25809 ts_tablet_manager.cc:1434] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 12:09:24.149101 26011 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.149914 25809 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:24.150545 26011 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.146130 25732 leader_election.cc:343] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.145177 25811 raft_consensus.cc:385] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.158373 25809 tablet_bootstrap.cc:654] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.158875 25811 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.159910 25811 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.161194 26053 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:24.167269 25515 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.169274 25811 ts_tablet_manager.cc:1434] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.005s
I20260709 12:09:24.170074 25811 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:24.177752 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:24.177590 26058 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.178520 25689 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.185565 25983 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.195770 25807 tablet_bootstrap.cc:492] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:24.196328 25807 ts_tablet_manager.cc:1403] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.010s
I20260709 12:09:24.198020 26014 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:24.203464 25807 raft_consensus.cc:359] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.204406 25807 raft_consensus.cc:385] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.204699 25807 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.205528 25807 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.210836 25809 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:24.211447 25809 ts_tablet_manager.cc:1403] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.007s
I20260709 12:09:24.224691 25809 raft_consensus.cc:359] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.225358 25809 raft_consensus.cc:385] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.225612 25809 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.227592 25689 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:24.228400 25809 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.229664 25807 ts_tablet_manager.cc:1434] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:09:24.230619 25807 tablet_bootstrap.cc:492] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:24.231482 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:24.232345 25926 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.232859 25926 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:24.233731 25926 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.237754 25809 ts_tablet_manager.cc:1434] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:09:24.242096 25811 tablet_bootstrap.cc:654] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.245420 25983 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.246033 25983 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.247049 25809 tablet_bootstrap.cc:492] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:24.248270 25983 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.249398 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.250236 25765 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:24.251874 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:24.253407 25914 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.253839 25914 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.254319 25914 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.253254 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.255672 25807 tablet_bootstrap.cc:654] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.265118 25809 tablet_bootstrap.cc:654] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.264036 25914 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.268395 25914 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:24.273458 25658 leader_election.cc:343] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.274396 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:24.275027 25765 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.277451 25811 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:24.277945 25811 ts_tablet_manager.cc:1403] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.002s
I20260709 12:09:24.280010 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:24.282379 25658 leader_election.cc:343] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.287912 25807 tablet_bootstrap.cc:492] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:24.288437 25807 ts_tablet_manager.cc:1403] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 12:09:24.289721 25811 raft_consensus.cc:359] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.290573 25811 raft_consensus.cc:385] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.290751 25765 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:24.291110 25807 raft_consensus.cc:359] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.290925 25811 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.291733 26014 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.292486 26014 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.293067 25811 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.295423 25809 tablet_bootstrap.cc:492] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:24.295049 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:24.295893 25809 ts_tablet_manager.cc:1403] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.006s
I20260709 12:09:24.298158 25983 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.298763 25983 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:24.298476 25515 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.300406 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.301052 25689 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:24.301231 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.302155 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:24.302563 25766 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:24.302969 25913 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.303411 25913 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.303750 25913 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.300582 25983 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.304888 25809 raft_consensus.cc:359] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.305644 25809 raft_consensus.cc:385] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.305904 25809 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.306686 25809 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.309696 25809 ts_tablet_manager.cc:1434] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:09:24.291868 25807 raft_consensus.cc:385] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.310703 25809 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:24.310776 25807 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.299381 26014 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.312041 25913 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.312718 25807 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.315415 25811 ts_tablet_manager.cc:1434] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:09:24.318231 25811 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:24.315469 25807 ts_tablet_manager.cc:1434] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:09:24.315467 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:24.326562 25913 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.326884 25809 tablet_bootstrap.cc:654] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.326946 25766 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.327349 25807 tablet_bootstrap.cc:492] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:24.340917 25809 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:24.341491 25809 ts_tablet_manager.cc:1403] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.011s
I20260709 12:09:24.344040 25811 tablet_bootstrap.cc:654] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.344789 25809 raft_consensus.cc:359] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.348352 25809 raft_consensus.cc:385] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.348649 25809 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.349504 25809 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.341897 25766 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:24.352038 25809 ts_tablet_manager.cc:1434] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 12:09:24.352099 25582 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:24.352993 25809 tablet_bootstrap.cc:492] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:24.353199 25913 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.353780 25913 raft_consensus.cc:697] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:24.354776 25913 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.355664 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:24.356249 25689 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.357517 25514 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.367153 25807 tablet_bootstrap.cc:654] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.370685 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.374294 25689 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:24.403676 25807 tablet_bootstrap.cc:492] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:24.404347 25807 ts_tablet_manager.cc:1403] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.006s
I20260709 12:09:24.404532 25811 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:24.405881 25515 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.407531 25807 raft_consensus.cc:359] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.408214 25807 raft_consensus.cc:385] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.408468 25807 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.409250 25807 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.410738 25807 ts_tablet_manager.cc:1434] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:24.405248 25811 ts_tablet_manager.cc:1403] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.087s	user 0.004s	sys 0.021s
I20260709 12:09:24.426296 25807 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:24.428928 25811 raft_consensus.cc:359] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.429777 25811 raft_consensus.cc:385] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.432657 25926 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.433947 25807 tablet_bootstrap.cc:654] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.430084 25811 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.438484 25811 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.440179 25811 ts_tablet_manager.cc:1434] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:09:24.447393 25894 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.449671 26057 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.471616 25811 tablet_bootstrap.cc:492] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:24.472934 25809 tablet_bootstrap.cc:654] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.484838 25811 tablet_bootstrap.cc:654] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.507632 25913 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.518596 26011 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.517208 25913 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.537505 25807 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:24.538008 25807 ts_tablet_manager.cc:1403] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.112s	user 0.028s	sys 0.038s
I20260709 12:09:24.527310 25900 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.540570 25900 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.542850 25900 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.542173 25913 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.544237 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.545022 25618 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:24.545779 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.546360 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:24.548072 25914 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.548506 25914 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.548925 25914 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.549108 25807 raft_consensus.cc:359] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.549834 25807 raft_consensus.cc:385] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.550176 25811 tablet_bootstrap.cc:492] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:24.550859 25811 ts_tablet_manager.cc:1403] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.009s
I20260709 12:09:24.550101 25807 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.531848 26011 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.553951 25807 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.555135 25811 raft_consensus.cc:359] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.555790 26011 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.555864 25811 raft_consensus.cc:385] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.556563 25807 ts_tablet_manager.cc:1434] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:09:24.556697 25811 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.557757 25807 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:24.557665 25811 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.560012 25811 ts_tablet_manager.cc:1434] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:24.560065 25914 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.561482 25811 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:24.562791 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.563074 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:24.563490 25765 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:24.563624 25618 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.571116 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.574079 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.575277 25689 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:24.589345 25829 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.579246 25619 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.598534 25829 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.612746 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.602294 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.616930 26011 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.612309 25914 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.620033 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:24.622372 25766 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.621937 25765 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:24.628630 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.625895 25829 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:24.629693 25811 tablet_bootstrap.cc:654] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.632323 25618 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:24.632761 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.633796 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:24.635766 25732 leader_election.cc:343] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.634783 25914 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.641989 25983 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:24.644764 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.645862 25689 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:24.649708 25807 tablet_bootstrap.cc:654] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.658576 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:24.651552 25766 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:24.654719 25914 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:24.661065 25914 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.656127 26014 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.663530 25809 tablet_bootstrap.cc:492] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:24.664080 25809 ts_tablet_manager.cc:1403] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.311s	user 0.026s	sys 0.040s
I20260709 12:09:24.663986 25829 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.664558 25829 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.664940 25829 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.671794 25809 raft_consensus.cc:359] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.672072 26125 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.673787 26011 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.676383 25983 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.676219 25809 raft_consensus.cc:385] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.677163 25809 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.678380 25809 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.684080 25809 ts_tablet_manager.cc:1434] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.006s
I20260709 12:09:24.681015 25811 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:24.687886 25811 ts_tablet_manager.cc:1403] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.007s
I20260709 12:09:24.686543 25807 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:24.688877 25807 ts_tablet_manager.cc:1403] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.002s
I20260709 12:09:24.691821 25811 raft_consensus.cc:359] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.692474 25811 raft_consensus.cc:385] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.692708 25811 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.693316 25811 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.697293 25809 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:24.674153 25829 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.710839 25811 ts_tablet_manager.cc:1434] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:09:24.708849 25517 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.711875 25811 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:24.718731 25617 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.738060 26057 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:24.751720 26125 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.752426 26125 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.756932 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.764289 26125 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.764101 25894 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.764765 25807 raft_consensus.cc:359] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.765452 25807 raft_consensus.cc:385] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.765710 25807 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.768783 25829 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:24.772346 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.772763 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:24.773413 25693 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.766613 25807 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.775323 25809 tablet_bootstrap.cc:654] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.782923 25693 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:24.783180 25983 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.784893 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:24.786242 25658 leader_election.cc:343] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.786984 26053 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.784309 26057 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.787325 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:24.787931 26057 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.797770 25807 ts_tablet_manager.cc:1434] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.001s
I20260709 12:09:24.795913 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.820060 26133 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:24.828203 25732 leader_election.cc:343] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.838893 26133 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.843585 26111 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.844112 26111 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.844579 26133 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:24.845933 25732 leader_election.cc:343] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.846777 25807 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:24.850898 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.851440 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.851588 25691 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:24.852663 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:24.854398 26111 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.834374 26011 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.833912 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.858733 25617 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.858683 25732 leader_election.cc:343] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.823643 26053 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:24.861112 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.862248 26124 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.863195 25766 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:24.862162 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:24.865036 25732 leader_election.cc:343] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.866024 26124 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.850029 26057 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:24.866575 26133 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.866520 26124 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.867043 26133 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.867476 26133 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.867666 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.870002 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.861573 26011 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.872015 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:24.873150 26125 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.868672 26124 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:24.874624 25811 tablet_bootstrap.cc:654] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.875130 26125 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.905066 26125 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.907058 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.913923 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:24.914848 25765 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:24.922236 25583 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.928836 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:24.917145 26011 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:24.934777 25807 tablet_bootstrap.cc:654] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.926630 26053 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.939258 26133 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:24.946576 26011 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:24.952612 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 75101.6us
I20260709 12:09:24.951761 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:24.977043 25732 leader_election.cc:343] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.977837 25732 leader_election.cc:343] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.978222 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.979138 26011 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.984114 25616 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.990607 25583 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:24.993530 26133 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:25.006273 25983 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.007694 25809 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:25.008361 25809 ts_tablet_manager.cc:1403] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.311s	user 0.017s	sys 0.016s
I20260709 12:09:25.014302 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:24.995062 26139 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:25.016709 25732 leader_election.cc:343] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.023257 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:25.023931 25692 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.039639 25514 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.015372 26125 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.047712 26125 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:25.050029 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:25.050891 25764 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.072639 25811 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:25.078475 25811 ts_tablet_manager.cc:1403] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.367s	user 0.017s	sys 0.004s
I20260709 12:09:25.073397 25809 raft_consensus.cc:359] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.079952 25809 raft_consensus.cc:385] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.080312 25809 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.128814 25809 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.129469 25811 raft_consensus.cc:359] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.132411 25811 raft_consensus.cc:385] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.132834 25811 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.134613 25811 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.139302 25809 ts_tablet_manager.cc:1434] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.001s
I20260709 12:09:25.140560 25809 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:25.144239 25811 ts_tablet_manager.cc:1434] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.006s
I20260709 12:09:25.145323 25811 tablet_bootstrap.cc:492] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:25.141419 26014 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.164703 25807 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:25.165179 25807 ts_tablet_manager.cc:1403] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.319s	user 0.024s	sys 0.046s
I20260709 12:09:25.172133 25807 raft_consensus.cc:359] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.172865 25807 raft_consensus.cc:385] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.173141 25807 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.177110 25807 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.187354 25807 ts_tablet_manager.cc:1434] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 12:09:25.186077 25811 tablet_bootstrap.cc:654] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.189235 25926 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.195732 26111 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.203919 25764 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:25.207007 25807 tablet_bootstrap.cc:492] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:25.192601 25926 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.211731 25926 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:25.223726 25692 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:25.230651 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:25.232857 25983 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.234823 25983 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:25.235838 25983 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.233734 26058 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:09:25.240221 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:25.245716 25807 tablet_bootstrap.cc:654] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.247852 25900 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.248824 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:25.249071 26014 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.249768 26014 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:25.259725 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82400.2us
I20260709 12:09:25.231408 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:25.246624 25829 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.269557 25900 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.250039 25914 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:09:25.270221 25900 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:25.284242 25732 leader_election.cc:343] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.271245 25616 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.299687 25900 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:25.287189 25829 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:25.293730 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:25.309104 25809 tablet_bootstrap.cc:654] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.315143 25811 tablet_bootstrap.cc:492] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:25.315642 25811 ts_tablet_manager.cc:1403] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.171s	user 0.028s	sys 0.014s
I20260709 12:09:25.316097 25829 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.320060 26014 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:25.322921 25732 leader_election.cc:343] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.323374 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:25.323596 25811 raft_consensus.cc:359] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.326316 25811 raft_consensus.cc:385] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.326727 25811 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.327592 25811 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.330556 25811 ts_tablet_manager.cc:1434] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:09:25.331900 25811 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:25.334317 26053 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.337312 25807 tablet_bootstrap.cc:492] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:25.338719 25807 ts_tablet_manager.cc:1403] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.132s	user 0.020s	sys 0.010s
I20260709 12:09:25.343426 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:25.423261 25768 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:25.455322 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:25.462641 25809 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:25.463362 25807 raft_consensus.cc:359] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.464161 25807 raft_consensus.cc:385] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.464459 25807 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.465302 25809 ts_tablet_manager.cc:1403] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.325s	user 0.013s	sys 0.005s
I20260709 12:09:25.465116 25807 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.468214 25809 raft_consensus.cc:359] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.468963 25809 raft_consensus.cc:385] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.468180 25807 ts_tablet_manager.cc:1434] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.000s
I20260709 12:09:25.469267 25809 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.469978 25809 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.471156 25811 tablet_bootstrap.cc:654] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.472057 25809 ts_tablet_manager.cc:1434] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:09:25.473902 25809 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:25.525701 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:25.578727 25807 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
W20260709 12:09:25.592398 25657 leader_election.cc:343] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.609783 25616 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:25.618464 25807 tablet_bootstrap.cc:654] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.641974 25658 leader_election.cc:343] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.642642 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:25.643944 25983 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.653342 25811 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:25.660356 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:25.661571 25811 ts_tablet_manager.cc:1403] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.330s	user 0.033s	sys 0.015s
I20260709 12:09:25.667122 26151 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.667868 26151 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.672295 26151 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:25.677392 25809 tablet_bootstrap.cc:654] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.681913 25811 raft_consensus.cc:359] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.682969 25811 raft_consensus.cc:385] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.683410 25811 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.681540 25514 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.684821 25811 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.687463 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:25.698009 25732 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.702636 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:25.703835 25689 raft_consensus.cc:2393] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:25.704547 25811 ts_tablet_manager.cc:1434] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.005s
I20260709 12:09:25.706883 25811 tablet_bootstrap.cc:492] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:25.750438 25983 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.751139 25983 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.753804 25983 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:25.754773 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:25.755597 25611 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:25.758652 25658 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:25.755445 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:25.760126 26151 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.762933 26156 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.765094 25616 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.765265 26156 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.765714 26156 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.770125 25583 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:25.774353 25809 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:25.767347 26155 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:25.781966 26151 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.783300 25811 tablet_bootstrap.cc:654] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.790810 25807 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:25.791435 25807 ts_tablet_manager.cc:1403] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.213s	user 0.012s	sys 0.007s
I20260709 12:09:25.796038 25807 raft_consensus.cc:359] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.796939 25807 raft_consensus.cc:385] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.797219 25807 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.797938 25807 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.799942 25807 ts_tablet_manager.cc:1434] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:25.798986 25809 ts_tablet_manager.cc:1403] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.325s	user 0.018s	sys 0.007s
I20260709 12:09:25.802313 25894 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.805539 25807 tablet_bootstrap.cc:492] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:25.820501 25809 raft_consensus.cc:359] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.821455 25809 raft_consensus.cc:385] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.821744 25809 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.824991 25809 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.835049 26156 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.849807 25809 ts_tablet_manager.cc:1434] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.002s
I20260709 12:09:25.851754 25809 tablet_bootstrap.cc:492] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:25.855736 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:25.856570 25611 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.873299 25829 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.873898 25829 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.874188 26156 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:25.874701 25517 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.875989 25829 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:25.876531 25611 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:25.877679 25658 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:25.884979 25807 tablet_bootstrap.cc:654] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.886065 25809 tablet_bootstrap.cc:654] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.886137 26153 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.886999 26153 raft_consensus.cc:697] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:25.887813 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:25.888770 26153 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:25.891465 25732 leader_election.cc:343] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.896694 25811 tablet_bootstrap.cc:492] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:25.897228 25811 ts_tablet_manager.cc:1403] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.191s	user 0.020s	sys 0.009s
I20260709 12:09:25.900354 25811 raft_consensus.cc:359] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.901094 25811 raft_consensus.cc:385] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.901350 25811 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.905057 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:25.905807 25764 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:25.907470 25807 tablet_bootstrap.cc:492] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:25.908237 25809 tablet_bootstrap.cc:492] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:25.907953 25829 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.922704 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:25.923386 25764 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.923527 25809 ts_tablet_manager.cc:1403] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.001s
I20260709 12:09:25.926956 25829 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.930464 25809 raft_consensus.cc:359] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.931440 25809 raft_consensus.cc:385] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.932029 25809 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.908743 25807 ts_tablet_manager.cc:1403] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.007s
I20260709 12:09:25.933647 26133 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.932902 25809 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.934228 26133 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.930532 25811 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.936832 26133 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:25.938107 25809 ts_tablet_manager.cc:1434] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:25.938458 25811 ts_tablet_manager.cc:1434] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.005s
I20260709 12:09:25.940078 25764 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:25.940325 25809 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:25.940491 25811 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:25.940176 25515 catalog_manager.cc:5697] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.946734 25807 raft_consensus.cc:359] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.947608 25807 raft_consensus.cc:385] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.947898 25807 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.951972 25809 tablet_bootstrap.cc:654] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.953547 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:25.956972 25617 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.958493 25732 leader_election.cc:343] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.961163 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:25.966280 25688 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:25.964721 25807 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.972580 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:25.973585 25689 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:25.985569 25829 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.986353 25829 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:25.985914 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:25.992570 25894 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.992964 25894 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.993588 25894 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.994966 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:25.978855 26153 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:09:26.008142 25807 ts_tablet_manager.cc:1434] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.001s
I20260709 12:09:26.016598 25807 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.018054 25829 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:26.021623 26163 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.026993 26163 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.045532 25811 tablet_bootstrap.cc:654] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.053138 25894 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.059343 25894 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:26.061705 25809 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.062285 25809 ts_tablet_manager.cc:1403] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.018s
I20260709 12:09:26.053666 26163 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:26.057222 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46991us
I20260709 12:09:26.115191 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:26.142179 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:26.148059 26163 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.151822 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:26.151657 25809 raft_consensus.cc:359] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.152491 25809 raft_consensus.cc:385] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.152542 25694 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.152822 25809 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.153605 25809 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.155305 25809 ts_tablet_manager.cc:1434] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.093s	user 0.020s	sys 0.017s
I20260709 12:09:26.156761 25809 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.163211 25809 tablet_bootstrap.cc:654] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:26.165633 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73315.6us
I20260709 12:09:26.171432 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:26.178248 25809 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.178851 25809 ts_tablet_manager.cc:1403] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:09:26.179869 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:26.198378 25732 leader_election.cc:343] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.203006 25807 tablet_bootstrap.cc:654] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.181843 25809 raft_consensus.cc:359] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.191395 25694 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:26.207039 25809 raft_consensus.cc:385] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.209316 25809 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.217871 26154 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.218556 26154 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.218410 25809 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.228024 26163 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:26.229269 26154 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.229943 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:26.231235 25658 leader_election.cc:343] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.238638 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:26.239750 25766 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:26.243955 25811 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:26.244516 25811 ts_tablet_manager.cc:1403] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.304s	user 0.012s	sys 0.010s
I20260709 12:09:26.244678 25809 ts_tablet_manager.cc:1434] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:09:26.246333 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:26.246829 25732 leader_election.cc:343] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.249074 26154 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:26.249367 25732 leader_election.cc:343] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.249644 26154 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.250300 26154 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.250165 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:26.256803 25809 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.258435 26183 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.263314 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.265401 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:26.266201 25688 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.266232 25811 raft_consensus.cc:359] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.267073 25811 raft_consensus.cc:385] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.267338 25811 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.267982 25811 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.274449 25811 ts_tablet_manager.cc:1434] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 12:09:26.279866 25811 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:26.273658 26183 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.280869 26183 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:26.283727 25807 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:26.284257 25807 ts_tablet_manager.cc:1403] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.268s	user 0.018s	sys 0.005s
I20260709 12:09:26.281819 26183 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.284721 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:26.293331 25732 leader_election.cc:343] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.293931 25688 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:26.299309 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.303272 26184 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.304018 26184 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:26.305034 26184 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.321481 25900 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.322337 25900 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.327646 25809 tablet_bootstrap.cc:654] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.333108 25900 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.333233 26154 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.334856 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:26.335667 25766 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:26.336968 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:26.331423 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:26.340281 25983 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:26.340234 25658 leader_election.cc:343] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.340734 25983 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.341120 25983 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.343483 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:26.344547 25613 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.358063 25809 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.358678 25809 ts_tablet_manager.cc:1403] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.000s
I20260709 12:09:26.361898 25809 raft_consensus.cc:359] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.362824 25809 raft_consensus.cc:385] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.363113 25809 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.345795 25807 raft_consensus.cc:359] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.348567 26154 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.349591 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:26.363919 25809 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.364768 25807 raft_consensus.cc:385] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.364966 25766 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.365156 25807 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
W20260709 12:09:26.365628 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89398.4us
I20260709 12:09:26.349776 25983 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.366698 25809 ts_tablet_manager.cc:1434] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:26.352751 26155 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.368891 25809 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.385473 25811 tablet_bootstrap.cc:654] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.387318 25807 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.353493 25517 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.393494 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:26.393752 25983 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.397727 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:26.398429 25768 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.400715 25766 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:26.405987 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:26.407212 25658 leader_election.cc:343] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.408438 26154 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.409026 26154 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:26.416885 26154 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.419091 26125 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.445454 25809 tablet_bootstrap.cc:654] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.445750 25807 ts_tablet_manager.cc:1434] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.161s	user 0.010s	sys 0.003s
I20260709 12:09:26.450016 25807 tablet_bootstrap.cc:492] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.469458 25768 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:26.491508 25517 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.501654 25613 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:26.508885 25807 tablet_bootstrap.cc:654] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.516652 25809 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.517181 25809 ts_tablet_manager.cc:1403] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.009s
I20260709 12:09:26.522291 25811 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:26.522881 25811 ts_tablet_manager.cc:1403] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.243s	user 0.007s	sys 0.018s
I20260709 12:09:26.531533 25811 raft_consensus.cc:359] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.532287 25811 raft_consensus.cc:385] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.532541 25811 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.524633 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.527525 25809 raft_consensus.cc:359] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.536021 25809 raft_consensus.cc:385] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.536096 26153 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.536607 25809 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.536785 26153 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:26.526908 25807 tablet_bootstrap.cc:492] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:26.537850 25807 ts_tablet_manager.cc:1403] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.002s
I20260709 12:09:26.537739 26153 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.542129 25809 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.544685 25809 ts_tablet_manager.cc:1434] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:09:26.545003 25811 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.545754 25809 tablet_bootstrap.cc:492] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.547389 25811 ts_tablet_manager.cc:1434] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.005s
I20260709 12:09:26.543007 25807 raft_consensus.cc:359] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.552040 25807 raft_consensus.cc:385] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.552378 25807 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.557082 25809 tablet_bootstrap.cc:654] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.559612 25807 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.563064 25807 ts_tablet_manager.cc:1434] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:09:26.563711 25811 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:26.564302 25807 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.567459 25514 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.585269 26124 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.585865 26124 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.588179 26124 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:26.593480 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:26.596485 25732 leader_election.cc:343] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.598694 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:26.610519 25807 tablet_bootstrap.cc:654] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.610759 25811 tablet_bootstrap.cc:654] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:26.615096 25732 leader_election.cc:343] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.615806 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:26.617642 26124 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.631062 25900 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.631798 25900 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.633931 25900 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.637646 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:26.639638 25658 leader_election.cc:343] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.641813 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:26.642331 25807 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:26.642583 25768 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:26.642915 25807 ts_tablet_manager.cc:1403] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.010s
I20260709 12:09:26.643096 25811 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:26.643595 25811 ts_tablet_manager.cc:1403] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.021s
I20260709 12:09:26.644794 25809 tablet_bootstrap.cc:492] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.645320 25809 ts_tablet_manager.cc:1403] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.025s
I20260709 12:09:26.645960 25807 raft_consensus.cc:359] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.647100 25807 raft_consensus.cc:385] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.647394 25807 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.648175 25807 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.648473 25809 raft_consensus.cc:359] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.648207 25811 raft_consensus.cc:359] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.649328 25809 raft_consensus.cc:385] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.650581 25809 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.651854 25807 ts_tablet_manager.cc:1434] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:26.651515 25809 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.652971 25807 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.649358 25811 raft_consensus.cc:385] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.658249 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.658443 25811 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.659068 25900 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.659433 25900 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.659926 25900 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.659366 25811 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.660694 25809 ts_tablet_manager.cc:1434] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:09:26.661760 25809 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.661890 25811 ts_tablet_manager.cc:1434] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:09:26.663360 25811 tablet_bootstrap.cc:492] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:26.668782 25900 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.677089 25811 tablet_bootstrap.cc:654] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.677163 25809 tablet_bootstrap.cc:654] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.679432 25900 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.680254 25807 tablet_bootstrap.cc:654] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.680365 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:26.681766 25658 leader_election.cc:343] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.684232 25809 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.684767 25809 ts_tablet_manager.cc:1403] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 12:09:26.684759 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:26.685815 25768 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.686149 25811 tablet_bootstrap.cc:492] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:26.686616 25811 ts_tablet_manager.cc:1403] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 12:09:26.688086 25809 raft_consensus.cc:359] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.688761 25809 raft_consensus.cc:385] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.689010 25809 raft_consensus.cc:740] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.689813 25809 consensus_queue.cc:260] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.689790 25811 raft_consensus.cc:359] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.701579 25811 raft_consensus.cc:385] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.701939 25811 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.702673 25811 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.703241 25809 ts_tablet_manager.cc:1434] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:09:26.704566 25809 tablet_bootstrap.cc:492] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.705133 25811 ts_tablet_manager.cc:1434] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 12:09:26.706182 25811 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:26.712461 25811 tablet_bootstrap.cc:654] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.713474 25514 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.715651 25809 tablet_bootstrap.cc:654] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.715683 25807 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:26.718397 25807 ts_tablet_manager.cc:1403] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.018s
I20260709 12:09:26.727000 25807 raft_consensus.cc:359] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.727895 25807 raft_consensus.cc:385] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.728238 25807 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.729378 25807 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.733232 25807 ts_tablet_manager.cc:1434] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:09:26.736532 25807 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.747231 25768 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:26.749138 26153 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.763695 26153 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.750882 25809 tablet_bootstrap.cc:492] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:26.765705 25809 ts_tablet_manager.cc:1403] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.003s
I20260709 12:09:26.766009 26153 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.768085 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:26.769767 25658 leader_election.cc:343] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.752280 25807 tablet_bootstrap.cc:654] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.771730 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:26.772470 25764 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:26.758239 26183 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.775228 25809 raft_consensus.cc:359] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.775949 25809 raft_consensus.cc:385] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.776219 25809 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.776906 25809 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.778606 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.779481 25900 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.779876 25900 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.780216 25900 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.781075 25807 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:26.781594 25807 ts_tablet_manager.cc:1403] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.004s
I20260709 12:09:26.784500 25807 raft_consensus.cc:359] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.785339 25807 raft_consensus.cc:385] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.785652 25807 raft_consensus.cc:740] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.786469 25807 consensus_queue.cc:260] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.790118 25900 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.793548 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:26.795272 25658 leader_election.cc:343] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.798707 25807 ts_tablet_manager.cc:1434] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:26.799582 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.800552 25807 tablet_bootstrap.cc:492] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.801461 26153 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.802434 26153 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:26.802538 25900 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.803378 26153 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.804895 26183 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.805687 25811 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:26.806167 25811 ts_tablet_manager.cc:1403] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.030s
I20260709 12:09:26.808003 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:26.808648 25764 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.809198 25811 raft_consensus.cc:359] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.810048 25811 raft_consensus.cc:385] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.810393 25811 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.810091 25809 ts_tablet_manager.cc:1434] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
I20260709 12:09:26.811924 25807 tablet_bootstrap.cc:654] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.812469 25809 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:26.813930 25811 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.817119 25811 ts_tablet_manager.cc:1434] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:26.818249 25811 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:26.825219 25811 tablet_bootstrap.cc:654] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.826488 25613 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.832948 25807 tablet_bootstrap.cc:492] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:26.833465 25807 ts_tablet_manager.cc:1403] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.003s
I20260709 12:09:26.836488 25807 raft_consensus.cc:359] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.837118 25807 raft_consensus.cc:385] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.837368 25807 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.838018 25807 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.840397 25807 ts_tablet_manager.cc:1434] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:09:26.840899 25811 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:26.841464 25811 ts_tablet_manager.cc:1403] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 12:09:26.844228 25764 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:26.841512 25807 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: Bootstrap starting.
I20260709 12:09:26.844874 25811 raft_consensus.cc:359] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.845671 25811 raft_consensus.cc:385] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.846015 25811 raft_consensus.cc:740] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.846848 25811 consensus_queue.cc:260] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.841502 26124 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.849474 25811 ts_tablet_manager.cc:1434] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:26.849927 26155 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.850483 26155 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.852380 25811 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:26.858911 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:26.859989 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:26.860548 26155 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.869621 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:26.870405 25764 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:26.876617 25811 tablet_bootstrap.cc:654] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.874994 25807 tablet_bootstrap.cc:654] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.866338 26154 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.874733 25618 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:26.879927 26154 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:26.879237 25657 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:26.880865 26154 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.881352 25900 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.881738 25900 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.882061 25900 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.889783 25900 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.892498 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:26.893141 25611 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.898005 25616 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.901789 25611 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:26.908160 25900 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:26.909521 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:26.911075 25768 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.913098 25900 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.915017 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.930878 25614 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.948909 26153 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.949581 26153 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.948678 26183 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.958765 25658 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:26.960116 25900 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.960721 25900 raft_consensus.cc:697] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:26.961715 25900 consensus_queue.cc:237] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:26.996377 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:26.987720 26154 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:09:27.031857 25809 tablet_bootstrap.cc:654] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.039748 26190 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.058668 26190 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.061038 26190 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.062862 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.063742 25763 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:27.065595 26153 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:27.074798 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56918.2us
I20260709 12:09:27.075241 25811 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:27.075994 25811 ts_tablet_manager.cc:1403] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.225s	user 0.013s	sys 0.032s
I20260709 12:09:27.072743 26184 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.065632 25768 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
W20260709 12:09:27.086915 26218 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:09:27.089103 26149 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.089689 26149 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.084551 26184 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.093544 26184 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:27.105129 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:27.110071 26149 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.113965 25811 raft_consensus.cc:359] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.116200 25811 raft_consensus.cc:385] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.116509 25811 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.117549 25811 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.121882 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.122570 25767 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:27.123785 25807 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: No bootstrap required, opened a new log
I20260709 12:09:27.124279 25807 ts_tablet_manager.cc:1403] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: Time spent bootstrapping tablet: real 0.283s	user 0.015s	sys 0.030s
W20260709 12:09:27.119190 25732 leader_election.cc:343] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.121919 26125 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.153105 26223 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:27.201399 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 43479.7us
I20260709 12:09:27.277664 25811 ts_tablet_manager.cc:1434] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.201s	user 0.008s	sys 0.002s
W20260709 12:09:27.200003 25658 leader_election.cc:343] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.170060 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:27.280648 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 80730.2us
I20260709 12:09:27.234980 25517 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.288627 25811 tablet_bootstrap.cc:492] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:27.174108 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:27.254644 26182 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.173836 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.302405 25807 raft_consensus.cc:359] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.303187 25807 raft_consensus.cc:385] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.303243 26222 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.296084 26182 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.306056 25768 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:27.306969 25809 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:27.307448 25809 ts_tablet_manager.cc:1403] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.495s	user 0.024s	sys 0.024s
I20260709 12:09:27.303542 25807 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.254513 26125 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.287055 26223 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.316897 26223 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.318960 25807 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:27.326757 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 194915us
I20260709 12:09:27.330299 26125 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:27.331660 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51564.4us
I20260709 12:09:27.332734 25807 ts_tablet_manager.cc:1434] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: Time spent starting tablet: real 0.208s	user 0.011s	sys 0.030s
I20260709 12:09:27.337869 25809 raft_consensus.cc:359] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.338850 25809 raft_consensus.cc:385] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.339161 25809 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
W20260709 12:09:27.339938 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 55194.8us
I20260709 12:09:27.344874 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:27.345885 26192 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:27.346247 26192 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.346612 26192 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.349419 26153 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.351655 25811 tablet_bootstrap.cc:654] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.351390 26229 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.355990 25809 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.355535 26229 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.358429 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:27.354025 26182 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:27.377593 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:27.388556 26229 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.401867 25809 ts_tablet_manager.cc:1434] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.003s
I20260709 12:09:27.403306 25809 tablet_bootstrap.cc:492] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Bootstrap starting.
I20260709 12:09:27.406747 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:27.402915 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:27.393766 25691 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
W20260709 12:09:27.412367 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59513.4us
I20260709 12:09:27.411332 26192 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.407755 25687 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:27.422163 25583 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:27.431195 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:27.431896 25691 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:27.434347 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.435174 25766 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
I20260709 12:09:27.438472 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:27.439189 25613 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 0.
I20260709 12:09:27.439400 25811 tablet_bootstrap.cc:492] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:27.441141 25811 ts_tablet_manager.cc:1403] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.153s	user 0.015s	sys 0.009s
I20260709 12:09:27.442871 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:27.444002 26183 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.444432 26183 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.444801 26183 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.448740 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:27.456874 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.457564 25767 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:27.463788 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.464476 25767 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:27.466831 25614 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:27.467399 26232 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.493516 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46875.8us
I20260709 12:09:27.493896 25811 raft_consensus.cc:359] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.494746 25811 raft_consensus.cc:385] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.495105 25811 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.495894 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:27.495831 25811 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:27.497258 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 43586.6us
I20260709 12:09:27.498149 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:27.503019 26190 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:27.509816 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56032.2us
W20260709 12:09:27.510515 25658 leader_election.cc:343] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.511708 25657 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:27.512615 25811 ts_tablet_manager.cc:1434] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.001s
I20260709 12:09:27.506138 26155 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.503432 26190 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:27.515430 25658 leader_election.cc:343] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.519335 26192 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.521459 25809 tablet_bootstrap.cc:654] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.515584 26155 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.516888 26190 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.527066 26155 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.537853 26154 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.547219 26154 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.562897 26154 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.600868 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 92589.1us
I20260709 12:09:27.609867 26125 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.623714 26239 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.626116 25811 tablet_bootstrap.cc:492] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
W20260709 12:09:27.626543 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 114917us
I20260709 12:09:27.628289 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:27.630105 26244 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.630401 26232 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.630569 26244 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.630939 26244 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.635730 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:27.617839 26125 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.638859 26224 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.635799 26239 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.642110 26224 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.642606 26224 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.645713 26239 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.648335 25517 catalog_manager.cc:5697] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.651573 26125 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.632032 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:27.659976 26183 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.665063 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.666229 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:27.668648 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:27.673913 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:27.679826 25768 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 0.
I20260709 12:09:27.684304 26244 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.678025 25767 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 0.
W20260709 12:09:27.679288 26241 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:09:27.688498 26223 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.688571 25983 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.700203 26154 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.689720 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:27.696970 26190 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.703073 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:27.698050 26183 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:27.703943 26240 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.704350 26240 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.704684 26240 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.708168 25583 leader_election.cc:343] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.709157 25583 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:27.707136 26222 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.710543 26222 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.704921 26155 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:27.711835 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 195065us
I20260709 12:09:27.712323 26236 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:27.710891 26222 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.718820 26223 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.722451 26154 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.716897 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:27.723970 25691 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:27.717106 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:27.725268 25614 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:27.730772 25809 tablet_bootstrap.cc:492] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: No bootstrap required, opened a new log
I20260709 12:09:27.731473 25809 ts_tablet_manager.cc:1403] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.007s
I20260709 12:09:27.734244 26155 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.736212 26244 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.737293 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:27.738868 26124 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.742367 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:27.748423 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:27.750658 25765 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.757278 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:27.762852 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:27.764040 25766 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:27.800978 26190 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.801608 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:27.803038 25692 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:27.803241 25765 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:27.765794 26224 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.824869 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:27.828222 25762 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:27.822821 26222 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.830997 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:27.834611 25767 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:27.807768 26240 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.842891 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:27.832389 26190 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.857726 25809 raft_consensus.cc:359] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.858837 25809 raft_consensus.cc:385] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.859377 25809 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.854225 26154 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.872315 26154 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:27.872895 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:27.873196 26154 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.876212 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:27.881042 26224 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:27.882066 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:27.883073 25617 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 1: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:09:27.882119 26250 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:09:27.886747 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:27.864203 25809 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.889232 25809 ts_tablet_manager.cc:1434] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent starting tablet: real 0.157s	user 0.008s	sys 0.000s
I20260709 12:09:27.894547 25811 tablet_bootstrap.cc:654] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.895236 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:27.897883 25692 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:27.899276 25613 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:27.906920 26153 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:27.910924 25658 leader_election.cc:343] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.913740 26240 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.899873 26222 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:27.917618 26238 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:27.918076 26238 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:27.927947 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:27.928720 25691 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.921993 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:27.931880 25658 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.937424 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:27.937718 25658 leader_election.cc:343] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.938122 25766 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:27.938673 25658 leader_election.cc:343] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.939113 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:27.942538 26230 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:27.945008 26222 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.947710 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:27.948544 26230 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.918969 26238 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:27.949648 26238 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:27.949851 25732 leader_election.cc:343] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.950568 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:27.951269 26183 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.958556 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:27.959229 25764 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.961494 25766 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:27.971711 26244 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:27.964385 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:27.992430 25658 leader_election.cc:343] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.992012 26232 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.009428 26232 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:28.001469 25514 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.013183 26232 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.023262 25691 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:28.072249 25811 tablet_bootstrap.cc:492] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:28.072775 25811 ts_tablet_manager.cc:1403] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.466s	user 0.022s	sys 0.004s
I20260709 12:09:28.076524 25764 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:28.080215 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:28.081055 26244 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:28.081553 26244 raft_consensus.cc:697] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:28.082417 26244 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.085160 25811 raft_consensus.cc:359] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.085951 25811 raft_consensus.cc:385] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.086211 25811 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.086882 25811 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.089331 25811 ts_tablet_manager.cc:1434] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:28.090381 25811 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:28.105464 25517 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.116186 26190 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.116788 26190 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.123134 26190 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:28.123649 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:28.124428 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:28.125233 25762 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:28.127147 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:28.127918 26190 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.137156 26190 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.139101 25811 tablet_bootstrap.cc:654] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.149915 25811 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:28.150475 25811 ts_tablet_manager.cc:1403] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260709 12:09:28.155090 25811 raft_consensus.cc:359] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.155800 25811 raft_consensus.cc:385] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.156059 25811 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.156692 25811 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.158782 25811 ts_tablet_manager.cc:1434] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:28.159714 25811 tablet_bootstrap.cc:492] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:28.165926 25811 tablet_bootstrap.cc:654] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.168089 25514 catalog_manager.cc:5697] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 1, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.182998 25811 tablet_bootstrap.cc:492] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:28.183527 25811 ts_tablet_manager.cc:1403] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:09:28.186561 25811 raft_consensus.cc:359] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.187088 25811 raft_consensus.cc:385] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.187379 25811 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.187927 25811 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.189810 25811 ts_tablet_manager.cc:1434] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:28.191442 25811 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Bootstrap starting.
I20260709 12:09:28.197441 25811 tablet_bootstrap.cc:654] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:28.209467 25811 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: No bootstrap required, opened a new log
I20260709 12:09:28.209964 25811 ts_tablet_manager.cc:1403] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.013s
I20260709 12:09:28.213025 25811 raft_consensus.cc:359] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.213759 25811 raft_consensus.cc:385] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:28.214041 25811 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Initialized, Role: FOLLOWER
I20260709 12:09:28.214903 25811 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.216740 25811 ts_tablet_manager.cc:1434] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:28.368651 26154 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.383216 26244 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.413501 26190 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.425741 26240 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.468619 25615 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.491394 25612 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.504737 26125 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:28.508940 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:28.528759 26230 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:28.599833 26190 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.600854 26190 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:28.603128 26190 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:28.603847 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:28.604720 25687 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:28.604838 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:28.605665 25762 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 1: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:28.606644 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:28.607313 26190 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.613188 26190 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:29.228179 26274 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.228776 26274 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.231006 26274 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:29.232088 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:29.232088 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:29.233161 25615 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:29.234418 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:29.235107 26274 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:29.235478 26274 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.235862 26274 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:29.239367 26184 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:29.239904 26184 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.241657 26274 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.242090 26184 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:29.243108 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:29.243741 26274 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:29.243948 25615 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:29.244663 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:29.245239 25611 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:29.245916 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:29.245254 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:29.246585 25768 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:29.247144 25687 raft_consensus.cc:2368] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:29.248502 25732 leader_election.cc:400] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:29.248792 25732 leader_election.cc:403] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:29.254209 25768 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:29.254875 26184 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:29.256953 25611 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:29.258241 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:29.259415 26125 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:29.262068 26125 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:29.263026 26125 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.273789 25514 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:29.545356 25565 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:29.634187 26230 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.634828 26230 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.636826 26230 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:29.637528 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:29.637775 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:29.638212 25611 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:29.638509 25762 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:29.639261 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:29.640188 26230 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:29.640605 26230 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.640904 26230 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.646575 26230 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.648451 26230 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:29.649155 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:29.649338 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:29.649746 25612 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.649922 25762 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.656498 25762 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:29.656983 25612 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:29.657795 25657 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:29.658646 26230 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:29.659137 26230 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:29.659989 26230 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.671653 26184 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:29.672224 26184 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.672004 25514 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 0 to 2, leader changed from <none> to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:29.674695 26184 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:29.674947 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:29.675668 25612 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:29.676311 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:29.676949 25687 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:29.676656 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:29.679679 26184 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:29.680073 26184 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:29.680830 26184 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.690928 26184 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.693101 26184 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:29.694399 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:29.695086 25611 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.698642 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:29.699287 25692 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:29.701031 25612 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:29.703048 26230 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.704080 25611 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:29.705093 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:29.705931 26184 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:29.706457 26184 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:29.707652 26184 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:29.712038 25692 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:29.712392 25764 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:29.714787 26230 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:29.725275 25514 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 0 to 2, leader changed from <none> to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:30.189994 25611 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:30.191639 26230 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.204835 25762 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:30.213711 26154 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.311820 25612 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:30.312294 25687 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:30.313328 26273 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:30.314018 26184 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:31.034699 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:31.068708 26293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:31.071388 26294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:31.071838 26296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:31.075500 24442 server_base.cc:1061] running on GCE node
I20260709 12:09:31.077191 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:31.077517 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:31.077767 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783598971077747 us; error 0 us; skew 500 ppm
I20260709 12:09:31.078572 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:31.082830 24442 webserver.cc:533] Webserver started at http://127.23.222.132:43129/ using document root <none> and password file <none>
I20260709 12:09:31.083474 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:31.083814 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:31.084563 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:31.086339 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-3-root/instance:
uuid: "8481c5f6be5b4faa9fe7c83301759f65"
format_stamp: "Formatted at 2026-07-09 12:09:31 on dist-test-slave-90bm"
I20260709 12:09:31.093683 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:09:31.098495 26302 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:31.099637 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:31.100025 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-3-root
uuid: "8481c5f6be5b4faa9fe7c83301759f65"
format_stamp: "Formatted at 2026-07-09 12:09:31 on dist-test-slave-90bm"
I20260709 12:09:31.100394 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:31.117955 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:31.120028 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:31.122220 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:31.127342 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:31.127655 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:31.127933 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:31.128088 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:31.229096 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.132:39515
I20260709 12:09:31.229239 26364 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.132:39515 every 8 connection(s)
I20260709 12:09:31.237128 24442 auto_leader_rebalancer-test.cc:439] add a tserver: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:31.255805 26365 heartbeater.cc:344] Connected to a master server at 127.23.222.190:33735
I20260709 12:09:31.256357 26365 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:31.257579 26365 heartbeater.cc:507] Master 127.23.222.190:33735 requested a full tablet report, sending...
I20260709 12:09:31.259896 25517 ts_manager.cc:194] Registered new tserver with Master: 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:31.261363 25517 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48328
I20260709 12:09:31.701368 25615 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:31.710407 25687 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.712329 26298 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.722379 25762 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.727198 26377 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:31.741132 25582 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 830afb4bf9c747ab89c652d34a9aedef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.740620 26298 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.748870 25692 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.762496 25611 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:31.808029 25517 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.828248 25762 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:09:31.840453 25582 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d95d45dfde7e4e1ea3a9df8d3a6c8ede. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.841832 25762 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.842231 25692 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.843250 26371 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.844180 26377 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.869067 26377 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.870121 25764 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.873660 25692 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.895658 25514 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.915678 25692 consensus_queue.cc:237] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:31.925300 25611 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.926857 25764 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.926802 26230 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.928489 26383 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:31.943575 25657 consensus_peers.cc:597] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d430da6a4c644f538698b570759feb1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.956255 26370 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.957461 25764 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.971696 25611 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:31.973740 25687 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:31.984584 25517 catalog_manager.cc:5697] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.999662 25611 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:32.003504 26382 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:32.002902 25764 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:32.010954 25657 consensus_peers.cc:597] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fca1ee2242e042518b1c8986c3bd8955. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:32.012614 26230 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:32.018402 26275 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:32.024675 25611 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:32.029500 25762 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:32.048210 25515 catalog_manager.cc:5697] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.203846 26397 ts_tablet_manager.cc:933] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:32.208775 26397 tablet_copy_client.cc:323] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:09:32.231063 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet 830afb4bf9c747ab89c652d34a9aedef from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:09:32.231680 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet 830afb4bf9c747ab89c652d34a9aedef from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-830afb4bf9c747ab89c652d34a9aedef
I20260709 12:09:32.241914 25629 tablet_copy_source_session.cc:215] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.248749 26397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830afb4bf9c747ab89c652d34a9aedef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.263916 26365 heartbeater.cc:499] Master 127.23.222.190:33735 was elected leader, sending a full tablet report...
I20260709 12:09:32.266471 26397 tablet_copy_client.cc:806] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.267349 26397 tablet_copy_client.cc:670] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.272157 26397 tablet_copy_client.cc:538] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.280961 26397 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:32.304198 26397 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.305119 26397 tablet_bootstrap.cc:492] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:32.305825 26397 ts_tablet_manager.cc:1403] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 12:09:32.308357 26397 raft_consensus.cc:359] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.309067 26397 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:32.309748 26397 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.314445 26397 ts_tablet_manager.cc:1434] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.004s
I20260709 12:09:32.316761 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-830afb4bf9c747ab89c652d34a9aedef received from {username='slave'} at 127.0.0.1:59338
I20260709 12:09:32.317253 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-830afb4bf9c747ab89c652d34a9aedef on tablet 830afb4bf9c747ab89c652d34a9aedef with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:32.403172 26397 ts_tablet_manager.cc:933] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:32.405457 26397 tablet_copy_client.cc:323] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:09:32.407065 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:09:32.407648 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-d95d45dfde7e4e1ea3a9df8d3a6c8ede
I20260709 12:09:32.415985 25629 tablet_copy_source_session.cc:215] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.419481 26397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.422219 26404 ts_tablet_manager.cc:933] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:32.427366 26404 tablet_copy_client.cc:323] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:09:32.445742 26397 tablet_copy_client.cc:806] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.446605 26397 tablet_copy_client.cc:670] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.461431 26397 tablet_copy_client.cc:538] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.464135 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet d430da6a4c644f538698b570759feb1e from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:09:32.464748 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet d430da6a4c644f538698b570759feb1e from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-d430da6a4c644f538698b570759feb1e
I20260709 12:09:32.471604 25704 tablet_copy_source_session.cc:215] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.473976 26397 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:32.476394 26404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d430da6a4c644f538698b570759feb1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.497574 26404 tablet_copy_client.cc:806] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.498373 26404 tablet_copy_client.cc:670] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.504817 26404 tablet_copy_client.cc:538] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.517833 26404 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:32.528352 26397 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.533350 26397 tablet_bootstrap.cc:492] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:32.534241 26397 ts_tablet_manager.cc:1403] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.019s
I20260709 12:09:32.538058 26397 raft_consensus.cc:359] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.541178 26397 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:32.542685 26397 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.546309 26397 ts_tablet_manager.cc:1434] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:32.551540 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-d95d45dfde7e4e1ea3a9df8d3a6c8ede received from {username='slave'} at 127.0.0.1:59338
I20260709 12:09:32.552047 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-d95d45dfde7e4e1ea3a9df8d3a6c8ede on tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:32.560745 26404 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.561867 26404 tablet_bootstrap.cc:492] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:32.562685 26404 ts_tablet_manager.cc:1403] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.009s
I20260709 12:09:32.566018 26404 raft_consensus.cc:359] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.566959 26404 raft_consensus.cc:740] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:32.567696 26404 consensus_queue.cc:260] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.570937 26397 ts_tablet_manager.cc:933] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:32.571312 26404 ts_tablet_manager.cc:1434] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:32.573108 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-d430da6a4c644f538698b570759feb1e received from {username='slave'} at 127.0.0.1:51490
I20260709 12:09:32.573568 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-d430da6a4c644f538698b570759feb1e on tablet d430da6a4c644f538698b570759feb1e with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:32.579409 26397 tablet_copy_client.cc:323] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:09:32.582104 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet fca1ee2242e042518b1c8986c3bd8955 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:09:32.582758 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet fca1ee2242e042518b1c8986c3bd8955 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-fca1ee2242e042518b1c8986c3bd8955
I20260709 12:09:32.591501 25704 tablet_copy_source_session.cc:215] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:32.595182 26397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca1ee2242e042518b1c8986c3bd8955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:32.617018 26397 tablet_copy_client.cc:806] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:32.618752 26397 tablet_copy_client.cc:670] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:32.623668 26340 raft_consensus.cc:1217] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.627184 26397 tablet_copy_client.cc:538] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:32.642652 26397 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:32.668576 26397 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:32.669822 26397 tablet_bootstrap.cc:492] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:32.670773 26397 ts_tablet_manager.cc:1403] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.000s
I20260709 12:09:32.673727 26397 raft_consensus.cc:359] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.674600 26397 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:32.675197 26397 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:32.677254 26397 ts_tablet_manager.cc:1434] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:32.679162 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-fca1ee2242e042518b1c8986c3bd8955 received from {username='slave'} at 127.0.0.1:51490
I20260709 12:09:32.679627 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-fca1ee2242e042518b1c8986c3bd8955 on tablet fca1ee2242e042518b1c8986c3bd8955 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:32.786078 26340 raft_consensus.cc:1217] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.951380 26340 raft_consensus.cc:1217] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.006588 26340 raft_consensus.cc:1217] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:33.147387 26411 raft_consensus.cc:1064] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:33.150137 26411 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.159135 26340 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.159782 25762 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.161295 25687 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.161580 26411 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.163955 26371 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.166680 26413 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.180799 26377 raft_consensus.cc:1064] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:33.184134 26377 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.241338 26371 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.249127 26340 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:09:33.262634 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 95790.8us
I20260709 12:09:33.270342 26339 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.273088 26413 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.277824 25762 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.279412 26413 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.299139 25764 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.312283 26411 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.317389 25514 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.320425 25693 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.328946 26414 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.350217 26339 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.366106 25764 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.386399 25693 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.387418 25687 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.398963 26418 raft_consensus.cc:1064] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:33.401875 26418 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.417908 25516 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.439340 25764 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.439630 26339 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.440887 26230 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.441450 25615 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.443840 26419 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:33.447829 26230 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.487525 26275 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.494951 25611 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.500691 25762 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.504369 25615 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.512058 25764 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.513055 26339 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.513698 26414 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.519462 26414 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.528437 26340 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.541795 25514 catalog_manager.cc:5697] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.557523 26377 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.573889 26339 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.581265 25687 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.586972 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 830afb4bf9c747ab89c652d34a9aedef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.588110 25762 raft_consensus.cc:2955] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.603152 25517 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 3 to 4, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.606129 25766 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.608124 26340 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.610661 26419 raft_consensus.cc:1064] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:33.610407 26275 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.615883 26419 consensus_queue.cc:237] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.617735 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 830afb4bf9c747ab89c652d34a9aedef with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39676
I20260709 12:09:33.633383 26370 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:33.648649 26433 tablet_replica.cc:333] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:09:33.671744 25611 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.674651 26275 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.678722 26419 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.677186 26339 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.678452 25764 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.679005 25766 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:33.682706 26433 raft_consensus.cc:2243] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.683559 26433 raft_consensus.cc:2272] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.687011 26433 ts_tablet_manager.cc:1916] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.698227 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fca1ee2242e042518b1c8986c3bd8955 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.699599 25517 catalog_manager.cc:5697] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.701658 26275 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:33.713704 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet fca1ee2242e042518b1c8986c3bd8955 with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53278
I20260709 12:09:33.718945 26230 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:33.721690 26339 raft_consensus.cc:2955] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.727847 26438 tablet_replica.cc:333] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:09:33.742623 26433 ts_tablet_manager.cc:1929] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.743235 26433 log.cc:1199] T 830afb4bf9c747ab89c652d34a9aedef P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/830afb4bf9c747ab89c652d34a9aedef
I20260709 12:09:33.744818 26438 raft_consensus.cc:2243] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.745244 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 830afb4bf9c747ab89c652d34a9aedef (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:09:33.745572 26438 raft_consensus.cc:2272] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.749954 26438 ts_tablet_manager.cc:1916] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.758486 26370 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.760154 25764 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.779253 26438 ts_tablet_manager.cc:1929] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.779781 26438 log.cc:1199] T fca1ee2242e042518b1c8986c3bd8955 P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/fca1ee2242e042518b1c8986c3bd8955
I20260709 12:09:33.783098 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet fca1ee2242e042518b1c8986c3bd8955 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:09:33.787235 25611 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.782073 25612 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.789495 26340 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.806689 26340 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.794212 25514 catalog_manager.cc:5697] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.810426 25693 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.813599 26424 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:33.822443 26414 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.837136 25692 consensus_queue.cc:237] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:33.847074 26424 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.852638 25693 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.856591 26339 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.858878 25766 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.859020 26418 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.860960 26418 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.873764 26418 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.880795 26339 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.881837 25764 raft_consensus.cc:2955] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.897985 25514 catalog_manager.cc:5697] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 3 to 4, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.903771 25515 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 3 to 4, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.911316 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d430da6a4c644f538698b570759feb1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.916805 26340 raft_consensus.cc:2955] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:33.934737 25750 tablet_service.cc:1558] Processing DeleteTablet for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54016
I20260709 12:09:33.939637 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.942250 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet d430da6a4c644f538698b570759feb1e with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53278
I20260709 12:09:33.943295 26438 tablet_replica.cc:333] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:09:33.947116 26442 tablet_replica.cc:333] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:09:33.949244 26442 raft_consensus.cc:2243] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.950160 26442 raft_consensus.cc:2272] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.954735 26442 ts_tablet_manager.cc:1916] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:09:33.972338 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44676.3us
I20260709 12:09:33.975507 26438 raft_consensus.cc:2243] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.976470 26438 raft_consensus.cc:2272] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.981774 26438 ts_tablet_manager.cc:1916] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.988760 26442 ts_tablet_manager.cc:1929] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.989416 26442 log.cc:1199] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/d95d45dfde7e4e1ea3a9df8d3a6c8ede
I20260709 12:09:33.991575 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet d95d45dfde7e4e1ea3a9df8d3a6c8ede (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:09:33.999598 26438 ts_tablet_manager.cc:1929] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:34.000257 26438 log.cc:1199] T d430da6a4c644f538698b570759feb1e P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/d430da6a4c644f538698b570759feb1e
I20260709 12:09:34.001714 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet d430da6a4c644f538698b570759feb1e (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:09:35.043304 25693 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:09:35.053671 25657 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b28e719d6586469e8c186ce7b5af6bc7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.054121 25612 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.054232 25762 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.055956 26419 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.061445 26419 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.074553 26418 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.077986 25612 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.080809 25766 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.100342 25515 catalog_manager.cc:5697] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.125720 25762 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:35.137813 25612 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.141872 25693 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.143539 26369 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.148768 26184 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:35.157589 25731 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39e6df07fdde400cbbefc675d486ab4a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.162885 26184 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.166308 25612 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.166896 25693 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.180703 25611 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:35.186769 25517 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.197670 25693 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:35.198324 25582 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa0600a571a0457f804bf9bf88fd9fd4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.198848 25762 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.200639 26441 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.204110 26377 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.211931 26441 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.213701 25692 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.230726 25762 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:35.234954 25766 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:09:35.254942 25731 consensus_peers.cc:597] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7b82e0d41f14cc2baa1e889ed4c7312. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.255084 25692 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.256654 25515 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.259449 25612 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.259312 26456 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.262531 26456 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.272840 26369 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.277021 25692 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.283818 25612 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.310550 25517 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 2, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:09:35.523012 26465 ts_tablet_manager.cc:933] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:35.524905 26465 tablet_copy_client.cc:323] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:09:35.526760 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet b28e719d6586469e8c186ce7b5af6bc7 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:09:35.527330 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet b28e719d6586469e8c186ce7b5af6bc7 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-b28e719d6586469e8c186ce7b5af6bc7
I20260709 12:09:35.534368 25704 tablet_copy_source_session.cc:215] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.538008 26465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b28e719d6586469e8c186ce7b5af6bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.557534 26465 tablet_copy_client.cc:806] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.558326 26465 tablet_copy_client.cc:670] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.565138 26465 tablet_copy_client.cc:538] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.575273 26465 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
W20260709 12:09:35.671984 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52026.4us
I20260709 12:09:35.942618 26481 ts_tablet_manager.cc:933] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:35.955008 26482 ts_tablet_manager.cc:933] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:35.970017 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69691.8us
I20260709 12:09:35.977743 26485 ts_tablet_manager.cc:933] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:36.008998 26481 tablet_copy_client.cc:323] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:09:36.011159 26465 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.027799 26465 tablet_bootstrap.cc:492] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
W20260709 12:09:36.026607 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 196829us
I20260709 12:09:36.027213 26482 tablet_copy_client.cc:323] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:09:36.028824 26465 ts_tablet_manager.cc:1403] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.454s	user 0.035s	sys 0.009s
W20260709 12:09:36.052723 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 120305us
I20260709 12:09:36.054936 26485 tablet_copy_client.cc:323] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:09:36.086515 26465 raft_consensus.cc:359] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.095765 26465 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:36.098124 26465 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.138942 26465 ts_tablet_manager.cc:1434] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.001s
I20260709 12:09:36.140125 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet fa0600a571a0457f804bf9bf88fd9fd4 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:09:36.140873 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet fa0600a571a0457f804bf9bf88fd9fd4 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-fa0600a571a0457f804bf9bf88fd9fd4
I20260709 12:09:36.145979 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b28e719d6586469e8c186ce7b5af6bc7 received from {username='slave'} at 127.0.0.1:51490
I20260709 12:09:36.146596 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b28e719d6586469e8c186ce7b5af6bc7 on tablet b28e719d6586469e8c186ce7b5af6bc7 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:36.163841 25629 tablet_copy_source_session.cc:215] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.171511 26485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0600a571a0457f804bf9bf88fd9fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.174222 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 39e6df07fdde400cbbefc675d486ab4a from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:09:36.174765 25778 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet b7b82e0d41f14cc2baa1e889ed4c7312 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:09:36.175081 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 39e6df07fdde400cbbefc675d486ab4a from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-39e6df07fdde400cbbefc675d486ab4a
I20260709 12:09:36.177083 25778 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet b7b82e0d41f14cc2baa1e889ed4c7312 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-b7b82e0d41f14cc2baa1e889ed4c7312
I20260709 12:09:36.190917 25778 tablet_copy_source_session.cc:215] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.191776 25777 tablet_copy_source_session.cc:215] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.194983 26482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b82e0d41f14cc2baa1e889ed4c7312. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.196483 26481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e6df07fdde400cbbefc675d486ab4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.212225 26485 tablet_copy_client.cc:806] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.212970 26485 tablet_copy_client.cc:670] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.217618 26485 tablet_copy_client.cc:538] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.229750 26485 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:36.232048 26482 tablet_copy_client.cc:806] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.233153 26481 tablet_copy_client.cc:806] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.233965 26481 tablet_copy_client.cc:670] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.233150 26482 tablet_copy_client.cc:670] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.241075 26481 tablet_copy_client.cc:538] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.244405 26482 tablet_copy_client.cc:538] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.262192 26482 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:36.264521 26481 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:09:36.328099 26485 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.329337 26485 tablet_bootstrap.cc:492] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:36.330199 26485 ts_tablet_manager.cc:1403] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.022s
I20260709 12:09:36.336911 26485 raft_consensus.cc:359] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.337879 26485 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:36.338742 26485 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.404896 26485 ts_tablet_manager.cc:1434] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.012s
I20260709 12:09:36.412338 26482 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.413515 26482 tablet_bootstrap.cc:492] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:36.414355 26482 ts_tablet_manager.cc:1403] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.013s
I20260709 12:09:36.414546 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-fa0600a571a0457f804bf9bf88fd9fd4 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:09:36.415143 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-fa0600a571a0457f804bf9bf88fd9fd4 on tablet fa0600a571a0457f804bf9bf88fd9fd4 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:36.482678 26482 raft_consensus.cc:359] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.483754 26482 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:36.484455 26482 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.487056 26482 ts_tablet_manager.cc:1434] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 12:09:36.489459 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b7b82e0d41f14cc2baa1e889ed4c7312 received from {username='slave'} at 127.0.0.1:41126
I20260709 12:09:36.489934 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b7b82e0d41f14cc2baa1e889ed4c7312 on tablet b7b82e0d41f14cc2baa1e889ed4c7312 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:36.494530 26481 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.497123 26481 tablet_bootstrap.cc:492] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:09:36.498143 26481 ts_tablet_manager.cc:1403] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.234s	user 0.012s	sys 0.019s
I20260709 12:09:36.502743 26481 raft_consensus.cc:359] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.503685 26481 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:09:36.504345 26481 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:36.506791 26481 ts_tablet_manager.cc:1434] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:09:36.511641 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-39e6df07fdde400cbbefc675d486ab4a received from {username='slave'} at 127.0.0.1:41126
I20260709 12:09:36.512110 26339 raft_consensus.cc:1217] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.512148 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-39e6df07fdde400cbbefc675d486ab4a on tablet 39e6df07fdde400cbbefc675d486ab4a with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:36.561035 26339 raft_consensus.cc:1217] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:37.636373 26501 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:37.637331 26501 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:37.644035 26501 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.660256 26441 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:37.661355 26441 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:37.664924 26441 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.667137 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:37.676783 26486 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:37.677614 26486 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:37.680740 26486 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.681767 26486 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:37.682508 26486 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:37.685189 26486 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.687637 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:37.695751 26501 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:37.746480 26501 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:37.750306 26501 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.753787 26500 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.000654 26500 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.003820 26500 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.772501 26441 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.004776 26441 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.007616 26441 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.008237 26441 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.008878 26441 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:37.804395 26504 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.010592 26504 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.012482 26500 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.013056 26504 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.013588 26504 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:37.920579 26503 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.014550 26503 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.017338 26503 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.921557 26498 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.018306 26498 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.021109 26498 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.923928 26499 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.021983 26499 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:38.024938 26499 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.014158 26504 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.028295 26504 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.013108 26500 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.032150 26500 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:37.983841 26502 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:37.978451 26486 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.034647 26486 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.034569 26502 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.036783 26502 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.033792 26441 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.061870 26501 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.062896 26501 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.072929 26441 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.074200 26441 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.077663 26441 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.081219 26504 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.154249 26504 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.157298 26504 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.096166 26506 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.158831 26506 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.162451 26506 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.171463 26501 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.112316 26505 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.146680 26502 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.196156 26502 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.199335 26502 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.147775 26500 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.149542 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.200431 26500 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.201274 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.201958 25692 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.202572 26500 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.202867 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.203472 25692 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.204501 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.036788 26486 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.207605 26505 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.210629 26505 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.245945 26486 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.246793 26486 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.249581 26486 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.250566 26441 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.252767 26502 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.253463 26502 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.255947 26502 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.256680 26504 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.257457 26504 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.260139 26504 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.260677 26504 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.261622 26504 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.263877 26504 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.251281 26441 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.266402 26441 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.266978 26441 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.267550 26441 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.268162 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.269789 26441 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.270488 26506 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.281754 26506 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.284699 26506 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.250216 26486 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.292943 26486 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.295310 26486 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.298977 26515 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.303943 26500 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.314055 26519 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.314239 26499 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.273479 26507 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.280910 26508 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.253468 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.315832 26503 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.315973 26523 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.317226 26499 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.311873 26520 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.326460 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.323877 26507 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:38.341801 26507 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.314677 26500 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.314656 26501 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.314702 26502 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.345993 26514 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.306035 26498 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.351212 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.351893 26441 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.356630 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.335626 26523 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.346028 26516 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.338615 26518 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.364537 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.356128 26505 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.352281 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.315095 26519 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.370422 26507 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.376818 26507 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.377559 26519 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.378999 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.379416 26507 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.380457 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.372103 26524 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.337587 26503 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.382284 25688 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.383379 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.383567 26503 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.384086 26503 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.384615 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.384582 26503 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.385329 25688 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:38.367744 26441 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.356289 26502 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.387532 26441 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.387925 26502 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.361672 26498 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:38.388942 26503 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.390071 25692 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.375327 26512 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.374768 26505 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.370970 26516 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.369880 26506 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.338384 26520 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.389673 26524 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.404832 26498 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.359891 26501 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.411888 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.372889 26486 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.420317 26506 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.307858 26515 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.378132 26519 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.364044 26514 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.430689 26514 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.431770 26486 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.428395 26519 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.412763 26512 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.427603 25686 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.453600 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 809) took 1765 ms. Trace:
I20260709 12:09:38.455147 26506 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.454238 25611 rpcz_store.cc:276] 0709 12:09:36.688101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:38.452306 (+1764205us) service_pool.cc:224] Handling call
0709 12:09:38.452909 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:38.453089 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:38.453117 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:38.453169 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:38.453196 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:38.453250 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:38.453403 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:38.334028 26508 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.493080 26510 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.493703 26510 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.496110 26510 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.501006 26505 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.502406 26507 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.503042 26507 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.503427 26506 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.503998 26506 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.505246 26507 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.505776 26507 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.506408 26504 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.506234 26507 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:38.506910 26504 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.509130 26504 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.509656 26504 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.508940 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:38.506036 26506 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.491109 26500 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.518083 26507 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.459856 26509 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.541082 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 808) took 1824 ms. Trace:
I20260709 12:09:38.531373 26528 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.461519 26514 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.421521 26518 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:38.537464 26506 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.532387 26519 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.541535 25615 rpcz_store.cc:276] 0709 12:09:36.687779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:38.510691 (+1822912us) service_pool.cc:224] Handling call
0709 12:09:38.511131 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:38.511351 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:38.511393 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:38.511455 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:38.511500 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:38.511572 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:38.511729 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:38.519416 26512 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.551126 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:38.550992 26505 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.534723 26510 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.571478 26523 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.543694 26507 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.577536 26520 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.577906 26505 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.576959 26510 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.582005 26505 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.510141 26504 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.583765 26537 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.596390 26529 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.580610 26528 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.594714 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:38.603909 26522 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.575822 26506 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.575598 26514 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.597566 26504 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.595221 26512 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.541424 26509 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:38.615782 26520 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.597000 26529 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.588392 26507 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.604907 26522 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.617076 26508 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.619277 26505 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.621212 26511 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.620532 26504 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.621591 26512 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.698091 26515 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.707010 26508 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:38.724032 26527 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.696889 26498 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.685530 26520 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.734663 26513 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.735296 26513 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.725864 26531 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.787415 26538 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.788297 26538 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:38.734035 26515 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.721424 26504 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.745875 26498 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.798563 26526 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.607873 26537 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.728729 26508 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.736178 26532 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.803541 26534 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.799178 26526 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.730368 26511 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.810623 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 390) took 1302 ms. Trace:
I20260709 12:09:38.811033 25689 rpcz_store.cc:276] 0709 12:09:37.508129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:38.809603 (+1301474us) service_pool.cc:224] Handling call
0709 12:09:38.809943 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:38.810124 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:38.810155 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:38.810200 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:38.810229 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:38.810305 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:38.810435 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:38.797163 26515 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.806239 26508 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:38.837977 26526 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.724812 26505 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.821027 26498 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.822417 26532 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:38.851737 26507 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.852792 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:38.855039 25766 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.832649 26533 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:38.837322 26534 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:38.795308 26527 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.850014 26506 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.858309 26528 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.804338 26531 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.871662 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.867904 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.872936 26504 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.855888 26535 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.878050 25611 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:38.847306 26540 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.878901 26514 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.898985 26505 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.870656 26512 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.882469 26529 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.887507 26522 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.906111 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.883913 26538 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:38.870223 26533 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:38.886973 26518 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:38.890610 26520 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.883678 26535 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.909547 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.914177 25611 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:38.910467 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.891113 26537 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.918176 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:38.911052 26521 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.927788 25766 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:38.911646 26509 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.922601 25614 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:38.909333 26533 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:38.937314 26543 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.911477 26540 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.942721 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:38.944584 25767 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.940382 26543 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.946069 26441 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.951077 26441 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.935017 26535 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.955850 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:38.956701 25767 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.956758 26339 raft_consensus.cc:1217] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.935611 26511 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.934917 26512 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.955755 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:38.941205 26522 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:38.960801 25763 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:38.960976 26522 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.940781 26509 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.962435 26509 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.963861 26522 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.940171 26527 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:38.967286 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.948228 26521 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.955801 26544 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.952950 26505 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.985850 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.967780 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:38.966524 26512 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:38.965092 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:38.988096 26527 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:39.023195 26499 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.023241 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.023587 26527 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.025619 26540 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.015480 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.034798 26441 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.034832 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.035038 25618 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.036006 26534 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:38.998448 26531 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.025633 26505 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.052838 25610 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.053033 26548 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:39.057191 26515 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.000718 26509 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.055218 26532 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.013208 26543 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.057143 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.015902 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.056341 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.007114 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.050849 25760 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.065735 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.065735 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.066764 26513 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.066789 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.057274 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.062615 26547 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:38.991137 26544 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.067847 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.076025 25618 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.066787 25767 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.075872 25764 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.067821 26505 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.081739 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.078512 25617 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.084448 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.084785 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.085695 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.099713 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.101258 25764 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.090282 26543 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.090408 26512 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.085911 26515 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.057744 26548 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:39.078451 26513 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:39.085521 25760 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.216401 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.217160 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.219802 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.213347 26486 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.222718 26499 raft_consensus.cc:1064] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:39.223017 26544 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.195238 26516 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.198379 26501 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.218182 26527 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.226228 26499 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:39.227658 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.131923 26543 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.140115 26336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:39.232077 26543 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.232795 26533 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.232720 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 391) took 1723 ms. Trace:
I20260709 12:09:39.234095 25614 raft_consensus.cc:2393] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:39.235118 26533 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.235822 26337 raft_consensus.cc:1217] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.148775 26522 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:39.233781 25693 rpcz_store.cc:276] 0709 12:09:37.508898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:38.388348 (+879450us) service_pool.cc:224] Handling call
0709 12:09:38.388631 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:38.405484 (+ 16853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:38.405517 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:38.405566 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:38.405599 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:39.232342 (+826743us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54003b9554. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:39.232388 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:39.232508 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27193600}
I20260709 12:09:39.107712 26531 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.131775 26521 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.159763 26510 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.241667 26522 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.242317 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.156376 26540 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.163805 26535 raft_consensus.cc:1064] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:39.087625 26547 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.242604 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.245664 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.104135 25763 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.246999 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.249245 25766 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.237504 26515 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:39.271112 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.251793 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.272300 25618 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.251335 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.252166 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.244277 26522 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.275148 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.271124 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.288544 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 395) took 1763 ms. Trace:
I20260709 12:09:39.289407 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.276551 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.290144 25614 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.291149 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:39.291356 25583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.025s	sys 0.040s
I20260709 12:09:39.291785 25614 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.292459 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.292940 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.254904 26540 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.293534 25614 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.295356 26540 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.252516 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.296087 25619 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.295857 26535 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:39.297001 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.297685 26497 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.299161 25658 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.300200 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.300518 26529 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.300981 26529 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.301328 26529 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.301441 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.302284 26518 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.302457 26516 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.302716 26518 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.302963 26516 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.303205 26518 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.303417 26516 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:39.291761 25583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.025s	sys 0.040s
W20260709 12:09:39.304072 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 681315us
I20260709 12:09:39.298086 26497 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.305339 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.305548 26497 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.306134 26501 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.306535 26501 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.306915 26501 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.308446 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.300244 25619 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.244531 26531 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.278616 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.280452 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.316782 25611 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.280783 26522 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.281297 26543 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.282845 26524 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.283540 26525 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.237877 26513 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:39.287123 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.288111 26547 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.309034 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.273309 25617 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.272650 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.321404 26530 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.254158 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.331625 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.237365 26508 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.332783 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.351481 25658 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.340969 25764 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:39.343411 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.344913 25618 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.318347 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.289007 25694 rpcz_store.cc:276] 0709 12:09:37.524516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:38.384890 (+860374us) service_pool.cc:224] Handling call
0709 12:09:38.385229 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:38.431402 (+ 46173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:38.431437 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:38.431490 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:38.431524 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:39.288179 (+856655us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54003b9054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:39.288225 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:39.288346 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105693952}
I20260709 12:09:39.352746 25766 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.358727 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.363308 25612 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:39.360129 26544 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:39.364185 26544 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.348416 26530 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.365619 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.370249 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.351836 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.366626 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.338932 26522 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.343078 26543 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.357646 26524 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.357594 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.370477 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.380261 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.356527 25610 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.347000 26525 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.364578 26544 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:39.369735 26530 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.387750 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.400466 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.402659 26515 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:39.393339 26546 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.403913 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.404203 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.405337 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.405910 26525 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.379004 26524 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.408134 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.406520 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.378157 26548 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.404258 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.386926 26533 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.423588 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.426285 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.407694 26542 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.433746 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.446807 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.405349 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.403963 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.403942 26546 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.456797 26337 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.457621 26336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:39.503561 26546 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:39.458177 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd0a0 after lost signal to thread 24445
I20260709 12:09:39.458806 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.416433 26524 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.479682 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.456797 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.499823 26531 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.501149 26508 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.451633 26542 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.434427 26533 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:09:39.513978 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd780 after lost signal to thread 25551
I20260709 12:09:39.514756 26547 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.515769 26543 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.522701 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.535631 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.535988 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.544173 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.545953 25768 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
W20260709 12:09:39.548153 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 196742us
I20260709 12:09:39.534536 26542 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.552606 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.540395 26533 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.554562 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.574724 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.588804 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.562172 26522 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:39.607995 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:39.612195 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 57764.4us
I20260709 12:09:39.573832 26518 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.590739 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.621639 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.623423 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.614522 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.621701 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.636417 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.630641 26548 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.637199 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.638983 26303 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.640028 26548 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.640411 26548 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.640785 26548 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.642495 25692 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:39.627434 26361 debug-util.cc:398] Leaking SignalData structure 0x7b0800312de0 after lost signal to thread 25643
I20260709 12:09:39.647614 26497 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.648847 25694 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.619037 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.651918 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.653650 25766 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.658896 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.660348 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.655058 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:39.660338 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.664440 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.665231 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:39.656776 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:39.665601 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.666483 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.666864 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.667718 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.654023 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.665275 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.667791 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.673638 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.674314 25766 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.675040 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.675957 26554 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.676318 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.676504 26554 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.675856 26501 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.676942 26554 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.677620 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.677615 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.650189 26513 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:39.653863 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.687104 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.655882 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.636618 26530 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.692281 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.695089 25766 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.662976 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:39.698452 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.662989 26497 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.690171 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.699927 25764 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.700831 25766 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:39.701493 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.713207 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:39.699211 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd740 after lost signal to thread 25718
I20260709 12:09:39.703477 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.703425 26513 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:39.717382 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.702172 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.706791 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.707042 25613 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.706909 25658 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.708022 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.710729 26518 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.711414 25614 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.714437 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.715206 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.741902 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.745683 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.746901 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.747685 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.744640 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.748239 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.748881 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.749291 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.749815 25762 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.744246 25658 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.751065 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.742748 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.751860 26505 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.752138 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.752293 26505 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.752688 26505 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.717423 25618 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.753242 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:39.754078 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.750102 25761 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.705811 25760 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:39.754571 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.766898 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.766079 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.769537 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.712637 26544 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.771028 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.742242 25763 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:39.754235 26499 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.759281 26486 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.759361 26508 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.764457 26497 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.774230 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.777899 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.776953 26533 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.776721 26486 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.783066 26486 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.783111 25617 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.783531 26533 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.769634 26518 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.768234 26441 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:39.774204 26361 debug-util.cc:398] Leaking SignalData structure 0x7b080021ea00 after lost signal to thread 25792
I20260709 12:09:39.787675 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.785763 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.799763 25611 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:39.802773 25582 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.775645 26512 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.775869 26499 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.810660 26499 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.811381 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.816182 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.816980 25687 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
W20260709 12:09:39.818555 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2c60 after lost signal to thread 26364
I20260709 12:09:39.780146 26508 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.785176 26497 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.826382 26497 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.787640 26501 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.821858 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:39.786429 26556 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.831909 26524 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.787989 26441 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.836191 26441 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.825031 25582 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.786867 26518 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.832381 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.838227 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.840194 26549 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.840394 26557 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.840813 26557 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.841238 26557 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:39.838920 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58721.4us
I20260709 12:09:39.843768 25658 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.828446 26508 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.844563 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.827222 26509 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.846495 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.848029 26533 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.848430 26533 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.848796 26533 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.843319 25690 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.851310 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.851640 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.852527 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.833634 26548 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:39.842849 26546 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.854101 25610 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.855195 26546 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.855330 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.852866 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.853654 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.862450 25687 raft_consensus.cc:1240] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.861451 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.842547 26518 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.860100 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.867682 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.859437 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.872366 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.873719 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.873756 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.875294 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.858371 26501 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.873816 25658 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:39.877563 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.836947 26556 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.858461 26509 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.885720 26562 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:39.886596 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.887270 25692 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:39.888461 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.844915 26560 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.889729 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.865450 26558 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.892225 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.894912 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.880280 26530 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.895978 26525 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.896311 26548 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.896881 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.884559 26556 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.897416 26515 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.897491 26337 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.876230 26549 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.912163 26544 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:39.913969 26516 consensus_meta.cc:287] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.006s
I20260709 12:09:39.914426 26516 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.916312 25693 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:39.916761 26516 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.880147 26513 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.880386 26540 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.920650 26524 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.882972 26511 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.880298 26501 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.948235 26441 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:39.924002 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:39.884559 26509 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:39.939595 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:39.913995 26535 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:39.952042 26441 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:39.893205 26522 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:39.894445 26560 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:39.953033 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 77776.8us
I20260709 12:09:39.973681 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:39.974735 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.896348 26530 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.960029 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:39.898378 26558 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:39.981082 26441 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:39.982861 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59217.9us
I20260709 12:09:39.982998 26441 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.983705 26441 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.984012 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.886210 26562 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.938591 26555 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.950408 26501 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.961944 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:39.951908 26535 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:40.002844 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.937405 26505 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.006758 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:39.997754 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 133450us
I20260709 12:09:40.008888 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:39.984817 26544 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:39.981134 26530 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:39.951640 25694 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:39.980818 26560 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:39.924615 26542 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:39.988437 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:40.000543 26529 consensus_meta.cc:287] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.699s	user 0.015s	sys 0.006s
I20260709 12:09:40.015939 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:39.984915 26558 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.032169 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:39.997851 26562 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:40.034072 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:40.035033 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.020282 25768 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.997850 26555 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:40.010583 26531 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.065981 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.017757 26543 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.015314 26544 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.017118 26530 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.043109 26515 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.043948 26555 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.015087 26565 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.091969 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.063642 26540 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:40.017642 26486 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.111819 26441 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.093156 26544 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:40.114683 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 101272us
I20260709 12:09:40.039090 26529 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.118242 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:40.121651 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 145899us
I20260709 12:09:40.124755 26558 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.127861 26558 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.128739 26558 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.129478 26558 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:40.130100 26558 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.104820 25688 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.163071 25689 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.166980 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.173457 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.175040 25615 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:40.188623 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65113us
I20260709 12:09:40.115324 26554 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.190454 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.194708 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.193890 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.200515 26441 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.201094 25618 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:40.200335 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.204217 25692 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:40.207163 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.210780 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.224810 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.225409 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.226704 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.227342 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.227973 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.205386 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.229068 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.230289 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.231196 25692 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:40.231952 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.233162 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.202232 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:40.241403 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.251952 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.256232 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.259500 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.261480 25583 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.262285 26547 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.267211 26441 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.194375 26558 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.203039 26505 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.276014 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.232049 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.217383 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.294245 26441 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.286664 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.206558 26557 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.281447 26533 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.309227 26486 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.310324 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.320218 26558 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.320628 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.321810 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.322374 26557 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.323010 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.311645 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.324601 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.325999 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.312692 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.312615 26497 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:40.314558 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.352013 26497 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:40.354326 26535 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.355923 26535 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:40.315377 26499 consensus_meta.cc:287] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.005s
I20260709 12:09:40.315461 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.358623 26499 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.359859 26518 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.361018 26499 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.318548 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.318755 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:40.363159 26508 consensus_meta.cc:287] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 12:09:40.319260 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.363662 26508 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.364853 25617 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.365675 26508 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.319428 26529 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.320375 26556 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.310514 26533 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.308491 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:40.367540 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59124.4us
I20260709 12:09:40.368153 26556 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.369663 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.335667 26542 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.336243 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.337554 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.370872 26501 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.338850 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:40.373389 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.375626 26441 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.340529 26555 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.293654 26560 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.378333 25616 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.322067 26554 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.374796 26508 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.374061 26533 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.379493 26560 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.362010 26518 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.395838 26501 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.398388 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:40.407544 25657 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.543s (SENT) [suppressed 4 similar messages]
W20260709 12:09:40.489008 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 423099us
I20260709 12:09:40.436295 26555 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.437757 26509 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.451752 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.498442 25611 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.498909 26509 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.327927 26562 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.501111 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.501374 25617 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:40.502334 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.502601 26562 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.502856 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.455384 25615 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.503913 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.433941 25614 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.505053 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.505573 25617 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:40.462963 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 272985us
I20260709 12:09:40.358096 26544 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:40.506685 25582 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:40.507439 26562 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.507805 26562 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.507990 26544 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.508975 26562 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.472697 25618 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.474182 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.510308 25618 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.510754 25616 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:40.485592 26578 raft_consensus.cc:1064] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
W20260709 12:09:40.488813 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 64398.3us
I20260709 12:09:40.516531 26542 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.516999 25617 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:40.518447 26564 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.509217 25610 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.518855 26564 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.519797 26564 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.435299 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.521018 26564 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.521267 25687 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:40.489291 26530 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.523455 25618 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.467399 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.526445 26501 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.527379 26577 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.527559 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.527942 26501 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.528391 26501 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.528508 26577 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.528918 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.529502 26577 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.529824 26531 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.529322 26501 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.492729 25613 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.503993 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.494418 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.530666 26543 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.530229 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.543097 26518 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.544267 26543 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.531616 26501 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.535676 26530 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.545094 26518 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.537741 26555 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:09:40.529843 26577 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:40.548439 26518 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.539089 26554 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:40.551332 26554 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.551688 26554 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.551734 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.552726 26554 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.539983 26562 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.554559 26554 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.555858 26562 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.530526 26531 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.535588 26578 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:40.556897 26531 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:40.549117 26555 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.557804 26531 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.558573 26555 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.559110 26531 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.559474 26555 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.560813 26555 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.544260 26556 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.562708 26556 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.563522 26556 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.564752 26556 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:40.532356 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 124878us
I20260709 12:09:40.542047 26542 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:09:40.550601 26518 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.581080 26518 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.583204 26518 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.584959 26542 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:40.585457 26542 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.572690 26577 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:40.586495 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:40.587074 26577 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.587332 26542 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.587805 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:40.531260 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.589267 26562 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.589177 26499 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:40.590240 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59054us
I20260709 12:09:40.590517 26497 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.590879 26497 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.591075 25582 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.591794 26562 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.591647 26497 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.593019 25582 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.590299 26499 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:40.594667 26499 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.593856 26562 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.594985 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.595731 26530 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.595189 26562 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.596043 26530 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.596187 26562 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.596454 26530 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:40.597945 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46400us
I20260709 12:09:40.599267 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.600296 26549 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.600456 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.598096 26543 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.603893 26558 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.605813 26501 consensus_queue.cc:1059] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.605327 26558 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.606752 26558 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.606920 26501 raft_consensus.cc:3055] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.607302 26501 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.607563 26558 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.608825 26558 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.608244 26501 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:40.610162 26501 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.610620 26497 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.615689 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.616567 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.617129 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.618521 26543 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.603015 26561 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:40.619311 26544 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.619946 26542 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:40.622464 26549 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.623430 26549 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:40.623795 26549 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.626194 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.627425 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.628484 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.629655 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.630565 26509 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.631078 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.637132 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.631362 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:40.638583 26540 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.638594 26576 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.594995 26499 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.641039 26499 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.638616 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:40.643055 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.635456 26561 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.644120 26543 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.645961 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.644976 26561 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.635830 26546 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:40.649324 26546 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.643280 25612 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:40.649958 26546 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:40.646802 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.651166 26516 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.651543 26516 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:40.651875 26544 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.651921 26516 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.637471 26535 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.656772 25657 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.635968 26560 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.630867 26556 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.660048 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.660991 25582 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:40.642426 26499 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.602995 26555 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:09:40.667387 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.658028 26535 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.669205 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.664052 26560 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.677207 26560 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.670630 26575 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:40.670675 26533 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.661270 26576 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.668721 26544 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.686936 26544 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.688212 26544 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.669747 26578 consensus_queue.cc:1059] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.672665 26553 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.672906 25582 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:40.673616 26337 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.691591 26509 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.691992 26509 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.692348 26509 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.666383 26530 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.680300 26533 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.681311 26535 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.698446 26578 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.698936 26535 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:40.699337 26535 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.699975 26530 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.681502 26576 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.702548 26576 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.684056 26562 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.692175 26575 raft_consensus.cc:3055] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.695675 26560 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.693388 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.697089 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:40.698402 26533 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.714186 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.716260 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:40.708359 26575 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:40.717144 26524 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.723429 25657 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.715319 26578 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.725973 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.731580 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.715261 26530 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:40.732640 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.727562 26513 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.735991 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.737443 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.738134 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.738867 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.740304 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.740592 26575 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.743372 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.727685 26524 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.749866 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.742929 26555 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.745535 26558 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.742393 26575 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.735128 26530 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.742667 26543 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:09:40.744057 26529 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.745826 26513 consensus_queue.cc:1059] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:40.770383 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.764207 26530 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:40.775008 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:40.776981 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.768779 26540 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:40.779973 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.779842 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.783115 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.803828 26522 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.804365 26522 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:40.805352 26522 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.781592 26540 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:40.829157 25618 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.818964 26565 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.789142 26497 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.836685 26522 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.837284 25619 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:40.831969 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47914us
I20260709 12:09:40.833237 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.780328 26533 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.835626 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.839120 25615 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.839339 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:40.832937 26540 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.848280 25618 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.833832 26565 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:40.855804 26583 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.856698 26583 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:40.857286 26583 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:40.858582 25612 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.861506 26583 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.848169 25613 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:40.862316 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 79312.4us
I20260709 12:09:40.864910 26560 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.846966 26568 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:09:40.866791 26533 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.856583 26565 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.866173 26544 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.870694 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.863373 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.874017 25759 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.836727 26531 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:40.840174 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.890115 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.890802 25764 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:40.885792 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:40.894027 25687 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:40.895354 26568 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.882797 26553 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.846786 26578 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:09:40.844790 26511 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:40.886459 26554 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.898363 26531 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.901921 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.899667 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:40.902532 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.903414 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.916883 26531 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:40.905922 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.906788 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.909407 26508 raft_consensus.cc:1064] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:09:40.909597 26565 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.909752 26515 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:40.894411 25760 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:40.912919 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:40.913939 26581 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:09:40.906041 26524 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.931854 26304 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:40.932924 26583 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.932974 26524 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.916927 25768 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.908674 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.842854 26535 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.878006 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:40.927505 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:40.928205 25764 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:40.928104 26515 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.855479 26576 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.843482 26562 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.794654 26516 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.907661 26540 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.952031 26535 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:40.920696 26556 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.952751 26556 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.953657 26556 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.955185 26544 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.955849 26556 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.929157 26546 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.957567 25765 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.944912 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:40.942085 26576 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.942057 26515 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:40.952164 26540 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:40.868381 26509 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.963141 26509 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.963402 26529 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.945935 26554 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:40.969498 25768 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:40.970943 26508 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:40.978813 25613 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:40.981735 26568 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:40.983137 26556 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:40.983549 26556 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:40.984570 26556 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.983706 25759 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:40.986023 26556 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:40.988075 25760 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:40.990607 26546 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.995378 26530 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:40.997785 26530 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:40.843860 26549 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.039812 25619 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.040931 26549 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:41.042910 26556 consensus_queue.cc:1059] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:41.044503 26556 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.044935 26556 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:41.046906 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 169065us
I20260709 12:09:41.048624 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.046548 26556 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.054358 26556 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:41.056937 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 215509us
I20260709 12:09:41.058398 26578 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.060545 26585 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.060667 26568 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.060947 26585 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.060858 26578 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.062178 26549 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:41.062660 26549 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.061995 26585 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.063832 26585 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.064886 26583 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.065420 25619 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.066972 26578 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.068184 26577 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.068536 26577 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.067176 26561 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:41.069340 26577 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.070384 26561 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.025612 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:41.070781 26561 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.070896 26577 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.026686 26516 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:41.017601 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:41.072942 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:41.073961 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.075158 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.075295 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.076614 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.078697 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:41.079641 25767 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:41.080900 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.081081 26531 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:41.080935 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.081732 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.071846 26561 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.082908 26540 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.082996 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.083233 26516 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.083369 26540 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.083679 26561 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.085172 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.086320 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.084079 26530 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:41.084142 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.064752 26549 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.090802 26540 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.096596 26540 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.092177 26516 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.090337 26530 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.098752 26556 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.099529 26530 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.102811 26549 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:41.093143 26565 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:09:41.104610 25582 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:41.104950 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.105753 26562 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.090767 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 2, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.106300 26562 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.107239 26562 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.111501 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:41.112411 26546 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.114809 26578 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.116032 26578 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.116559 26337 raft_consensus.cc:1240] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.115348 26577 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.117892 26499 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.118847 26578 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.120002 26578 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.122668 26522 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.123653 26533 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.123835 26531 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.124992 26531 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.125344 26509 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.125735 26509 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.126144 26546 raft_consensus.cc:697] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.125893 26531 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.126623 26509 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.127190 26546 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:41.128039 26509 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.129491 26531 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.135670 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.137696 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.138314 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.140228 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:41.141485 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 142472us
I20260709 12:09:41.144433 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:41.145053 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.146181 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.149204 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.150871 26544 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.151697 26441 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.157083 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.158744 26544 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.159852 26544 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.160768 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.162786 26560 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.163409 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.163825 26533 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.164252 26533 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.164390 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.165262 26533 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.165737 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.166721 26533 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.172835 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.173084 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.173907 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.175360 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.175946 25767 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:41.175760 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.177086 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.177505 25764 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:41.181389 25613 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.185681 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.186515 25583 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.196247 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.201536 26303 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.203060 26576 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.201403 26578 consensus_queue.cc:1059] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.196199 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:41.212374 25693 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.212841 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.213614 25615 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:41.214248 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:41.214676 25689 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.217031 25619 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.219516 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:41.190725 26499 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:09:41.221849 25768 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:41.222649 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.222930 25688 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.224301 25686 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.225497 25763 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.225788 25690 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.226933 25694 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.229568 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.232751 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.235658 25619 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.212116 26578 raft_consensus.cc:3055] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.266561 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.267527 26578 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.236128 25583 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.268694 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.211079 26583 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.270340 25692 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.270852 26560 consensus_queue.cc:1059] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:41.273293 26578 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:41.274371 26562 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.263628 26518 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:09:41.279326 26518 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.279376 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:41.279815 26518 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.280741 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.280941 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.282146 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.283557 25688 raft_consensus.cc:2410] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:41.282670 25613 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.283730 25685 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.284552 25614 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:41.285060 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.272821 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.285557 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.297482 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.271309 26565 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:41.300231 26565 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.303993 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.308115 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:41.309984 25611 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:41.311991 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.291661 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.314996 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.312613 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:41.314718 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.280798 26518 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.295925 26556 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:09:41.293747 26499 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:09:41.394366 25517 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 3, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.405776 25612 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
W20260709 12:09:41.405841 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 93986.2us
I20260709 12:09:41.307945 26529 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:09:41.409000 25693 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.411193 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.407609 25692 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:41.411624 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:41.426644 25759 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.426770 26562 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.427369 26337 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:41.428046 25583 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.429236 25583 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.424532 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.430435 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.430549 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.431310 25613 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:41.432041 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.433187 26530 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.433975 26522 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.434571 26522 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.434887 26556 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.435001 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.435528 26556 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.435925 26562 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.435631 26522 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.436584 26556 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.437899 26556 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.401585 26509 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:41.443105 26441 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:41.406368 26546 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.457463 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.424767 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.406805 26549 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.444357 25583 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.464682 26441 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:41.464850 25687 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.401566 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:41.472941 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:41.473737 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.473945 25687 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.475574 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.476678 26441 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.469141 25692 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.482247 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.467469 26518 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.500720 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.470355 26565 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:41.471058 26530 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.471589 26513 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:41.469455 26583 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:41.506721 25693 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.515792 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.516230 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.477530 26585 consensus_queue.cc:1059] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:09:41.477169 25686 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:41.516825 25689 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.523157 26441 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.522506 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.514230 25692 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.521046 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.521678 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.469820 26540 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:09:41.502315 26509 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.525467 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.525672 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:41.524490 26585 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:41.544009 26441 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.556107 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.516701 26533 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.557466 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.545979 25692 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:41.571863 26441 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.574898 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:41.573969 26602 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.518230 25613 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:41.508163 26499 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.523708 26513 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.501006 26531 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:09:41.518951 26565 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:41.577123 26441 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.519640 26535 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:09:41.579487 25583 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.580884 26599 raft_consensus.cc:3055] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.551316 25762 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:41.582544 26549 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:09:41.583298 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.593128 26599 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.525650 26583 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:41.597422 25583 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.589730 25691 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:41.610085 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 152758us
I20260709 12:09:41.610476 26441 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.611088 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.612902 26441 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.549381 25693 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.570647 26585 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.594435 26509 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.616209 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.596304 26508 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.611295 26599 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:41.629952 26594 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 12:09:41.628182 25694 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.633219 26509 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.613963 26499 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.594090 26565 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.636133 26600 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.634738 26509 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.639992 26568 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.643224 26568 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:41.643646 26587 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.412s	user 0.003s	sys 0.000s
I20260709 12:09:41.644138 26568 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.646987 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.648654 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.650573 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.652190 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.622059 26513 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:41.656713 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.640720 26585 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:41.658736 26549 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.655898 26501 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.653367 26499 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:41.664179 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.668044 26583 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:41.674487 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:41.648058 26568 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.679167 25687 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.681581 26606 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.689822 26606 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.690923 26606 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.692231 26606 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.647686 25761 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:41.695173 26576 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.695737 26576 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.696138 26565 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:41.695705 25688 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.696839 26576 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.654663 26600 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.666064 26556 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:41.704962 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:41.682960 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 204407us
W20260709 12:09:41.719064 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.719293 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.705896 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.683157 26553 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.734542 26556 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:41.737170 26589 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.459s	user 0.005s	sys 0.000s
I20260709 12:09:41.737779 25685 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.725610 26576 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.721688 26577 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.721838 26501 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:09:41.749109 26501 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:41.749529 26501 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.750528 26501 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.756186 26604 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.756291 26602 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.756754 26604 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.757618 25690 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:41.790020 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:41.799257 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.800812 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.801813 25611 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:41.743671 25760 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:41.819119 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.820292 25614 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:41.798841 26540 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:09:41.824216 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.822067 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.828205 25613 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:41.828303 26337 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 LEARNER]: Advancing to term 2
I20260709 12:09:41.794513 26577 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.757719 26604 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:41.840394 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 107380us
I20260709 12:09:41.838153 26513 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.841718 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.849669 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.851863 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:41.855062 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.858938 26554 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.859499 26554 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.860591 26554 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.854400 26600 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.852877 26518 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.848968 26516 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.870525 26533 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:41.843902 26513 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.880450 26556 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:41.881138 26556 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:41.862052 26554 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.887176 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.890597 26518 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.892071 26518 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.893220 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:41.896171 26577 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:41.896875 26577 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.898164 26561 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:41.899027 26561 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.899134 26522 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.899585 26522 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:41.900573 26522 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.900051 26561 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.902696 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:41.904253 25613 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:41.907305 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:41.909860 26599 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.910411 26585 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:41.911298 26585 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:41.911991 26585 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:41.918124 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:41.919632 26583 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:41.920040 26604 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:41.923199 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.924594 25759 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:41.928966 26522 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.882695 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:41.935082 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52262.6us
I20260709 12:09:41.936504 25583 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:41.937302 26441 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.937762 26441 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.939884 25583 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:41.938655 26553 consensus_queue.cc:1059] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:09:41.941062 26562 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.941675 26562 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:41.937384 26524 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:41.942060 26612 raft_consensus.cc:3055] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:41.942409 26524 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.942550 26612 raft_consensus.cc:740] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:41.942690 26562 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.943395 26524 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.881433 26513 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:41.884784 25763 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:41.886159 26556 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:41.943537 26612 consensus_queue.cc:260] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:41.948561 26501 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:41.938988 26441 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:41.950090 26513 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.963825 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:41.881928 26337 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:41.934476 26578 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.934042 26561 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:41.970850 25613 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:41.971068 25763 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:41.977443 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:41.977820 25614 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:41.968585 26509 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:09:41.972046 26530 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:09:41.951260 26339 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:41.972561 26540 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:41.987262 26540 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:41.987705 26540 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:41.891948 26336 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:41.988503 26612 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:41.996059 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:41.998855 26565 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.999130 26577 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:41.972818 26535 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:09:42.001108 25613 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.001472 26535 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:42.009145 26509 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:09:42.001827 26535 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:42.025669 26556 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:42.028401 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:42.031575 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.032516 25687 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:42.035874 25693 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.021696 26529 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:09:42.009347 26530 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:09:42.026324 26556 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:42.049309 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.067936 25514 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.093343 25514 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.068322 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.098677 25514 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:42.101189 25691 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:42.090544 25688 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:42.055389 25689 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:42.069018 26535 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:42.053872 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 88597.6us
I20260709 12:09:42.125336 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.126081 25687 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:42.143442 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.143359 26513 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.155512 26513 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.145195 25694 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:42.169570 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.158933 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.187845 26513 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.192250 26535 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.165751 26556 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:42.197177 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:42.203635 25693 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.206524 25583 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:42.190868 26585 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.211872 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:42.213757 26441 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:42.215269 25583 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:42.214228 26441 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:42.205499 26508 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.213483 26533 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:42.220021 26604 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.226122 25690 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:42.222904 26576 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:42.224234 26560 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:42.222153 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.235203 26508 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.239672 26597 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:42.246989 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:42.243433 26585 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.238806 26441 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.251021 25515 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:42.253505 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:42.252753 25762 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:42.256975 25685 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:42.247161 26599 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.249389 25761 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:42.253455 26605 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.051s	user 0.004s	sys 0.000s
I20260709 12:09:42.274478 26599 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.255959 25610 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.251055 26576 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:42.277535 25767 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.256067 26606 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:42.262719 26597 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.261490 25694 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:09:42.244264 26604 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.312565 25617 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.327299 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:42.333995 25657 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:42.308027 25694 pending_rounds.cc:85] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 2
I20260709 12:09:42.347035 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:42.347736 26607 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:42.348212 26607 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.348644 26607 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.312623 26513 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.307310 26606 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.362686 25690 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.345453 26516 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:42.374910 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:42.326375 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.324568 26565 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:09:42.400368 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:42.401202 25687 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.398509 25693 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.404640 26501 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:42.405311 26501 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:42.408982 26597 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:42.409839 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:42.410744 25685 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:42.412050 26576 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.374384 26513 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.415412 26513 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:42.423928 26625 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 12:09:42.406002 26599 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.376561 26606 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.433720 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:42.440212 25768 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:42.433969 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:42.441653 25764 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:42.437239 25767 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.376631 26540 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.449098 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:42.451095 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.468032 25617 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
W20260709 12:09:42.474380 26624 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:09:42.479391 25760 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.455895 26585 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.484474 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:42.438167 26604 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.440276 26599 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.489979 26599 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.492970 26599 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.495344 26540 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.501832 26578 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.476540 25613 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:42.502693 26578 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.476387 26513 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.505990 26508 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:42.509657 26621 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:09:42.512184 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.516304 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:42.465855 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:42.480973 26585 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.524040 25687 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
W20260709 12:09:42.524470 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 75532.4us
I20260709 12:09:42.528434 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:42.529177 25767 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.532086 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:42.532950 25613 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:42.534956 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:42.525523 25693 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:42.517979 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60353.6us
I20260709 12:09:42.536949 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:42.547685 25767 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.486928 26522 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.517594 26501 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:42.487380 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.536373 26557 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:42.526194 26602 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:42.598923 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48853.2us
I20260709 12:09:42.596233 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.605556 25612 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:42.543850 26535 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:42.607769 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 392543us
I20260709 12:09:42.544323 26540 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:42.610018 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:42.597388 26562 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:09:42.538370 25694 pending_rounds.cc:107] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:09:42.614802 25583 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:42.549052 26604 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:42.609184 26620 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.372s	user 0.000s	sys 0.003s
I20260709 12:09:42.627281 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:42.603657 26602 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:42.600438 26557 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:42.548952 26561 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:09:42.627633 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:42.615839 26540 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:42.609216 26535 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.618247 25694 raft_consensus.cc:2917] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:09:42.618537 26530 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:42.601791 26522 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.613679 25610 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:42.644156 26540 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.631320 26513 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:42.635695 26576 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:42.636363 26602 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.639278 26557 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:42.674598 26622 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.280s	user 0.001s	sys 0.001s
I20260709 12:09:42.632014 26508 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:09:42.649537 26535 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:42.633257 26604 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.718526 26576 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:42.656160 26577 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:42.656420 26598 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:42.732939 26604 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.733004 26576 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.736680 26604 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:42.737197 26604 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.686127 26554 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.738703 26554 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.739351 26604 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.730468 26583 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:42.742390 26583 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:42.743434 26554 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:42.744504 26583 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.721573 26524 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.687574 25694 raft_consensus.cc:2889] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:42.748368 26568 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:42.687353 26513 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.749636 26513 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:42.752094 26513 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:42.753690 26513 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.728533 26516 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:42.680058 26530 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:42.723059 26599 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:42.765843 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:42.766762 25612 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:42.768494 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:42.733887 26577 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:42.755173 26562 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:42.759543 25759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.040s	sys 0.073s
I20260709 12:09:42.746044 26524 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.757444 26578 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:42.763768 26591 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:09:42.799661 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 195763us
I20260709 12:09:42.763072 25690 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.759480 26598 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:42.814200 26583 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.815022 26583 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:42.754213 26513 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.775731 26553 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:42.768105 26604 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:42.806087 25759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.040s	sys 0.075s
I20260709 12:09:42.760823 26516 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.807379 26339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:42.774770 26577 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:42.846460 26441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.026s	sys 0.105s
W20260709 12:09:42.848438 26441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.026s	sys 0.105s
I20260709 12:09:42.766794 26599 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.821380 26583 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:42.847831 26604 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.827952 26612 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.825079 26553 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:42.806437 26562 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.857661 26522 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.882637 26516 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:42.887463 26513 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.862802 26540 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.872445 26339 raft_consensus.cc:2393] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:09:42.847821 26530 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.892323 26540 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.902606 26598 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.903988 26524 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:42.871282 26553 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:42.905320 26599 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:42.906410 26607 consensus_meta.cc:287] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.557s	user 0.016s	sys 0.000s
I20260709 12:09:42.907650 26604 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:42.912331 26529 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.874992 26597 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.870846 26612 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:42.922693 26618 log.cc:927] Time spent T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:09:42.925550 25760 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:42.904013 26516 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.970639 26441 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:42.972162 26441 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:42.933718 26602 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.968988 26516 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:42.991433 26560 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:42.954411 26607 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.010337 26441 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:43.013181 26602 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.033370 26540 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.014811 26599 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.037130 26540 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.037897 26599 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.039880 26540 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.041647 26599 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.014638 26604 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:43.033784 26522 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.043282 26522 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.043175 26604 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.045468 26522 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.034072 26583 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:42.964423 26529 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.046505 26640 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.048787 26583 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:42.965906 26597 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.052776 26585 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.052923 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.056962 26524 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.043418 26516 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.057497 26524 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.052918 26640 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:43.059206 26606 consensus_meta.cc:287] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
I20260709 12:09:43.059648 26606 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.059865 26640 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.055022 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.061335 25763 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.057940 26508 raft_consensus.cc:1064] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
W20260709 12:09:43.056633 26632 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:09:43.059793 26524 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.062934 26557 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.053474 25759 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:43.067543 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.069612 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.081161 25612 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.071995 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.081874 25615 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.052742 26604 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.084008 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.087069 26607 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.087530 26557 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.085995 25618 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.055215 26535 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.098469 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.099455 25616 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.100409 26529 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.101106 25617 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.101742 26577 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.094028 26597 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.103914 26577 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.105203 26606 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.106634 26561 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.107163 26561 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.109849 26562 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.111658 26524 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.112176 26524 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.115643 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.116290 25613 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:43.119318 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.120631 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.121265 25613 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.123690 25658 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.124272 26524 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.110160 26561 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.125448 26612 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.129473 26553 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.132122 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.144835 25764 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.133782 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.147066 26553 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.147472 26583 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.149019 26522 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.133958 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.134596 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.150767 25765 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.150933 25762 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.154577 26585 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.155198 26585 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.157473 26585 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.160522 25766 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.143674 26607 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:43.175930 26607 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.094002 26535 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.180497 26607 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.185521 26568 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.186200 26568 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.188481 26568 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:43.189013 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:43.135068 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.136178 26499 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.190410 26568 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.190573 26499 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.190989 26499 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.136996 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.139303 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.194269 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.194772 25759 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.195043 25690 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:43.140745 26339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:43.195894 26339 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.196024 26553 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.196439 26553 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.142300 25760 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:43.196796 26553 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.198971 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.199673 25690 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:43.201085 26508 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:43.202656 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.203353 25690 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:43.204566 26304 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.205003 26612 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.149652 26522 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.205502 26612 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.193360 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:43.208221 26522 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.208699 26597 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.209088 26597 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.209245 26583 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:43.209487 26597 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.209668 26583 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:43.210089 26583 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:43.194072 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 57187.5us
I20260709 12:09:43.211464 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.212218 26561 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.212597 26561 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.212927 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.213690 26524 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:43.212945 26561 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.205607 26304 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.214066 26524 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.219473 26524 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:43.214043 25658 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.220916 26529 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.221292 26529 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.221637 26529 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.190964 26568 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.232110 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.232815 25613 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.234580 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.235201 25617 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.237564 25760 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:43.241009 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.241664 26529 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.242591 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.260900 25516 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 2, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.234127 26568 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.248888 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.263180 25614 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
W20260709 12:09:43.250089 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 56794.5us
I20260709 12:09:43.264110 26524 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.264763 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:43.266368 26562 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:43.266472 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:43.266907 26562 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:43.208221 26612 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.268106 26635 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.267797 26562 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.268515 26635 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.269026 26635 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.269850 26544 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:43.274663 26602 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.275249 26602 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.252712 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.278172 26602 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.279309 26522 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.279729 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.280015 26522 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.280588 26640 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.281495 26612 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.281857 26640 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.282332 26612 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.283242 26612 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.283802 26522 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.282429 26640 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.285526 26561 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.287977 26499 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.286633 26568 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.288981 26568 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:43.291320 26568 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:43.295881 26529 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.304447 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.306074 25690 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.308449 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.309881 25690 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.313575 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:43.314364 26576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.021s	sys 0.039s
W20260709 12:09:43.314745 26576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.021s	sys 0.039s
I20260709 12:09:43.316766 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.318574 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:43.320658 26640 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.326665 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.326767 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.328790 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.329438 25765 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:43.330070 25694 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:43.330394 25766 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.331321 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.331956 25765 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.328186 25759 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.333985 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.338452 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.341053 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.341676 25766 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:43.343852 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.344561 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.347316 25764 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.349080 26640 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.345647 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.349843 25693 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:43.350741 25763 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:43.351748 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.282544 25617 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.352352 25763 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.357103 26640 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.358826 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.358135 26640 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.358989 26529 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.359697 25766 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:43.359786 26529 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.361378 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.362056 26529 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.362509 26640 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.363390 26576 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.365952 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.365262 26576 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.366024 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.366597 25611 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.368486 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.369139 25613 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.370080 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.365139 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.375420 26529 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.376103 26529 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.377209 25759 raft_consensus.cc:2410] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:43.377388 26640 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:43.379136 26529 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.375880 26576 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:43.379894 26556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.016s	sys 0.012s
W20260709 12:09:43.380322 26556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.016s	sys 0.012s
I20260709 12:09:43.373246 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:43.381807 25583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.014s	sys 0.064s
W20260709 12:09:43.382218 25583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.014s	sys 0.064s
I20260709 12:09:43.378934 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.383431 25764 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.386278 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.389472 25764 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.388922 25611 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.384670 25766 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:43.390673 25762 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:43.396664 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.397609 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.398290 25615 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
W20260709 12:09:43.383055 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 755450us
I20260709 12:09:43.260221 26583 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:43.406517 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.403461 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:43.411314 25582 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:09:43.437882 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 56725us
I20260709 12:09:43.439033 25764 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.422487 25613 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.382913 25760 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:43.426673 25614 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:43.415972 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.446743 25618 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
W20260709 12:09:43.446946 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 43582.6us
I20260709 12:09:43.431694 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.442452 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.452009 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.452801 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.453579 25658 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.437078 26518 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.450950 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.454993 26518 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.455454 25616 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.450526 26576 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:43.457324 26518 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.457751 26576 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.457952 26518 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:43.445030 26640 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.404963 26499 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.462945 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:43.459674 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.464394 25764 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:43.465596 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:43.478425 26441 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:43.480129 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.480899 25762 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.484193 25764 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:43.458237 26576 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:43.489225 26648 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:43.451038 26568 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.430785 26529 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:09:43.482702 26530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.008s
I20260709 12:09:43.461265 26516 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:43.403406 26635 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.461998 26602 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.460274 26613 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:43.484831 25610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.004s
W20260709 12:09:43.546470 25768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.021s	sys 0.008s
I20260709 12:09:43.478093 26533 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.532305 26568 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.477871 26640 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:43.550729 25610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.020s	sys 0.006s
W20260709 12:09:43.537179 26530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.012s	sys 0.008s
I20260709 12:09:43.455029 26645 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:43.479266 26509 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:09:43.491185 26597 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:43.572953 25768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.021s	sys 0.008s
I20260709 12:09:43.548362 26647 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.556087 26568 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.558300 26544 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:43.557160 26557 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:43.566057 25732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.024s	sys 0.041s
I20260709 12:09:43.567646 26561 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.551162 26533 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.554193 26553 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.551980 26602 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.559566 26644 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 12:09:43.575302 25767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.029s
I20260709 12:09:43.591334 26613 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.624370 26530 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.625168 26665 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.625550 26661 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:43.603271 25732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.024s	sys 0.042s
W20260709 12:09:43.660799 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:43.688189 25767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.000s	sys 0.030s
W20260709 12:09:43.691897 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 1.06464e+06us
I20260709 12:09:43.539615 26648 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:43.605592 26565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.012s	sys 0.018s
I20260709 12:09:43.598487 26650 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:43.689739 26598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.036s
I20260709 12:09:43.604097 26645 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:43.607404 26529 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.687785 26524 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.687651 26599 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:43.604089 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 398551us
W20260709 12:09:43.703351 26565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.012s	sys 0.018s
I20260709 12:09:43.691838 26613 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.698805 26665 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.734295 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:43.735071 25693 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:43.595778 26647 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.702346 26530 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.715950 26612 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.718185 26674 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.719671 26533 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.722379 26529 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.601212 26557 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.700731 26661 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:43.728974 26441 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:43.705966 26561 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:43.722393 25616 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.731348 26499 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:43.713734 26598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.014s	sys 0.036s
I20260709 12:09:43.732158 26643 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:43.707834 26556 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:43.714881 26583 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:43.820956 26653 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:09:43.821801 26655 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:09:43.822353 26516 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:43.822548 26648 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.823019 26640 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.771924 26674 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.823122 26647 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.824438 26612 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.825057 26529 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.825282 26553 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.807821 26664 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.835105 26643 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.836972 26645 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.826325 25690 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:43.826781 26597 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.827544 26557 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:43.754276 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 295450us
I20260709 12:09:43.758230 25693 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
W20260709 12:09:43.784423 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 304957us
W20260709 12:09:43.839589 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 374070us
W20260709 12:09:43.767009 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 313502us
I20260709 12:09:43.826815 26441 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.743451 26613 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.864176 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.864697 25764 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.866030 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:43.866752 25762 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.867259 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.851737 26664 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:43.742930 26665 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:43.791664 26635 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.880153 25764 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:43.751070 26646 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:43.838294 26562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.001s	sys 0.049s
I20260709 12:09:43.786831 26670 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.883795 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.883881 26670 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.885506 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.842599 26565 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.881659 26560 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.886555 26565 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.887200 26560 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.888886 26565 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.889297 26560 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.881505 26553 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:43.889849 26597 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:43.881314 26557 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:09:43.890942 26670 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.772048 26518 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:43.855744 26516 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.887449 26509 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:09:43.853163 25763 consensus_meta.cc:287] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.013s
I20260709 12:09:43.895790 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.839740 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:43.869060 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.870558 26643 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.872350 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.860110 26530 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.873821 26661 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.744140 26599 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:43.874610 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.846204 26576 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:43.875250 26304 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.835312 26499 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.775645 26524 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.834822 26561 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.840324 26556 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.883172 26667 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:43.883466 26562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.049s
I20260709 12:09:43.838611 26522 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:43.892117 26518 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.853574 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:43.893131 26646 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.899004 25768 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
W20260709 12:09:43.911123 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72636.9us
I20260709 12:09:43.912201 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.940646 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.914561 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.915802 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.916158 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.919587 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.919833 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.916587 26676 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:43.956977 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:43.957315 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.958038 25619 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
W20260709 12:09:43.944718 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64433.1us
I20260709 12:09:43.961122 26568 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.961544 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:43.974133 25690 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:43.974777 26599 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:43.948110 26676 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:43.975643 26599 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:43.976364 26676 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:43.941800 25611 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.979239 26499 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.979552 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.980046 26680 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:43.980325 25611 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:43.980757 26680 raft_consensus.cc:697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:43.981361 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.950740 25612 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.982177 25611 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:43.986718 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.942345 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.924302 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:43.935775 25617 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:43.916260 26647 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:43.994375 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.882079 26602 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.898377 25763 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:43.923555 25759 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:43.922053 25762 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:43.995786 25613 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.993463 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.998420 25619 raft_consensus.cc:2368] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:43.998453 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.931814 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.934417 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:43.993868 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 69651.7us
I20260709 12:09:44.003950 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:44.021267 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:44.021368 25618 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:43.999665 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.021106 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:44.022938 25611 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:44.019255 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.025617 25613 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.027076 25612 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:43.951817 26561 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.029752 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:43.953218 26556 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:43.998656 26646 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:43.953441 26643 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:43.943801 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:43.998705 26499 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:43.930605 26524 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.947662 25761 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:43.983835 26522 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.910416 26509 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.038466 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.039153 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:44.042349 26678 log.cc:927] Time spent T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:09:44.041369 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.052219 26441 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:43.938141 26667 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.972183 26613 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:43.954095 26648 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:09:44.033430 25760 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:43.997684 26647 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:44.057873 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 100972us
I20260709 12:09:44.066819 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.060684 25767 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:44.040673 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:44.121062 25768 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:09:44.061617 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.066928 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.122071 25762 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:44.064864 26441 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.060075 25766 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:44.056744 26556 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.054723 26670 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:44.129765 25618 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:44.055388 26643 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:44.061842 26533 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:44.059325 26529 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.059556 26499 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:44.062903 26612 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.028124 26576 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:44.114665 26561 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:43.982056 26680 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:44.048370 26553 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:44.120105 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 195057us
I20260709 12:09:44.156093 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:44.128453 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:44.069240 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:44.138568 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.113704 26560 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:44.148608 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.151130 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:44.129120 26647 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.157493 25765 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:09:44.158463 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 204032us
I20260709 12:09:44.158596 26441 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.131458 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.198621 25767 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:44.198771 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:44.199681 25766 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.140409 26533 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:44.201501 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:44.237442 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.238310 25762 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:44.132812 26556 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.203370 26691 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.146181 26529 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.204058 25760 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:44.153332 26612 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.204236 26338 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:44.188405 26672 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.208052 26690 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:44.208262 26666 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:44.208592 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61762.5us
I20260709 12:09:44.208662 26648 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:44.246537 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:44.238519 26646 raft_consensus.cc:2764] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:44.251147 25759 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:44.208067 26667 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.252188 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.252732 26522 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:44.253403 25690 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:44.155215 26561 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.213835 26613 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:44.215646 26682 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:09:44.216176 26640 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.145736 26650 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:44.155604 26553 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.134941 26670 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.246019 26691 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.239109 26533 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:44.162581 26674 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.297822 25689 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:44.162559 26518 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.243919 26671 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.270270 25768 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:44.271083 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.271448 26664 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:44.238950 25761 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:44.249050 26643 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.161299 26516 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.306332 26516 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.248381 26666 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.277420 25514 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 176) took 2275 ms. Trace:
I20260709 12:09:44.277500 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:44.269300 25517 catalog_manager.cc:5697] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.286945 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 130938us
I20260709 12:09:44.267879 26499 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.250026 26672 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.268173 26568 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.294210 26670 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.296044 25693 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:44.296677 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.237788 26560 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:44.299247 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.294553 26665 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:44.257638 26690 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.292378 26553 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.303391 26674 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.309123 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.374719 25688 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:44.308224 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.297883 26650 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.302834 26676 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.376418 25687 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:44.378578 26646 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:44.376792 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.308159 26635 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:44.379058 25689 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:44.292109 26640 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.402874 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.376545 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:44.404711 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.407115 25689 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:44.408510 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.409454 25689 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:44.304957 26524 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.381860 25766 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:44.374917 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.411988 25685 raft_consensus.cc:2368] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:44.309897 26556 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.387621 25692 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.297605 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.373119 26666 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.416507 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.417775 25690 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:44.303792 26518 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.371299 26509 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:44.390445 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82312.2us
I20260709 12:09:44.418959 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.419302 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.420271 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.420558 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.421406 26681 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:44.422712 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:44.376916 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 99530.2us
I20260709 12:09:44.423739 25689 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.425097 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.425740 25689 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.426980 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.430495 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.379098 26613 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:44.422158 26597 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:44.394243 26670 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:44.437736 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.441473 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.422418 25694 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:44.442353 25687 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:09:44.435290 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 61368.6us
I20260709 12:09:44.307448 26671 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.424366 26681 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:44.395601 26650 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.454641 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:44.439289 26597 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.452533 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:44.452654 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.453227 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.455328 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:44.461760 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:44.461809 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.462713 25612 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:44.462590 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:44.463507 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.447121 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.435775 25690 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.442618 26670 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.439543 26518 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.466992 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.468878 25768 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:44.473560 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.474128 26693 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:44.474763 26693 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:44.475628 26691 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.393865 26674 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:44.478446 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.481580 25693 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.482460 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:44.483053 25687 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:44.447150 26529 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.487795 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.475754 26693 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.477046 26670 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.468245 26612 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:44.653064 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 165343us
I20260709 12:09:44.651942 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.653753 25767 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.654313 25692 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:44.373948 25514 rpcz_store.cc:276] 0709 12:09:41.993482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:41.993791 (+   309us) service_pool.cc:224] Handling call
0709 12:09:44.268704 (+2274913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:42.304112 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:42.304803 (+   691us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:42.304839 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:09:42.304852 (+    13us) tablet.cc:662] Decoding operations
0709 12:09:42.353669 (+ 48817us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:42.373771 (+ 20102us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:42.376257 (+  2486us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:09:42.476328 (+100071us) tablet.cc:701] Row locks acquired
0709 12:09:42.476350 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:09:42.480278 (+  3928us) write_op.cc:270] Start()
0709 12:09:42.480426 (+   148us) write_op.cc:276] Timestamp: P: 1783598982480218 usec, L: 0
0709 12:09:42.480451 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:09:42.650483 (+170032us) log.cc:844] Serialized 1325 byte log entry
0709 12:09:42.914979 (+264496us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d56e28 00007fbdb6791581 00007fbdb6790d58 00007fbdb67959f1 00007fbdb67959a9 00007fbdb6795939 00007fbdb6795901 00007fbdb6794b2d 0000000000388634 0000000000388479
0709 12:09:43.460823 (+545844us) op_driver.cc:464] REPLICATION: finished
0709 12:09:43.867960 (+407137us) write_op.cc:301] APPLY: starting
0709 12:09:43.880673 (+ 12713us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:43.909155 (+ 28482us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:43.912816 (+  3661us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:43.954901 (+ 42085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:43.955159 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:09:43.955236 (+    77us) write_op.cc:312] APPLY: finished
0709 12:09:43.955495 (+   259us) log.cc:844] Serialized 34 byte log entry
0709 12:09:43.955727 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:43.955845 (+   118us) write_op.cc:454] Released schema lock
0709 12:09:43.955898 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:44.022290 (+ 66392us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:44.027749 (+  5459us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":387882,"apply.run_cpu_time_us":3764,"apply.run_wall_time_us":135453,"num_ops":3,"prepare.queue_time_us":162685,"prepare.run_cpu_time_us":8903,"prepare.run_wall_time_us":611099,"replication_time_us":980160,"spinlock_wait_cycles":14032256,"thread_start_us":316888,"threads_started":2}]]}
I20260709 12:09:44.465256 26597 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.540356 25517 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.659346 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 100527us
I20260709 12:09:44.539705 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 38) took 2303 ms. Trace:
W20260709 12:09:44.650031 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:44.537410 26695 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:09:44.653317 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.635527 26650 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:44.525952 26544 consensus_meta.cc:287] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.920s	user 0.012s	sys 0.003s
W20260709 12:09:44.537750 26696 log.cc:927] Time spent T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:09:44.484395 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.499905 26561 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.660177 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:44.787190 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 127084us
I20260709 12:09:44.660297 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.654356 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.788525 25692 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.788709 25693 raft_consensus.cc:2368] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5.
I20260709 12:09:44.517894 26665 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.663506 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.576970 26516 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.606307 26681 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.535606 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.500598 26303 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:44.801281 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.519553 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.530058 26672 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.717020 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.663869 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.811246 25613 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:44.811631 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.812556 25617 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:44.812413 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.660949 26635 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:44.656450 25767 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:44.811681 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.814728 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.699267 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.662518 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.824625 25762 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.739467 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.686623 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:44.708765 25517 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.826006 25766 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.789382 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.658605 26643 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:44.705629 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 175) took 1454 ms. Trace:
I20260709 12:09:44.791568 26441 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:44.779435 26669 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:44.698026 26648 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:44.851076 26508 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:44.703455 25759 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:44.701009 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.807586 26560 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:44.809391 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.708854 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.816247 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.808436 26568 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:44.820490 25692 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.821967 26640 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.778826 26645 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.694571 26602 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:44.853741 26672 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:44.808284 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.834673 25760 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.645041 26690 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.852123 26441 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.806819 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.703994 26674 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.778577 26671 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.841004 26699 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:44.859042 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.809048 26646 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:44.857223 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.860154 26508 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.864828 25767 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:44.636941 26676 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.867972 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.738709 26544 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:44.833912 26643 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:44.694290 26533 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.833086 26516 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:44.707988 26553 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.854967 26665 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:44.879014 26645 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:44.835368 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 354095us
I20260709 12:09:44.982041 25615 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.859840 25761 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:44.810441 25690 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.829869 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.869297 26576 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:09:44.660478 25515 rpcz_store.cc:276] 0709 12:09:42.236214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:42.236387 (+   173us) service_pool.cc:224] Handling call
0709 12:09:44.539625 (+2303238us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:42.915379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:42.915974 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:42.916029 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:09:42.916049 (+    20us) tablet.cc:662] Decoding operations
0709 12:09:42.916437 (+   388us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:42.916486 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:42.916519 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:42.916707 (+   188us) tablet.cc:701] Row locks acquired
0709 12:09:42.916725 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:09:42.916912 (+   187us) write_op.cc:270] Start()
0709 12:09:42.917035 (+   123us) write_op.cc:276] Timestamp: P: 1783598982916867 usec, L: 0
0709 12:09:42.917057 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:09:42.917744 (+   687us) log.cc:844] Serialized 602 byte log entry
0709 12:09:43.843494 (+925750us) op_driver.cc:464] REPLICATION: finished
0709 12:09:44.059732 (+216238us) write_op.cc:301] APPLY: starting
0709 12:09:44.066575 (+  6843us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:44.109467 (+ 42892us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:44.116627 (+  7160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:44.139205 (+ 22578us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:44.160444 (+ 21239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:44.160496 (+    52us) write_op.cc:312] APPLY: finished
0709 12:09:44.187093 (+ 26597us) log.cc:844] Serialized 22 byte log entry
0709 12:09:44.218383 (+ 31290us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:44.218499 (+   116us) write_op.cc:454] Released schema lock
0709 12:09:44.218562 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:44.219081 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:44.219129 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52502,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":197653,"apply.run_cpu_time_us":2892,"apply.run_wall_time_us":161736,"mutex_wait_us":3883,"num_ops":1,"prepare.queue_time_us":651383,"prepare.run_cpu_time_us":2742,"prepare.run_wall_time_us":2741,"replication_time_us":918806,"thread_start_us":170000,"threads_started":1}]]}
I20260709 12:09:44.942939 26646 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:44.944473 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 282216us
I20260709 12:09:44.944890 25687 raft_consensus.cc:2368] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:44.938122 25658 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:44.949419 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:44.995795 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:44.955380 26441 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.996412 25693 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:44.971484 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:44.984674 25617 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:45.000093 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.000808 26640 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.001484 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.001853 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:44.928718 26599 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.002043 26533 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.002451 26599 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.002884 26599 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.945767 26508 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:44.871179 25694 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.884459 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.943960 26643 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:44.986053 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 196658us
I20260709 12:09:45.020255 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:44.986786 25619 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:44.862345 26669 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:44.998390 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60373.1us
W20260709 12:09:44.938738 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 262880us
I20260709 12:09:45.000826 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.006735 25618 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:44.978488 26665 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.008052 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.008265 25615 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:45.041620 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.009397 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.946326 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.915030 26613 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:45.011701 25766 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
W20260709 12:09:45.013000 26704 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:09:45.013065 25686 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:44.955488 26530 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.015065 25691 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.872246 26568 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.017647 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:44.955775 26509 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.026850 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.066349 25687 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:44.997470 26646 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:44.896517 26602 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.032553 25693 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:45.072667 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:45.073220 25693 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.036116 25658 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.076411 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.044831 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.045430 25732 leader_election.cc:400] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:45.078905 25732 leader_election.cc:403] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:45.023550 26670 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:44.978288 26516 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.047587 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.016659 26499 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.019953 26648 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.100545 26553 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.100944 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 943) took 1056 ms. Trace:
I20260709 12:09:45.101101 26648 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.101845 26671 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.102303 26671 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.102655 26671 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.054174 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.043896 26665 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.056380 26339 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:45.056591 25610 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:44.984118 26699 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.120848 25613 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:45.121243 26699 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:44.982125 26635 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.048990 26674 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.123940 25692 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:45.126960 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:45.127662 25610 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:45.081023 26556 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.051697 26640 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.049099 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.080294 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.075042 26509 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.056231 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:45.082907 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.091154 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:45.136473 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53662.4us
I20260709 12:09:45.064023 26709 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.110941 25693 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:45.112709 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.069384 26530 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.063689 26613 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:45.081826 26597 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:45.045678 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 198510us
I20260709 12:09:45.136592 25691 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:45.147461 25617 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:45.101442 25765 rpcz_store.cc:276] 0709 12:09:44.044428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.468062 (+423634us) service_pool.cc:224] Handling call
0709 12:09:44.468420 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:44.468649 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:44.468675 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:44.638589 (+169914us) log.cc:844] Serialized 26 byte log entry
0709 12:09:44.813982 (+175393us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:44.814027 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:44.814096 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:45.100693 (+286597us) raft_consensus.cc:1685] finished
0709 12:09:45.100720 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:45.100880 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":101875,"threads_started":1,"wal-append.queue_time_us":366255}
I20260709 12:09:45.137310 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.149255 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.137959 25612 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:45.079334 26676 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.098302 26499 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.151404 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.155998 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.156595 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.157127 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:45.156850 25765 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:45.159162 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:45.128032 26516 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.163754 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.164353 25583 leader_election.cc:400] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:45.160061 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.132150 25685 raft_consensus.cc:2368] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
W20260709 12:09:45.162153 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 141033us
I20260709 12:09:45.165623 26441 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.165328 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.162773 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:45.164882 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.169059 25693 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:45.166769 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.170006 25617 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:45.171463 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.171769 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.172328 25691 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:45.138592 26556 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.166105 26441 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.175369 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.138626 26640 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.176559 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.177541 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.168035 25583 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:45.146984 26553 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:45.167083 25764 raft_consensus.cc:2410] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:09:45.192042 25612 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:45.191766 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:45.070341 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.139086 26715 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:45.195549 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.196770 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:45.198784 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:45.201615 25764 raft_consensus.cc:2410] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:45.157750 26699 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.197474 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:45.163654 26499 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.162955 26674 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:45.158160 26648 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.207232 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.211587 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.212770 25691 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:45.212759 25764 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:45.214288 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:45.215178 25583 leader_election.cc:400] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:45.161478 26669 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.187507 26672 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.224794 26441 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.191713 26556 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.172600 25617 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:45.196295 26557 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.222851 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.192999 26640 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.165182 26533 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:09:45.194096 26712 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.204916 26516 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.217149 25690 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:45.193313 26544 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:45.286211 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.161947 26709 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.293030 26709 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.197959 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:45.225700 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:45.237970 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.233247 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.196895 26560 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:09:45.278458 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.279292 25582 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:45.281216 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.310128 25691 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:45.216008 26715 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.210626 26553 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:45.203204 26645 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.204437 26650 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:45.206631 26699 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.165727 26713 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 12:09:45.228796 25764 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:45.168503 26711 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.139s
I20260709 12:09:45.219342 26668 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:09:45.224300 26672 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.229730 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:45.228070 26648 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.309985 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:45.210891 26598 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.224436 26674 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:45.311148 26709 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.275492 26557 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:45.279691 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.280568 26516 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.323951 26719 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.230404 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:45.330761 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 105196us
I20260709 12:09:45.354096 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.226553 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.334712 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.336261 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:09:45.355515 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 129047us
I20260709 12:09:45.355685 25691 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:45.327481 26699 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.356305 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.337133 25619 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:45.311147 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.312417 26715 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.228973 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.371448 25619 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:45.373345 25619 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:45.325981 26544 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.273895 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:45.357431 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.343874 25614 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:09:45.358909 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 128671us
I20260709 12:09:45.376241 25658 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.341228 26672 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.376433 25619 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:09:45.374130 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 64253us
I20260709 12:09:45.343972 26648 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.344262 26598 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.350752 26557 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.331281 26650 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.353844 26516 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.393756 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:45.358975 26693 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:45.401235 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:45.432485 26598 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.358723 26529 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.434165 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.366742 26568 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:45.476105 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 122101us
W20260709 12:09:45.476280 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82629.8us
I20260709 12:09:45.489807 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:45.483284 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 989) took 1020 ms. Trace:
I20260709 12:09:45.391470 26544 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:45.371780 26675 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.496038 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:45.497345 25619 raft_consensus.cc:2410] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:45.493913 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:45.350942 26709 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.440766 26676 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.500854 26723 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:45.370172 26715 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.395843 26533 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.510210 26441 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.485868 26681 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:45.514940 26718 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:09:45.491168 25618 rpcz_store.cc:276] 0709 12:09:44.463299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.288738 (+825439us) service_pool.cc:224] Handling call
0709 12:09:45.289069 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:45.289309 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:45.338439 (+ 49130us) log.cc:844] Serialized 14 byte log entry
0709 12:09:45.482780 (+144341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:45.482871 (+    91us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:45.482933 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:45.483031 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:45.483204 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46054,"raft.queue_time_us":46212,"thread_start_us":146409,"threads_started":2,"wal-append.queue_time_us":52374}
I20260709 12:09:45.492309 26509 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.502843 26568 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.495304 26675 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.495461 26544 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.511133 26676 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.391451 26719 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.518718 26533 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.498737 26713 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:09:45.396775 26553 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.398278 26597 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:45.392431 26647 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 1.181s	user 0.014s	sys 0.001s
I20260709 12:09:45.510421 26668 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.521427 26529 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:44.851712 25516 rpcz_store.cc:276] 0709 12:09:43.251714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:43.251902 (+   188us) service_pool.cc:224] Handling call
0709 12:09:44.705505 (+1453603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:43.288486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:43.289033 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:43.289072 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:09:43.289090 (+    18us) tablet.cc:662] Decoding operations
0709 12:09:43.289446 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:43.289491 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:43.289516 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:43.289711 (+   195us) tablet.cc:701] Row locks acquired
0709 12:09:43.289733 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:09:43.289885 (+   152us) write_op.cc:270] Start()
0709 12:09:43.290026 (+   141us) write_op.cc:276] Timestamp: P: 1783598983289834 usec, L: 0
0709 12:09:43.290048 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:09:43.290777 (+   729us) log.cc:844] Serialized 543 byte log entry
0709 12:09:44.254117 (+963340us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b540001c128. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb91179e1 00007fbdb911664c 00007fbdb67923bb 00007fbdb679471a 00007fbdb67946a8 00007fbdb6794628 00007fbdb67945e3 00007fbdb67937fc 00007fbdb8bc62f6 00007fbdb8bc0aa8 00007fbdb2d67310
0709 12:09:44.273012 (+ 18895us) op_driver.cc:464] REPLICATION: finished
0709 12:09:44.290359 (+ 17347us) write_op.cc:301] APPLY: starting
0709 12:09:44.294995 (+  4636us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:44.297736 (+  2741us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:44.297769 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:44.300899 (+  3130us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:44.301069 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:44.301125 (+    56us) write_op.cc:312] APPLY: finished
0709 12:09:44.344820 (+ 43695us) log.cc:844] Serialized 22 byte log entry
0709 12:09:44.375795 (+ 30975us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:44.381510 (+  5715us) write_op.cc:454] Released schema lock
0709 12:09:44.383573 (+  2063us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:44.432883 (+ 49310us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:44.435159 (+  2276us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115625,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":2274,"apply.run_cpu_time_us":2281,"apply.run_wall_time_us":100763,"num_ops":1,"prepare.queue_time_us":22695,"prepare.run_cpu_time_us":3378,"prepare.run_wall_time_us":3377,"replication_time_us":769502,"spinlock_wait_cycles":7247232}]]}
I20260709 12:09:45.544358 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.610803 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 975) took 1159 ms. Trace:
I20260709 12:09:45.612737 25694 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:45.616894 26557 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.618587 25765 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:45.520646 26681 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:45.506551 26674 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:45.522069 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 309336us
W20260709 12:09:45.532296 26666 consensus_meta.cc:287] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.117s	user 0.011s	sys 0.002s
I20260709 12:09:45.521518 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.627605 26734 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:45.432542 26724 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.394493 26648 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.524277 26723 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.730055 26724 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.730839 26724 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.732470 26723 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.523131 26730 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.733287 26730 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:45.648142 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 247010us
I20260709 12:09:45.736423 26730 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:45.737130 26730 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.737601 26730 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:45.543375 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 502) took 1244 ms. Trace:
I20260709 12:09:45.738442 25686 rpcz_store.cc:276] 0709 12:09:44.298542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.299868 (+  1326us) service_pool.cc:224] Handling call
0709 12:09:44.300975 (+  1107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:45.063042 (+762067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:45.542976 (+479934us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54000aa854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:45.543258 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602424064}
I20260709 12:09:45.739753 26730 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:45.740118 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.740319 26730 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.740810 26730 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.594012 26675 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.593652 26676 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.541863 26640 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.748122 26640 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.633059 26533 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.730085 26735 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.751029 26735 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.753638 26735 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.541975 26556 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.673872 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:45.677889 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 447685us
W20260709 12:09:45.698617 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 322445us
I20260709 12:09:45.637938 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.657145 26668 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:45.658560 26529 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.754940 25765 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:45.740813 25686 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:45.754241 26735 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.757464 26668 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.763582 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 743) took 1340 ms. Trace:
I20260709 12:09:45.755805 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.756009 26556 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.757517 26529 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.757061 25693 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:45.763819 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.755682 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:45.765487 25765 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:45.766695 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.671830 26681 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.700299 26645 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:45.700058 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 504) took 1373 ms. Trace:
I20260709 12:09:45.662155 26647 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.787333 26645 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:09:45.777911 26646 consensus_meta.cc:287] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.004s
I20260709 12:09:45.763872 26735 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:45.769001 26665 consensus_meta.cc:287] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.002s
I20260709 12:09:45.788707 26556 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:45.789095 26568 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.783973 26723 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:45.807780 25765 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:45.705066 26716 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:45.762352 26648 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.785689 26730 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.760001 26533 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.789727 26711 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:45.801829 26508 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.770s	user 0.011s	sys 0.000s
I20260709 12:09:45.770993 26675 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.791805 26650 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:45.808668 26643 consensus_meta.cc:287] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.003s
I20260709 12:09:45.760038 26724 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.881304 26643 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.891311 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 757) took 1356 ms. Trace:
I20260709 12:09:45.803193 26734 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:45.893865 25692 rpcz_store.cc:276] 0709 12:09:44.534887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.867672 (+332785us) service_pool.cc:224] Handling call
0709 12:09:45.886549 (+1018877us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400329454. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:45.891229 (+  4680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416106240}
I20260709 12:09:45.894323 26734 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:45.894717 26734 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:45.895219 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.895886 25692 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:45.851887 26739 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.851929 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:45.852550 26728 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:09:45.853382 26729 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.719892 26666 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:45.854696 26717 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.459s	user 0.000s	sys 0.002s
I20260709 12:09:45.807356 26568 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.791914 26509 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:09:45.919013 26441 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:45.919389 26441 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:45.920190 26441 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.818400 26723 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:45.806568 26646 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.840543 26745 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:45.879210 26640 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:09:45.893198 26643 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.896939 25768 raft_consensus.cc:2368] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:45.898769 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.954798 25767 raft_consensus.cc:2410] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:45.955391 26647 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.955539 26719 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.955823 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.956473 25767 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:45.957418 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.909255 26557 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.826994 26665 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:45.912652 26737 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:09:45.913930 26613 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.914143 26675 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:45.917021 26591 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.690s	user 0.001s	sys 0.002s
I20260709 12:09:45.918071 26568 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.817642 26556 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.921408 26441 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.817247 26735 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.001863 26665 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.004490 26556 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.004492 26735 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.891194 26736 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:45.904402 26599 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.901s	user 0.012s	sys 0.001s
I20260709 12:09:45.899118 26648 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.016214 26602 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.016050 26681 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.961445 26741 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:45.927852 26723 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:45.985657 26721 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.624s	user 0.000s	sys 0.006s
I20260709 12:09:45.990007 26666 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:45.991915 26712 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:46.022511 26712 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:45.863715 26645 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:46.081179 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:46.080821 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 973) took 1629 ms. Trace:
I20260709 12:09:46.082820 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1000) took 1129 ms. Trace:
W20260709 12:09:46.083974 25613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 756) took 1287 ms (client timeout 1675 ms). Trace:
W20260709 12:09:46.085637 25615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 736) took 2170 ms (client timeout 1682 ms). Trace:
I20260709 12:09:45.666965 25616 rpcz_store.cc:276] 0709 12:09:44.451489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.456882 (+  5393us) service_pool.cc:224] Handling call
0709 12:09:44.720547 (+263665us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800003398. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:44.720774 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:45.120449 (+399675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:45.120490 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:45.120536 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:45.120574 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:45.610423 (+489849us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540008e154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:45.610498 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:45.610688 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937260672}
I20260709 12:09:46.087958 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:45.833189 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:45.904811 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.348379 25685 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.348634 25692 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:45.764016 25686 rpcz_store.cc:276] 0709 12:09:44.422976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.739795 (+1316819us) service_pool.cc:224] Handling call
0709 12:09:45.763521 (+ 23726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.351749 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:45.897729 25688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 747) took 1457 ms (client timeout 1748 ms). Trace:
W20260709 12:09:46.353044 26699 consensus_meta.cc:287] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.978s	user 0.010s	sys 0.002s
I20260709 12:09:45.921279 25689 raft_consensus.cc:2368] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:45.959110 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.362867 25767 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:46.099654 25690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 524) took 1793 ms (client timeout 2141 ms). Trace:
I20260709 12:09:45.785686 25694 rpcz_store.cc:276] 0709 12:09:44.299175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.197678 (+898503us) service_pool.cc:224] Handling call
0709 12:09:45.672261 (+474583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.370200 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.100425 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 529) took 1793 ms. Trace:
I20260709 12:09:46.371565 25694 raft_consensus.cc:2368] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:46.371958 25693 rpcz_store.cc:276] 0709 12:09:44.307171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.177289 (+870118us) service_pool.cc:224] Handling call
0709 12:09:46.099731 (+922442us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400266954. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.100153 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305856896}
I20260709 12:09:46.373047 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 729) took 2065 ms. Trace:
I20260709 12:09:46.373646 25694 rpcz_store.cc:276] 0709 12:09:44.307945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.369497 (+2061552us) service_pool.cc:224] Handling call
0709 12:09:46.372806 (+  3309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:45.896049 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.418138 25761 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:09:46.106657 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.422818 25691 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
W20260709 12:09:46.423550 25691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 512) took 2121 ms (client timeout 2808 ms). Trace:
I20260709 12:09:46.107754 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 561) took 1367 ms. Trace:
I20260709 12:09:45.964314 25766 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.114516 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 552) took 1645 ms. Trace:
I20260709 12:09:46.120126 26336 raft_consensus.cc:1240] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:45.985435 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:09:45.903400 26499 consensus_meta.cc:287] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.003s
I20260709 12:09:45.901585 26516 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.424707 25762 rpcz_store.cc:276] 0709 12:09:44.740661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.825543 (+ 84882us) service_pool.cc:224] Handling call
0709 12:09:44.948512 (+122969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:44.948803 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:44.948830 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:44.980702 (+ 31872us) log.cc:844] Serialized 26 byte log entry
0709 12:09:45.168111 (+187409us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:45.168157 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:45.168227 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:46.107005 (+938778us) raft_consensus.cc:1685] finished
0709 12:09:46.107096 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.107477 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":151639,"threads_started":1,"wal-append.queue_time_us":317387}
I20260709 12:09:46.438352 26499 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.440032 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:45.899127 26533 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.440860 25687 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:45.992575 26544 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.441365 26499 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.440984 26516 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.013154 26599 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.026409 26670 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.026069 26709 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:45.864773 26711 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:46.451431 26668 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.687s	user 0.004s	sys 0.014s
I20260709 12:09:45.996460 26715 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.453032 26599 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.455284 26715 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.029671 26724 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.457551 25764 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.020396 26736 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:46.460000 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 976) took 1273 ms. Trace:
I20260709 12:09:46.453677 26712 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.460898 26736 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:46.461982 25687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 759) took 1904 ms (client timeout 1997 ms). Trace:
W20260709 12:09:46.462550 25687 rpcz_store.cc:269] 0709 12:09:44.557662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.067224 (+509562us) service_pool.cc:224] Handling call
0709 12:09:45.233041 (+165817us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:09:46.461632 (+1228591us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400194bd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.461889 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628169344}
I20260709 12:09:46.464206 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:45.930728 26739 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.466578 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 952) took 1314 ms. Trace:
I20260709 12:09:45.963229 26745 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:46.467084 25766 rpcz_store.cc:276] 0709 12:09:45.151678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.176258 (+ 24580us) service_pool.cc:224] Handling call
0709 12:09:46.466087 (+1289829us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400165154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.466341 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784452352}
I20260709 12:09:46.121856 26338 raft_consensus.cc:2368] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:46.181185 26741 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:46.023474 26676 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:46.184890 25610 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.057s	user 0.016s	sys 0.006s
I20260709 12:09:46.168884 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.185060 26681 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:46.196924 25734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.008s	sys 0.021s
W20260709 12:09:46.197129 26306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.104s	sys 0.096s
W20260709 12:09:46.197072 26667 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.008s	sys 0.045s
W20260709 12:09:46.021474 26671 consensus_meta.cc:287] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.918s	user 0.004s	sys 0.009s
W20260709 12:09:46.231779 25582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.016s	sys 0.008s
W20260709 12:09:46.196915 26635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.016s	sys 0.031s
W20260709 12:09:46.294549 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 490886us
I20260709 12:09:45.861696 26508 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:46.313249 25731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.015s	sys 0.035s
I20260709 12:09:46.320640 26734 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:46.453097 26711 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.311143 25611 rpcz_store.cc:276] 0709 12:09:44.450906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.454416 (+  3510us) service_pool.cc:224] Handling call
0709 12:09:46.079732 (+1625316us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b5400361ad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.080226 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1913444736}
I20260709 12:09:46.311555 25612 rpcz_store.cc:276] 0709 12:09:44.952744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.156260 (+203516us) service_pool.cc:224] Handling call
0709 12:09:46.082216 (+925956us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5400278154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.082559 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52226432}
W20260709 12:09:46.312347 25615 rpcz_store.cc:269] 0709 12:09:43.915431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:43.915575 (+   144us) service_pool.cc:224] Handling call
0709 12:09:46.085026 (+2169451us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400418054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.085315 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2393043200}
W20260709 12:09:46.311973 25613 rpcz_store.cc:269] 0709 12:09:44.796193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.812122 (+ 15929us) service_pool.cc:224] Handling call
0709 12:09:45.884573 (+1072451us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400360bd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.083702 (+199129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700647168}
I20260709 12:09:46.346763 26742 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:46.478365 25582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.017s	sys 0.008s
I20260709 12:09:46.477911 25610 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:46.480975 26742 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:46.481477 25610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 998) took 1529 ms (client timeout 2031 ms). Trace:
I20260709 12:09:46.349370 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 733) took 2004 ms. Trace:
W20260709 12:09:46.356899 25732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.053s	sys 0.085s
W20260709 12:09:46.352974 25688 rpcz_store.cc:269] 0709 12:09:44.440151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.444831 (+  4680us) service_pool.cc:224] Handling call
0709 12:09:45.897484 (+1452653us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54000a9e54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:45.897634 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826255744}
W20260709 12:09:46.366519 26529 consensus_meta.cc:287] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.010s
W20260709 12:09:46.365324 25690 rpcz_store.cc:269] 0709 12:09:44.305743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.001604 (+695861us) service_pool.cc:224] Handling call
0709 12:09:46.098480 (+1096876us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000a9954. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.099323 (+   843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367084288}
I20260709 12:09:46.355195 26699 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:45.917143 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:46.375205 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 287926us
I20260709 12:09:46.376417 26646 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.374089 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.379339 26748 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:46.384317 25689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 737) took 2010 ms (client timeout 1836 ms). Trace:
W20260709 12:09:46.387526 25614 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.011s
I20260709 12:09:46.494712 26745 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.393055 26530 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:46.399099 25619 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.041s	sys 0.040s
W20260709 12:09:46.424015 25691 rpcz_store.cc:269] 0709 12:09:44.302015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.885247 (+1583232us) service_pool.cc:224] Handling call
0709 12:09:46.423437 (+538190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.432274 26336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60616 (request call id 56) took 1377 ms. Trace:
I20260709 12:09:46.440960 25762 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:46.511888 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 970) took 1326 ms. Trace:
I20260709 12:09:46.429448 25768 rpcz_store.cc:276] 0709 12:09:44.470022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.470167 (+   145us) service_pool.cc:224] Handling call
0709 12:09:46.113863 (+1643696us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003188d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.114198 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2647948672}
I20260709 12:09:46.512486 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:46.512856 25693 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:46.513264 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.513476 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 506) took 2213 ms. Trace:
I20260709 12:09:46.514209 25768 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:09:46.029397 26720 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.696s	user 0.002s	sys 0.002s
I20260709 12:09:46.515959 25614 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:45.952622 26729 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.455148 26544 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.465274 25687 raft_consensus.cc:2368] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:46.460455 25764 rpcz_store.cc:276] 0709 12:09:45.186910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.334447 (+147537us) service_pool.cc:224] Handling call
0709 12:09:46.459697 (+1125250us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002b98d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.459925 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2531112832}
I20260709 12:09:46.472361 25759 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
W20260709 12:09:46.475557 25734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.008s	sys 0.021s
W20260709 12:09:46.477394 26306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.105s	sys 0.096s
I20260709 12:09:46.528396 26736 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:46.477593 25765 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:46.532655 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 941) took 2493 ms. Trace:
I20260709 12:09:46.322641 26556 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:46.472666 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:46.477746 26667 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.008s	sys 0.046s
W20260709 12:09:46.479506 25731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.015s	sys 0.035s
I20260709 12:09:46.482733 25692 rpcz_store.cc:276] 0709 12:09:44.344719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.904387 (+1559668us) service_pool.cc:224] Handling call
0709 12:09:46.349235 (+444848us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:46.487291 25732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.054s	sys 0.086s
I20260709 12:09:46.477870 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:46.479404 26635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.017s	sys 0.031s
I20260709 12:09:46.490621 26529 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.491485 26670 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:46.540935 26670 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.541975 26646 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:46.527503 25760 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.542863 26646 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.543329 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:46.543984 25692 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.492754 26671 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.493758 25686 raft_consensus.cc:2368] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:46.493707 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:46.482028 25610 rpcz_store.cc:269] 0709 12:09:44.951908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.126617 (+174709us) service_pool.cc:224] Handling call
0709 12:09:46.481382 (+1354765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.497751 25767 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:46.453934 26668 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.499348 26741 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.387897 26645 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.464629 26723 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:46.505968 25689 rpcz_store.cc:269] 0709 12:09:44.373663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.437360 (+ 63697us) service_pool.cc:224] Handling call
0709 12:09:46.383785 (+1946425us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400328f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.384062 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3401961216}
I20260709 12:09:46.512280 25762 rpcz_store.cc:276] 0709 12:09:45.185008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.439580 (+1254572us) service_pool.cc:224] Handling call
0709 12:09:46.511796 (+ 72216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.513265 25691 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.502671 26712 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:46.516223 25619 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.042s	sys 0.040s
I20260709 12:09:46.513984 25693 rpcz_store.cc:276] 0709 12:09:44.299695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.373647 (+2073952us) service_pool.cc:224] Handling call
0709 12:09:46.513380 (+139733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.513586 26675 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:46.517002 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 966) took 1331 ms. Trace:
W20260709 12:09:46.513715 25583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.141s (SENT) [suppressed 9 similar messages]
I20260709 12:09:46.507270 26748 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:09:46.520299 26598 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.952s	user 0.016s	sys 0.005s
I20260709 12:09:46.511658 26336 rpcz_store.cc:276] 0709 12:09:45.055046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.065665 (+ 10619us) service_pool.cc:224] Handling call
0709 12:09:46.118755 (+1053090us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b58000d3b98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:46.119400 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.431686 (+312286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.432098 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30068480}
I20260709 12:09:46.571089 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:46.537333 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 533) took 1329 ms. Trace:
I20260709 12:09:46.540799 26556 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.541498 26340 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
W20260709 12:09:46.542596 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 1.0487e+06us
I20260709 12:09:46.492571 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.491933 26676 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.545442 25766 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
W20260709 12:09:46.536685 25614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 974) took 2085 ms (client timeout 2177 ms). Trace:
I20260709 12:09:46.556403 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.556587 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 977) took 1369 ms. Trace:
I20260709 12:09:46.587949 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.556993 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:46.552222 26599 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:46.557662 26338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60616 (request call id 54) took 1503 ms. Trace:
I20260709 12:09:46.589536 26598 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.591004 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:46.559188 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.559413 26739 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.560225 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.557957 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:09:46.562443 25686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 508) took 2262 ms (client timeout 2910 ms). Trace:
I20260709 12:09:46.564133 25768 rpcz_store.cc:276] 0709 12:09:45.183799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.512954 (+1329155us) service_pool.cc:224] Handling call
0709 12:09:46.514770 (+  1816us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:46.598982 25686 rpcz_store.cc:269] 0709 12:09:44.300454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.350892 (+2050438us) service_pool.cc:224] Handling call
0709 12:09:46.562188 (+211296us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400327654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.562374 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323883264}
I20260709 12:09:46.600026 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.600314 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:46.600782 25768 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.600715 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.601342 25686 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:46.567095 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 760) took 1346 ms. Trace:
I20260709 12:09:46.567703 26670 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.568174 26748 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.549715 26646 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.568431 26699 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.571821 25687 rpcz_store.cc:276] 0709 12:09:45.200337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.463741 (+1263404us) service_pool.cc:224] Handling call
0709 12:09:46.530016 (+ 66275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.573077 25693 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.571597 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.576463 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 975) took 1389 ms. Trace:
I20260709 12:09:46.590091 25691 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:46.588666 25759 rpcz_store.cc:276] 0709 12:09:45.187238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.630225 (+442987us) service_pool.cc:224] Handling call
0709 12:09:46.556373 (+926148us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54003183d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.556510 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636551936}
I20260709 12:09:46.591109 26338 rpcz_store.cc:276] 0709 12:09:45.054144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.055973 (+  1829us) service_pool.cc:224] Handling call
0709 12:09:46.557386 (+1501413us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400521054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.557561 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259291008}
I20260709 12:09:46.591706 25690 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.569799 25761 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:46.605912 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:46.605767 26675 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:46.533139 25763 rpcz_store.cc:276] 0709 12:09:44.039086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.234936 (+195850us) service_pool.cc:224] Handling call
0709 12:09:44.277955 (+ 43019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:44.300345 (+ 22390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:44.301555 (+  1210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:44.722367 (+420812us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b2c00003bf8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:09:44.723046 (+   679us) log.cc:844] Serialized 26 byte log entry
0709 12:09:45.164059 (+441013us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:45.167562 (+  3503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:45.179984 (+ 12422us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:46.019405 (+839421us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:46.532111 (+512706us) raft_consensus.cc:1685] finished
0709 12:09:46.532161 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.532434 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1428,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3361,"spinlock_wait_cycles":58509312,"thread_start_us":415648,"threads_started":1,"wal-append.queue_time_us":509132}
I20260709 12:09:46.573467 25694 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:46.638336 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.572050 26742 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.614588 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.617043 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:46.611361 26544 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:46.638839 25692 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:46.642902 25687 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:46.642796 26544 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.643931 26668 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.640903 26699 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:46.638090 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 535) took 1437 ms. Trace:
I20260709 12:09:46.645273 26699 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:46.638952 26568 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.010s
I20260709 12:09:46.645184 25694 rpcz_store.cc:276] 0709 12:09:45.201064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.473173 (+1272109us) service_pool.cc:224] Handling call
0709 12:09:46.638022 (+164849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.622864 25764 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.646055 26568 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.646657 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 958) took 1493 ms. Trace:
I20260709 12:09:46.647061 25764 rpcz_store.cc:276] 0709 12:09:45.153748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.546496 (+1392748us) service_pool.cc:224] Handling call
0709 12:09:46.646580 (+100084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.648067 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.648489 26568 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.648770 25764 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.649611 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.650775 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.651387 25763 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.650899 26699 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.652140 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.653662 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 568) took 1865 ms. Trace:
I20260709 12:09:46.619671 25685 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
W20260709 12:09:46.654449 25685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51490 (request call id 20) took 2123 ms (client timeout 2509 ms). Trace:
I20260709 12:09:46.622427 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.623107 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:46.610821 25767 rpcz_store.cc:276] 0709 12:09:45.186599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.958870 (+772271us) service_pool.cc:224] Handling call
0709 12:09:46.572284 (+613414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.630620 25688 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:46.654860 25685 rpcz_store.cc:269] 0709 12:09:44.530663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.794848 (+1264185us) service_pool.cc:224] Handling call
0709 12:09:46.654357 (+859509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.656428 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 510) took 2354 ms. Trace:
I20260709 12:09:46.591257 26599 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.658707 25610 raft_consensus.cc:3055] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:46.659240 25610 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:46.659652 26599 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.631207 26556 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:46.631600 26754 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:09:46.660656 25610 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:46.634804 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:46.625941 26672 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.225s	user 0.019s	sys 0.007s
I20260709 12:09:46.604215 26734 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:46.662479 25689 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:46.635515 25691 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.568892 26736 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:09:46.641808 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.641116 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.656919 25767 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:46.636080 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 122405us
I20260709 12:09:46.667646 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.667821 26672 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.653959 25763 rpcz_store.cc:276] 0709 12:09:44.787889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.652888 (+1864999us) service_pool.cc:224] Handling call
0709 12:09:46.653189 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.653410 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.653428 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.653464 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:46.653484 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.653523 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.653604 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.670941 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 569) took 1874 ms. Trace:
I20260709 12:09:46.671677 25767 rpcz_store.cc:276] 0709 12:09:44.791515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.656255 (+1864740us) service_pool.cc:224] Handling call
0709 12:09:46.656684 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.665243 (+  8559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.665408 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.662201 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 996) took 1710 ms. Trace:
I20260709 12:09:46.602520 25619 rpcz_store.cc:276] 0709 12:09:45.221131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.506556 (+285425us) service_pool.cc:224] Handling call
0709 12:09:45.506995 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:45.507272 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:45.518399 (+ 11127us) log.cc:844] Serialized 14 byte log entry
0709 12:09:46.566537 (+1048138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.566632 (+    95us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:46.566714 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.566813 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.566988 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40942,"prepare.queue_time_us":10583,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":16010,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3592,"thread_start_us":1047469,"threads_started":2,"wal-append.queue_time_us":275357}
I20260709 12:09:46.666293 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 509) took 2363 ms. Trace:
I20260709 12:09:46.662501 25759 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:09:46.669100 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 53641.1us
I20260709 12:09:46.666189 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:46.662164 25610 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.673043 25617 rpcz_store.cc:276] 0709 12:09:44.951261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.299464 (+348203us) service_pool.cc:224] Handling call
0709 12:09:45.299830 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:45.300231 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:45.300270 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.090613 (+790343us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18000d5040. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a
0709 12:09:46.093073 (+  2460us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b2c000fcb58. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:09:46.094538 (+  1465us) log.cc:844] Serialized 26 byte log entry
0709 12:09:46.298973 (+204435us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:46.308502 (+  9529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.313879 (+  5377us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:46.661784 (+347905us) raft_consensus.cc:1685] finished
0709 12:09:46.661807 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.661985 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":696,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":24853,"spinlock_wait_cycles":15434752,"thread_start_us":193832,"threads_started":1,"wal-append.queue_time_us":340430}
I20260709 12:09:46.655227 26544 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.662349 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 968) took 1473 ms. Trace:
I20260709 12:09:46.641183 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 511) took 2339 ms. Trace:
I20260709 12:09:46.678462 25691 rpcz_store.cc:276] 0709 12:09:44.301197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.626663 (+2325466us) service_pool.cc:224] Handling call
0709 12:09:46.635103 (+  8440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.663393 (+ 28290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.663690 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:46.690440 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49445.3us
I20260709 12:09:46.689327 25762 raft_consensus.cc:2410] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:46.689065 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.691041 25766 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:46.694887 26598 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.695972 25685 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:46.696637 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 523) took 2391 ms. Trace:
I20260709 12:09:46.696965 25685 rpcz_store.cc:276] 0709 12:09:44.305490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.656755 (+2351265us) service_pool.cc:224] Handling call
0709 12:09:46.686474 (+ 29719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.696360 (+  9886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.696573 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.689942 26675 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:46.698359 26556 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:46.701417 25767 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.702322 25764 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:46.702618 25693 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
W20260709 12:09:46.603219 25614 rpcz_store.cc:269] 0709 12:09:44.451191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:44.456575 (+  5384us) service_pool.cc:224] Handling call
0709 12:09:45.219129 (+762554us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5800003398. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:09:46.528603 (+1309474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6724480}
I20260709 12:09:46.707661 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.709435 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.711663 25762 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.712325 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.656845 25688 rpcz_store.cc:276] 0709 12:09:44.301512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.629620 (+2328108us) service_pool.cc:224] Handling call
0709 12:09:46.630246 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.656091 (+ 25845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.656339 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.693086 25761 rpcz_store.cc:276] 0709 12:09:45.184410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.842176 (+657766us) service_pool.cc:224] Handling call
0709 12:09:46.637406 (+795230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.704728 26672 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.691915 25760 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:46.718917 25764 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.719827 25691 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:46.722139 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 103259us
I20260709 12:09:46.723618 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:46.725063 25732 leader_election.cc:400] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5.
I20260709 12:09:46.725435 25732 leader_election.cc:403] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:46.726815 25766 raft_consensus.cc:2410] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:46.727149 25688 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:46.727993 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 531) took 2420 ms. Trace:
I20260709 12:09:46.728338 25688 rpcz_store.cc:276] 0709 12:09:44.307660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.720728 (+2413068us) service_pool.cc:224] Handling call
0709 12:09:46.726846 (+  6118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.727691 (+   845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.727917 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.730463 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.733268 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.735235 26671 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.731046 26723 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.715209 26599 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.738634 26646 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:46.739416 26646 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:46.739964 26646 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.742515 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 588) took 1144 ms. Trace:
I20260709 12:09:46.718429 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:46.745029 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 528) took 2413 ms. Trace:
I20260709 12:09:46.745383 25691 rpcz_store.cc:276] 0709 12:09:44.306938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.708324 (+2401386us) service_pool.cc:224] Handling call
0709 12:09:46.719631 (+ 11307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.720238 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.720385 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.746981 26742 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5.
I20260709 12:09:46.750787 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.751765 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 962) took 1569 ms. Trace:
I20260709 12:09:46.752113 25765 rpcz_store.cc:276] 0709 12:09:45.182340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.750457 (+1568117us) service_pool.cc:224] Handling call
0709 12:09:46.751703 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.753808 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 572) took 1926 ms. Trace:
I20260709 12:09:46.755553 26729 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.754391 25692 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:46.756439 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:46.747056 26753 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:09:46.750978 25685 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:46.754142 25765 rpcz_store.cc:276] 0709 12:09:44.827961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.752834 (+1924873us) service_pool.cc:224] Handling call
0709 12:09:46.753200 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.753481 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.753505 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.753547 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:46.753581 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.753645 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.753749 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.765838 25690 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:46.699522 26304 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:46.778529 25693 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:46.773835 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 64003.6us
I20260709 12:09:46.743001 25760 rpcz_store.cc:276] 0709 12:09:45.597691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.916753 (+319062us) service_pool.cc:224] Handling call
0709 12:09:46.742407 (+825654us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.784241 26672 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:46.786139 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.782035 26675 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:46.793618 26675 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:46.787256 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:46.792459 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:46.795419 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.793120 26599 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:46.793764 26556 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:46.790777 26508 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.786479 26736 raft_consensus.cc:2764] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:09:46.798589 25767 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
W20260709 12:09:46.801499 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 76802.7us
I20260709 12:09:46.788895 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 530) took 2472 ms. Trace:
I20260709 12:09:46.806279 25693 rpcz_store.cc:276] 0709 12:09:44.307424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.707223 (+2399799us) service_pool.cc:224] Handling call
0709 12:09:46.719078 (+ 11855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.779107 (+ 60029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.779403 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.807550 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.808019 25693 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.799710 26556 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:46.780233 26671 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:46.808627 26568 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:46.809595 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 110455us
I20260709 12:09:46.809840 26672 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:46.808660 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 21) took 2156 ms. Trace:
I20260709 12:09:46.810689 26734 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:46.810806 25693 rpcz_store.cc:276] 0709 12:09:44.652426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.807190 (+2154764us) service_pool.cc:224] Handling call
0709 12:09:46.807601 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.808410 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.808605 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.811311 26734 raft_consensus.cc:697] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:46.808679 26556 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.811602 26672 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.812407 26734 consensus_queue.cc:237] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:46.693292 25686 rpcz_store.cc:276] 0709 12:09:44.301765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.639652 (+2337887us) service_pool.cc:224] Handling call
0709 12:09:46.640193 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.640705 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.640747 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.640821 (+    74us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:46.640870 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.640939 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.641070 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":655,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":214}
I20260709 12:09:46.795885 26675 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.815980 26741 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:46.809901 26568 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.822775 26671 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:46.823520 25759 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.825160 25691 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:46.825582 25693 raft_consensus.cc:1240] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:46.825827 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 758) took 2268 ms. Trace:
I20260709 12:09:46.783255 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 732) took 2433 ms. Trace:
I20260709 12:09:46.826187 25691 rpcz_store.cc:276] 0709 12:09:44.557337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.788772 (+2231435us) service_pool.cc:224] Handling call
0709 12:09:46.824881 (+ 36109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.825550 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.825771 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.826179 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 536) took 1624 ms. Trace:
I20260709 12:09:46.828678 25693 rpcz_store.cc:276] 0709 12:09:45.201357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.825076 (+1623719us) service_pool.cc:224] Handling call
0709 12:09:46.825427 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.825953 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.826127 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.832504 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 525) took 2499 ms. Trace:
I20260709 12:09:46.835812 26568 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.836562 25515 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 2 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.839061 25691 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:46.839715 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 538) took 1637 ms. Trace:
I20260709 12:09:46.840041 25691 rpcz_store.cc:276] 0709 12:09:45.201828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.838196 (+1636368us) service_pool.cc:224] Handling call
0709 12:09:46.838662 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.839449 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.839656 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.842801 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:46.842993 25762 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.844419 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:46.845100 25617 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.797215 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 527) took 2490 ms. Trace:
I20260709 12:09:46.846570 25685 rpcz_store.cc:276] 0709 12:09:44.306550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.713447 (+2406897us) service_pool.cc:224] Handling call
0709 12:09:46.750751 (+ 37304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.774756 (+ 24005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.794704 (+ 19948us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.842857 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:46.832878 25689 rpcz_store.cc:276] 0709 12:09:44.306013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.668081 (+2362068us) service_pool.cc:224] Handling call
0709 12:09:46.765731 (+ 97650us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:46.766081 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.799761 (+ 33680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.799793 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.805539 (+  5746us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:46.805579 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.805639 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.805758 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20204800}
W20260709 12:09:46.856541 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49134.7us
I20260709 12:09:46.856675 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.857547 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.858969 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:46.859278 26340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60616 (request call id 58) took 1803 ms (client timeout 1768 ms). Trace:
I20260709 12:09:46.859061 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:46.859864 25766 raft_consensus.cc:2368] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
W20260709 12:09:46.859773 26340 rpcz_store.cc:269] 0709 12:09:45.055760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.065542 (+  9782us) service_pool.cc:224] Handling call
0709 12:09:45.889473 (+823931us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58000d3b98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:09:46.858980 (+969507us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b540054f454. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:46.859201 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174552704}
I20260709 12:09:46.860925 25693 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:46.861204 26599 raft_consensus.cc:2764] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:46.861595 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 539) took 1659 ms. Trace:
I20260709 12:09:46.861375 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.861941 26599 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:46.862351 25691 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:46.862972 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 761) took 1080 ms. Trace:
I20260709 12:09:46.863268 25691 rpcz_store.cc:276] 0709 12:09:45.782226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.840769 (+1058543us) service_pool.cc:224] Handling call
0709 12:09:46.841223 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.862691 (+ 21468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.862913 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.863734 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.862021 25693 rpcz_store.cc:276] 0709 12:09:45.202063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.849658 (+1647595us) service_pool.cc:224] Handling call
0709 12:09:46.860690 (+ 11032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.861344 (+   654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.861541 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.867159 25765 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:46.866851 25582 leader_election.cc:400] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515) with higher term. Message: Invalid argument: T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:46.870118 25582 leader_election.cc:403] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:46.871177 25768 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:46.856643 26529 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.874771 26508 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:46.875737 26508 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.832190 25688 rpcz_store.cc:276] 0709 12:09:44.344429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.729224 (+2384795us) service_pool.cc:224] Handling call
0709 12:09:46.729669 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.729994 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.730040 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.730138 (+    98us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:46.730206 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.767698 (+ 37492us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.777241 (+  9543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.884261 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.885088 25764 raft_consensus.cc:2368] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:46.889178 25517 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 173) took 4669 ms. Trace:
I20260709 12:09:46.889460 25610 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:46.890986 25515 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:46.893385 26646 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.895278 26508 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.895737 26646 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:46.891954 25619 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.886142 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.899412 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.877964 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 571) took 2062 ms. Trace:
I20260709 12:09:46.920318 25762 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:46.924314 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:46.884297 25688 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:46.924336 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:46.931627 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 89392.8us
W20260709 12:09:46.933717 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76255.5us
I20260709 12:09:46.915683 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:46.935560 25612 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:46.937182 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:46.937959 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:46.935652 25764 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 1.
I20260709 12:09:46.923681 26699 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:46.923530 26729 raft_consensus.cc:2764] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:09:46.945412 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 576) took 2058 ms. Trace:
I20260709 12:09:46.944033 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 578) took 2040 ms. Trace:
I20260709 12:09:46.947477 25617 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:46.946108 25767 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:46.948285 25768 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.947144 25765 rpcz_store.cc:276] 0709 12:09:44.880227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.899894 (+2019667us) service_pool.cc:224] Handling call
0709 12:09:46.922818 (+ 22924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.938548 (+ 15730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.938579 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.938625 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:46.938660 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.938749 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.938854 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.950518 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 513) took 2644 ms. Trace:
W20260709 12:09:46.951167 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89976.5us
I20260709 12:09:46.950950 25692 rpcz_store.cc:276] 0709 12:09:44.302297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.643216 (+2340919us) service_pool.cc:224] Handling call
0709 12:09:46.643858 (+   642us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.644295 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.644657 (+   362us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.646042 (+  1385us) log.cc:844] Serialized 572 byte log entry
0709 12:09:46.713661 (+ 67619us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:46.921094 (+207433us) log.cc:844] Serialized 14 byte log entry
0709 12:09:46.946594 (+ 25500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.946674 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:46.946709 (+    35us) raft_consensus.cc:1685] finished
0709 12:09:46.946722 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.946846 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21572,"raft.queue_time_us":25677,"thread_start_us":67177,"threads_started":1,"wal-append.queue_time_us":132333}
I20260709 12:09:46.953975 25692 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:46.958606 25615 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.959599 25760 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:46.960496 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:46.889617 25517 rpcz_store.cc:276] 0709 12:09:42.220045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:42.220172 (+   127us) service_pool.cc:224] Handling call
0709 12:09:46.888878 (+4668706us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:45.110799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:45.132974 (+ 22175us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:45.133015 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:09:45.133034 (+    19us) tablet.cc:662] Decoding operations
0709 12:09:45.133809 (+   775us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:45.133916 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:45.133959 (+    43us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:09:45.134450 (+   491us) tablet.cc:701] Row locks acquired
0709 12:09:45.134479 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:09:45.134677 (+   198us) write_op.cc:270] Start()
0709 12:09:45.134853 (+   176us) write_op.cc:276] Timestamp: P: 1783598985134619 usec, L: 0
0709 12:09:45.134880 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:09:45.199350 (+ 64470us) log.cc:844] Serialized 1380 byte log entry
0709 12:09:46.459517 (+1260167us) op_driver.cc:464] REPLICATION: finished
0709 12:09:46.569715 (+110198us) write_op.cc:301] APPLY: starting
0709 12:09:46.605075 (+ 35360us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:46.656238 (+ 51163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:46.656448 (+   210us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:46.658245 (+  1797us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:46.658745 (+   500us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:09:46.658818 (+    73us) write_op.cc:312] APPLY: finished
0709 12:09:46.659255 (+   437us) log.cc:844] Serialized 34 byte log entry
0709 12:09:46.667772 (+  8517us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:46.667935 (+   163us) write_op.cc:454] Released schema lock
0709 12:09:46.667998 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:46.668544 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:46.668582 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":200210,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":66745,"apply.run_cpu_time_us":4144,"apply.run_wall_time_us":120370,"num_ops":3,"prepare.queue_time_us":210533,"prepare.run_cpu_time_us":4694,"prepare.run_wall_time_us":141462,"replication_time_us":1324291,"thread_start_us":160293,"threads_started":2}]]}
I20260709 12:09:46.960780 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:46.961490 25612 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:46.945318 26699 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:46.965795 26699 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:46.968401 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 521) took 2663 ms. Trace:
I20260709 12:09:46.969264 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 570) took 2154 ms. Trace:
I20260709 12:09:46.970679 25761 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:46.948130 26556 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.971768 25686 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:46.919893 25759 rpcz_store.cc:276] 0709 12:09:44.815268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.712661 (+1897393us) service_pool.cc:224] Handling call
0709 12:09:46.721528 (+  8867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.823986 (+102458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.877651 (+ 53665us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400150254. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:46.877872 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233511296}
I20260709 12:09:46.972892 26556 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:46.968859 25687 rpcz_store.cc:276] 0709 12:09:44.304988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.643615 (+2338627us) service_pool.cc:224] Handling call
0709 12:09:46.643991 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.644440 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.644479 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.645041 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:09:46.708026 (+ 62985us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:46.781608 (+ 73582us) log.cc:844] Serialized 14 byte log entry
0709 12:09:46.787103 (+  5495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.787199 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:46.968141 (+180942us) raft_consensus.cc:1685] finished
0709 12:09:46.968163 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.968331 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5248,"prepare.queue_time_us":126547,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":27516,"raft.queue_time_us":5402,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":243,"thread_start_us":132251,"threads_started":2,"wal-append.queue_time_us":157033}
I20260709 12:09:46.973486 25615 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:46.949807 25766 rpcz_store.cc:276] 0709 12:09:44.896296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.879135 (+1982839us) service_pool.cc:224] Handling call
0709 12:09:46.879538 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.879866 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:46.880188 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:09:46.932493 (+ 52305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.932566 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:46.936579 (+  4013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.936655 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.936789 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6838,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":6483,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":10969,"thread_start_us":45516,"threads_started":1}
I20260709 12:09:46.978820 25768 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:46.979569 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 577) took 2093 ms. Trace:
I20260709 12:09:46.979946 25768 rpcz_store.cc:276] 0709 12:09:44.885950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.873549 (+1987599us) service_pool.cc:224] Handling call
0709 12:09:46.939175 (+ 65626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.979278 (+ 40103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.979511 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.946909 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:46.992874 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:46.973531 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 522) took 2653 ms. Trace:
I20260709 12:09:46.996107 25762 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:47.005468 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 579) took 2089 ms. Trace:
I20260709 12:09:47.006848 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 953) took 1854 ms. Trace:
I20260709 12:09:47.007308 25765 rpcz_store.cc:276] 0709 12:09:45.152032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.978593 (+1826561us) service_pool.cc:224] Handling call
0709 12:09:46.989600 (+ 11007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.006390 (+ 16790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.006435 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.006502 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.006546 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.006644 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.006781 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.005951 25762 rpcz_store.cc:276] 0709 12:09:44.915757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.925981 (+2010224us) service_pool.cc:224] Handling call
0709 12:09:46.958573 (+ 32592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.005109 (+ 46536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.005395 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:46.988512 26556 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:46.952040 26748 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.011216 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 951) took 1860 ms. Trace:
I20260709 12:09:47.024142 25764 rpcz_store.cc:276] 0709 12:09:45.151276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.958369 (+1807093us) service_pool.cc:224] Handling call
0709 12:09:46.997846 (+ 39477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.010861 (+ 13015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.010889 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.010940 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.010973 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.011036 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.011156 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.016016 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.022823 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:47.039844 25619 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:47.041318 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 956) took 1888 ms. Trace:
I20260709 12:09:47.055699 25768 rpcz_store.cc:276] 0709 12:09:45.153049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.986303 (+1833254us) service_pool.cc:224] Handling call
0709 12:09:47.004327 (+ 18024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.040746 (+ 36419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.040779 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.040846 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:47.040898 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.041005 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.041217 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:47.057338 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 73729.2us
I20260709 12:09:47.048411 26699 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.051115 25762 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:47.063325 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 965) took 1879 ms. Trace:
I20260709 12:09:47.063735 25762 rpcz_store.cc:276] 0709 12:09:45.183439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.015238 (+1831799us) service_pool.cc:224] Handling call
0709 12:09:47.050721 (+ 35483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.062828 (+ 12107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.063245 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.058032 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 580) took 1463 ms. Trace:
I20260709 12:09:47.058394 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.060379 25765 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:47.065120 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 963) took 1882 ms. Trace:
I20260709 12:09:47.065511 25765 rpcz_store.cc:276] 0709 12:09:45.182755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.014896 (+1832141us) service_pool.cc:224] Handling call
0709 12:09:47.041561 (+ 26665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.064848 (+ 23287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.065067 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.018126 26671 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.078420 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 954) took 1926 ms. Trace:
I20260709 12:09:47.078962 25767 rpcz_store.cc:276] 0709 12:09:45.152396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.986103 (+1833707us) service_pool.cc:224] Handling call
0709 12:09:47.018179 (+ 32076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.068989 (+ 50810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.077980 (+  8991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.078036 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.078073 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.078138 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.078338 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.061486 25612 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:47.058177 26723 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.064675 25768 rpcz_store.cc:276] 0709 12:09:45.594650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.056899 (+1462249us) service_pool.cc:224] Handling call
0709 12:09:47.057362 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.057640 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.057678 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.057725 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:47.057759 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.057823 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.057951 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:47.082110 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 92241.5us
I20260709 12:09:47.090061 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:47.060794 26508 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515) with higher term. Message: Invalid argument: T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.092576 25614 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:47.119901 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.123459 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 974) took 1937 ms. Trace:
I20260709 12:09:47.123899 25764 rpcz_store.cc:276] 0709 12:09:45.186294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.061666 (+1875372us) service_pool.cc:224] Handling call
0709 12:09:47.109812 (+ 48146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.123162 (+ 13350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.123188 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.123224 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.123242 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.123295 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.123407 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.130345 25768 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:47.131184 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 587) took 1533 ms. Trace:
I20260709 12:09:47.131489 25768 rpcz_store.cc:276] 0709 12:09:45.597405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.087229 (+1489824us) service_pool.cc:224] Handling call
0709 12:09:47.130145 (+ 42916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.130929 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.131128 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.135735 25619 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.136456 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 583) took 1540 ms. Trace:
I20260709 12:09:47.121196 26599 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.137670 25762 rpcz_store.cc:276] 0709 12:09:45.596011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.085040 (+1489029us) service_pool.cc:224] Handling call
0709 12:09:47.122286 (+ 37246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:47.128222 (+  5936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.128264 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:47.135621 (+  7357us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.135727 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.135983 (+   256us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.136364 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:47.144390 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.145347 26646 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.145882 26646 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:47.146922 26646 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.136752 26670 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.116881 26671 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:46.969719 25763 rpcz_store.cc:276] 0709 12:09:44.814632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.669909 (+1855277us) service_pool.cc:224] Handling call
0709 12:09:46.670384 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.670848 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:46.688211 (+ 17363us) log.cc:844] Serialized 14 byte log entry
0709 12:09:46.947939 (+259728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:46.950383 (+  2444us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:46.968933 (+ 18550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.969027 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.969173 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":628,"prepare.queue_time_us":16979,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":12626,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":10022,"thread_start_us":257089,"threads_started":2}
I20260709 12:09:47.121425 26675 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:47.167245 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 109070us
I20260709 12:09:47.143436 26599 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:47.156425 26771 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:09:47.174129 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.150568 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 549) took 1033 ms. Trace:
I20260709 12:09:47.197028 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:47.163405 26670 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:47.197999 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 53814us
I20260709 12:09:47.164705 26746 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:47.233566 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.175275 26599 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.238147 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.201681 26675 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:47.238894 26772 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:09:47.266402 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.273593 26741 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:47.276693 26741 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:47.274747 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.235775 26670 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.294476 26748 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.004325 25694 rpcz_store.cc:276] 0709 12:09:44.305236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.646328 (+2341092us) service_pool.cc:224] Handling call
0709 12:09:46.646766 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.647250 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.647289 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.647822 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:09:46.716653 (+ 68831us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:46.802450 (+ 85797us) log.cc:844] Serialized 14 byte log entry
0709 12:09:46.868634 (+ 66184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:46.865755 (+ -2879us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b180029eae0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:09:46.914622 (+ 48867us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:46.936252 (+ 21630us) raft_consensus.cc:1685] finished
0709 12:09:46.948964 (+ 12712us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:46.958159 (+  9195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73956,"prepare.queue_time_us":115749,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":22280,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"spinlock_wait_cycles":15732608,"thread_start_us":122746,"threads_started":2,"wal-append.queue_time_us":135976}
I20260709 12:09:47.301400 25619 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:47.301692 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.302532 25617 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:09:47.304298 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 99344.2us
I20260709 12:09:47.275281 26699 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.309228 25612 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.310546 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:47.304066 26768 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.151s	user 0.004s	sys 0.000s
I20260709 12:09:47.314311 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:47.336228 25694 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:47.337359 26723 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.273090 26746 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:47.339536 26671 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.332777 25763 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:47.331929 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.345944 25692 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:09:47.353200 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48134.2us
I20260709 12:09:47.355412 25612 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:47.340205 26748 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:47.356570 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:47.352245 26776 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.003s
I20260709 12:09:47.346422 26723 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.356684 26749 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.370896 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 760) took 2812 ms. Trace:
I20260709 12:09:47.371549 25690 rpcz_store.cc:276] 0709 12:09:44.557960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.794544 (+2236584us) service_pool.cc:224] Handling call
0709 12:09:46.815012 (+ 20468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.815632 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.815685 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.816431 (+   746us) log.cc:844] Serialized 26 byte log entry
0709 12:09:47.017580 (+201149us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.021241 (+  3661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.051883 (+ 30642us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.363860 (+311977us) raft_consensus.cc:1685] finished
0709 12:09:47.364811 (+   951us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.368565 (+  3754us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":700,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":185255,"threads_started":1,"wal-append.queue_time_us":302092}
I20260709 12:09:47.371227 25610 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:47.374359 26646 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:47.346730 26741 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.374816 26646 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:47.378978 26646 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.382335 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:47.401998 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:47.397734 25618 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:47.407907 25763 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:09:47.409013 25768 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:47.413757 26723 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.414227 25759 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:47.409797 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 574) took 2530 ms. Trace:
W20260709 12:09:47.414772 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 394445us
I20260709 12:09:47.417448 25582 leader_election.cc:400] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.418354 25582 leader_election.cc:403] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:47.428161 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 552) took 1251 ms. Trace:
I20260709 12:09:47.428577 25691 rpcz_store.cc:276] 0709 12:09:46.177095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.864021 (+686926us) service_pool.cc:224] Handling call
0709 12:09:46.864389 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.922690 (+ 58301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.922869 (+   179us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.929517 (+  6648us) log.cc:844] Serialized 26 byte log entry
0709 12:09:47.098544 (+169027us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:47.133268 (+ 34724us) log.cc:844] Serialized 14 byte log entry
0709 12:09:47.427756 (+294488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.427866 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.427922 (+    56us) raft_consensus.cc:1685] finished
0709 12:09:47.427938 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.428092 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":370077,"prepare.queue_time_us":35072,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1555,"raft.queue_time_us":353290,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":22163,"thread_start_us":118011,"threads_started":1,"wal-append.queue_time_us":196288}
I20260709 12:09:47.434958 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 553) took 1257 ms. Trace:
I20260709 12:09:47.429236 26499 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:47.437793 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 534) took 2237 ms. Trace:
I20260709 12:09:47.437934 26499 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.438328 25686 rpcz_store.cc:276] 0709 12:09:45.200646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.815524 (+1614878us) service_pool.cc:224] Handling call
0709 12:09:46.815916 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.972167 (+156251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.434294 (+462127us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000aad54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:47.437723 (+  3429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357864320}
I20260709 12:09:47.416117 26599 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:47.435433 25693 rpcz_store.cc:276] 0709 12:09:46.177529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.866524 (+688995us) service_pool.cc:224] Handling call
0709 12:09:46.879219 (+ 12695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.938358 (+ 59139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.938413 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.948564 (+ 10151us) log.cc:844] Serialized 26 byte log entry
0709 12:09:47.175064 (+226500us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:47.196885 (+ 21821us) log.cc:844] Serialized 14 byte log entry
0709 12:09:47.354983 (+158098us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b4800241ed8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:09:47.428922 (+ 73939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.428999 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.429040 (+    41us) raft_consensus.cc:1685] finished
0709 12:09:47.434773 (+  5733us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.434903 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285659,"prepare.queue_time_us":21850,"prepare.run_cpu_time_us":195,"prepare.run_wall_time_us":190,"raft.queue_time_us":292828,"raft.run_cpu_time_us":4584,"raft.run_wall_time_us":413580,"spinlock_wait_cycles":9120512,"thread_start_us":200986,"threads_started":1,"wal-append.queue_time_us":263174}
I20260709 12:09:47.446379 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:47.447386 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:47.447569 26723 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.448047 26723 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:47.443253 26785 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:47.448534 26723 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.448114 26667 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:47.448969 26785 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:47.449699 26667 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:47.450099 26667 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.452045 26748 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.452152 26785 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.452766 26672 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.453666 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 590) took 1855 ms. Trace:
I20260709 12:09:47.427263 26556 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.453996 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 551) took 1335 ms. Trace:
I20260709 12:09:47.454051 25764 rpcz_store.cc:276] 0709 12:09:45.598341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.124662 (+1526321us) service_pool.cc:224] Handling call
0709 12:09:47.164119 (+ 39457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:47.237074 (+ 72955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:47.237105 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:47.271740 (+ 34635us) log.cc:844] Serialized 26 byte log entry
0709 12:09:47.351174 (+ 79434us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:47.351234 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.351319 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.453426 (+102107us) raft_consensus.cc:1685] finished
0709 12:09:47.453451 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.453603 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4222,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":28893,"thread_start_us":40919,"threads_started":1,"wal-append.queue_time_us":98210}
I20260709 12:09:47.460664 26556 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.463090 26556 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.463137 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:47.464179 26676 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.464699 26676 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:47.457599 26672 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:47.465945 26676 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.417194 25761 rpcz_store.cc:276] 0709 12:09:44.879651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.864753 (+1985102us) service_pool.cc:224] Handling call
0709 12:09:46.925098 (+ 60345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:46.971177 (+ 46079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.408718 (+437541us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b540030b6d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:47.409540 (+   822us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b540030b6d0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:47.409702 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234527360}
I20260709 12:09:47.459331 26671 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.468663 26671 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.464579 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.476599 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.466300 26672 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.201285 25685 rpcz_store.cc:276] 0709 12:09:46.117225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.847803 (+730578us) service_pool.cc:224] Handling call
0709 12:09:46.848321 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.877652 (+ 29331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.877694 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.878297 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:09:46.939240 (+ 60943us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:46.986127 (+ 46887us) log.cc:844] Serialized 14 byte log entry
0709 12:09:47.013490 (+ 27363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.017785 (+  4295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.150093 (+132308us) raft_consensus.cc:1685] finished
0709 12:09:47.150160 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.150474 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65575,"prepare.queue_time_us":32791,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":29978,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":5410,"spinlock_wait_cycles":52158336,"thread_start_us":51696,"threads_started":1,"wal-append.queue_time_us":176465}
I20260709 12:09:47.457116 25689 rpcz_store.cc:276] 0709 12:09:46.166618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.850693 (+684075us) service_pool.cc:224] Handling call
0709 12:09:46.915273 (+ 64580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.952010 (+ 36737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.952050 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.959867 (+  7817us) log.cc:844] Serialized 26 byte log entry
0709 12:09:47.345705 (+385838us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b18002c2c00. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:09:47.402306 (+ 56601us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:47.433601 (+ 31295us) log.cc:844] Serialized 14 byte log entry
0709 12:09:47.439713 (+  6112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.439830 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.439894 (+    64us) raft_consensus.cc:1685] finished
0709 12:09:47.445400 (+  5506us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.453942 (+  8542us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37070,"prepare.queue_time_us":25032,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":36082,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":17784,"spinlock_wait_cycles":44828032,"thread_start_us":56337,"threads_started":1,"wal-append.queue_time_us":451845}
I20260709 12:09:47.487202 26671 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:47.455122 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 84169.1us
W20260709 12:09:47.491483 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64637.6us
W20260709 12:09:47.500416 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 488279us
I20260709 12:09:47.500022 26736 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:47.499326 26670 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.460196 26785 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:09:47.510571 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.516093 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.519392 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.520162 26729 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.520373 26646 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:47.518074 26670 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.520596 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:47.524641 26599 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:47.526600 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:47.549662 25658 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:47.553331 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 68359.4us
I20260709 12:09:47.544509 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:47.553334 26556 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.567499 26795 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.564415 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.551606 26742 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.566507 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.569484 26795 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.557552 26671 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.573072 26795 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.573221 26671 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:47.574703 26671 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:47.588630 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:47.590806 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71525.3us
W20260709 12:09:47.612916 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49184.8us
I20260709 12:09:47.560185 26748 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.567119 26746 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:09:47.621755 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:47.624410 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:47.617900 26736 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.626524 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.629129 26793 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.629405 25732 leader_election.cc:400] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:47.629822 25732 leader_election.cc:403] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:47.634152 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.636343 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:47.635138 26599 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:47.630541 26723 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.640126 26797 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.640305 26748 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.640661 26798 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:47.641175 25582 leader_election.cc:400] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.641959 26803 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.646407 26599 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:47.647305 26746 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:47.647630 26793 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:47.648058 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 81681.7us
I20260709 12:09:47.648957 25582 leader_election.cc:403] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:47.631923 26742 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:47.650157 26556 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.653263 26748 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:47.661684 26748 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.662464 26797 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.657676 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:47.690958 25732 leader_election.cc:400] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:47.691411 25732 leader_election.cc:403] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:47.648137 26723 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.691951 25582 leader_election.cc:400] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.693074 25582 leader_election.cc:403] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:47.655772 26599 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:47.695286 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71513.9us
I20260709 12:09:47.649857 26803 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:47.654376 26667 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.665787 26499 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.708657 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.709687 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.727555 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.710999 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:47.712611 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:47.712981 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:47.714185 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:47.714352 26742 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.731540 25613 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:47.738651 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:47.741636 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.709088 26723 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.746042 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:47.746321 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 85752.7us
I20260709 12:09:47.747836 25615 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:47.707891 26803 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.754619 26805 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:47.755508 26794 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:47.755945 26794 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:47.756328 26794 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:47.757297 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:47.764277 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.764839 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:47.768056 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:47.744068 26499 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.773343 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:47.694645 26798 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.776006 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 39) took 2712 ms. Trace:
I20260709 12:09:47.766283 26699 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:47.762764 26749 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.765990 26568 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:47.780110 26729 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:47.779161 26646 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:47.782150 26675 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.783463 26723 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:47.784300 26749 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:47.804126 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:47.778291 25515 rpcz_store.cc:276] 0709 12:09:45.057760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:45.057931 (+   171us) service_pool.cc:224] Handling call
0709 12:09:47.770174 (+2712243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:47.154321 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:47.295048 (+140727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:47.295146 (+    98us) write_op.cc:435] Acquired schema lock
0709 12:09:47.295165 (+    19us) tablet.cc:662] Decoding operations
0709 12:09:47.305929 (+ 10764us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:47.306034 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:47.306065 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:09:47.306473 (+   408us) tablet.cc:701] Row locks acquired
0709 12:09:47.306515 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:09:47.306717 (+   202us) write_op.cc:270] Start()
0709 12:09:47.306892 (+   175us) write_op.cc:276] Timestamp: P: 1783598987306645 usec, L: 0
0709 12:09:47.306911 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:09:47.337260 (+ 30349us) log.cc:844] Serialized 984 byte log entry
0709 12:09:47.523118 (+185858us) op_driver.cc:464] REPLICATION: finished
0709 12:09:47.635257 (+112139us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdafc510ac 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb6791ef0
0709 12:09:47.713726 (+ 78469us) write_op.cc:301] APPLY: starting
0709 12:09:47.713817 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:47.713944 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:47.713964 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:47.714413 (+   449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:47.714591 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:09:47.714640 (+    49us) write_op.cc:312] APPLY: finished
0709 12:09:47.714846 (+   206us) log.cc:844] Serialized 28 byte log entry
0709 12:09:47.715025 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:47.715116 (+    91us) write_op.cc:454] Released schema lock
0709 12:09:47.715174 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:47.715537 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:47.715565 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":140301,"reported_tablets":3,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":190303,"apply.run_cpu_time_us":1793,"apply.run_wall_time_us":1789,"num_ops":2,"prepare.queue_time_us":162090,"prepare.run_cpu_time_us":5485,"prepare.run_wall_time_us":208694,"replication_time_us":204803,"spinlock_wait_cycles":9620864,"thread_start_us":249271,"threads_started":2}]]}
I20260709 12:09:47.806314 26749 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.801295 26723 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:47.746795 26793 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.801713 26508 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:09:47.835209 26646 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:47.818329 26568 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.857715 26723 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:47.859045 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:47.855298 26699 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:47.851595 26499 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:47.866370 26805 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:47.880558 26553 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:47.861029 26795 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:09:47.883376 26812 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:09:47.873376 26667 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.877740 26340 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:47.915346 26499 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.908540 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:47.877476 26807 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 12:09:47.915911 26798 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.881810 26599 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.905382 26553 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:47.935029 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 148441us
W20260709 12:09:47.955358 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 94668.8us
I20260709 12:09:47.935925 26553 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:47.960695 25619 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:09:47.961548 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 173049us
I20260709 12:09:47.962549 25615 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:47.961705 25619 pending_rounds.cc:85] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 1
I20260709 12:09:47.964874 25619 pending_rounds.cc:107] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:09:47.965049 25616 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:47.965257 25619 raft_consensus.cc:2889] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:09:47.965821 26809 log.cc:927] Time spent T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:09:47.966436 26699 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:47.955859 26675 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:48.008699 26797 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:47.990087 26568 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.043725 26599 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:48.033763 26340 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:48.047883 26675 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.048900 25614 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.048511 25517 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:48.050035 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:48.043968 26795 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:09:48.053196 26795 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.053310 25517 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:48.055251 25658 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:48.055823 25517 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:48.056034 26672 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:48.058736 26672 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:48.059139 26672 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:48.059988 26746 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.061185 26529 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.061594 26529 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:48.062542 26529 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.044343 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.065599 26825 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.057468 25517 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:48.067633 26742 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:48.069348 26568 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.070412 26805 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.091058 25615 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:48.072327 26556 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.094558 26529 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.098654 26568 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:48.099152 26568 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:48.072703 26670 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.100899 26805 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.101310 26805 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:48.101760 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.102339 26805 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.103724 26805 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.101337 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.104893 25762 raft_consensus.cc:2368] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:48.074954 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.106187 26822 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.106591 25766 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.106788 26822 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.109575 26822 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:48.110358 25765 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:48.068336 25517 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.074417 26820 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:48.079551 25732 leader_election.cc:400] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:48.121682 25732 leader_election.cc:403] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:48.079957 26599 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:48.124519 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47143us
I20260709 12:09:48.126736 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.127450 25761 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:48.128702 26827 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:09:48.130605 26599 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
W20260709 12:09:48.131917 26830 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:09:48.041730 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:48.081985 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.090672 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.067467 26672 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:48.137033 25760 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:48.138614 26823 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.139981 26823 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.140312 26823 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:48.141624 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 339522us
I20260709 12:09:48.042796 26794 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.158883 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.053609 26795 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:48.184535 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.187218 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.187879 25767 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:48.190145 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.190817 25762 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:48.191661 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.192108 25768 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:48.199169 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.205541 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.207043 25759 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:48.208274 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.195008 26803 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.210670 25760 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.212074 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.212280 26803 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.213342 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.189076 26671 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:48.242177 25618 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.214936 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.243525 25767 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:48.234809 25766 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:48.247138 25762 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:48.213975 26794 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.259802 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.151638 26749 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.186188 26499 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:09:48.261626 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.214059 25760 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:48.263367 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.265089 25766 raft_consensus.cc:2368] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 2. Current term is 3.
I20260709 12:09:48.266116 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.263340 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.210179 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.268918 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.215873 26795 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.271174 25760 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:48.259220 26508 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.271593 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.276782 25759 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:48.278684 25766 raft_consensus.cc:2376] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3. Re-sending same reply.
I20260709 12:09:48.278607 26508 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.279528 26676 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.280121 26676 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.278304 26805 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.266917 25615 raft_consensus.cc:2376] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3. Re-sending same reply.
I20260709 12:09:48.241806 26746 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:09:48.272127 25762 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:48.282490 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.214480 26813 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:09:48.215775 26818 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:09:48.281713 26508 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.280710 25515 catalog_manager.cc:5697] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 3, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 3 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:48.251461 26675 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:09:48.220456 26553 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.244138 26734 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:09:48.312296 25762 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:09:48.313998 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 113471us
I20260709 12:09:48.320470 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.321764 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.310966 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.322096 25612 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:48.327524 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.320293 26795 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.338179 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.339306 25613 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.310441 26805 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.347221 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.395618 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.405511 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.332768 26676 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.418087 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.333504 26723 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:48.418480 26836 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:09:48.417724 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.421835 25611 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:48.423895 25693 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:48.404932 26599 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.348961 25761 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:48.426432 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.440549 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.422741 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.455747 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.456975 25691 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:48.463876 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.347508 26823 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.470882 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.471724 25692 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:48.444370 26599 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.477569 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.477558 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.479979 25691 raft_consensus.cc:2368] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:48.478698 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.481248 25615 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:48.475916 26749 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.494310 25612 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:48.495035 25582 leader_election.cc:400] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:48.477384 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.500473 25582 leader_election.cc:403] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:48.503417 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.503450 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.504617 25615 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:48.507297 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:48.496976 26591 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:09:48.511596 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:48.516268 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:48.499814 25614 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:48.513552 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.491868 26723 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:48.497634 26829 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:09:48.523186 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.524228 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:48.501770 26553 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.524291 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.525460 25690 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:48.530242 26508 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:48.531103 26508 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:48.531708 26508 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.531853 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.535655 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.537745 25692 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
W20260709 12:09:48.538188 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.516659 26749 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:48.517874 26803 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:48.517890 26805 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.522243 26667 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:48.543792 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.547000 25692 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:48.547401 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:48.551394 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:48.552529 25582 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:48.552635 26798 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:09:48.553144 26831 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.282s	user 0.000s	sys 0.012s
W20260709 12:09:48.553519 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55146.8us
I20260709 12:09:48.550608 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.556789 26748 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:48.557205 26748 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:48.557574 26748 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:48.559136 26839 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:09:48.560231 26304 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:48.561443 26734 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:48.562958 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:48.565503 26838 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:09:48.566975 26748 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.544988 26803 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:48.546705 26667 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:48.544494 26723 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:09:48.583877 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.584127 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.584668 25693 raft_consensus.cc:2376] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3. Re-sending same reply.
I20260709 12:09:48.574584 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.586215 25692 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:48.591684 25612 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:48.593253 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.555943 26798 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:48.572204 26805 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:48.595747 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.574136 26803 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.602221 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:48.585999 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.579286 26667 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.578406 26748 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.611629 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.608747 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.612962 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.614883 25619 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.614854 25692 raft_consensus.cc:2376] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3. Re-sending same reply.
I20260709 12:09:48.615762 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.594825 26671 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:48.602054 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.600872 26499 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.601421 26805 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:48.594676 26835 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:48.600351 26599 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:48.507697 25761 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:48.771875 25619 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:48.758448 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.607621 26822 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.775316 25693 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:48.775086 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:48.776984 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.632539 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.782223 25617 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:48.752540 26840 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:09:48.610378 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.612582 26734 raft_consensus.cc:697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:48.791669 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.792347 25768 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.793951 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.773377 26805 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.794801 25619 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:48.736658 26844 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.768261 26529 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:48.804606 25693 raft_consensus.cc:1240] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:48.665995 26671 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.779063 26676 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.809437 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.793218 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.643025 26699 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.177s
W20260709 12:09:48.817282 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 231886us
I20260709 12:09:48.824409 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.825318 25619 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:48.816849 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.777707 26499 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.806664 26553 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:48.827272 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.813870 26529 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.780057 26835 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.830763 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.831126 26844 consensus_queue.cc:1059] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:48.832563 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.834717 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.835906 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:48.911954 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.912190 25688 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.837139 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:48.912891 25764 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:09:48.913359 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 76334.3us
I20260709 12:09:48.913725 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.840322 26599 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.856962 26675 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.914647 26599 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.915377 26675 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:48.849926 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:48.865562 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:48.874383 25689 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:48.783742 26822 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.892577 25768 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:48.850174 26803 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.908509 26335 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:48.877487 26823 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.785552 26798 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.813822 26746 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:09:48.931246 26851 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:48.931955 26734 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:48.932785 26508 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.935577 26508 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.936163 26803 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.925495 26848 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.937805 26848 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.938925 26854 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.939361 26854 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:48.940135 26848 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.919301 25762 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:48.940244 26854 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.883980 25694 raft_consensus.cc:2376] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3. Re-sending same reply.
I20260709 12:09:48.941423 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.942104 25762 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.856824 26818 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.917739 26675 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.818678 26676 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.953647 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.954321 25617 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:48.954428 26499 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.955873 26676 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.927981 26748 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:48.958613 26822 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:48.959457 26822 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.960034 26822 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.962468 26796 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:09:48.968407 26825 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.917464 26599 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:48.970351 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.970733 26599 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:48.971480 26820 consensus_meta.cc:287] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.749s	user 0.014s	sys 0.001s
I20260709 12:09:48.971598 26746 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.971416 26599 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.951889 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.951740 26818 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:09:48.969509 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.942396 25616 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:48.941536 25688 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:48.975432 25617 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:48.988891 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.990046 26818 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:48.947925 26749 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:48.990674 26825 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.920292 26736 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:48.991986 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.992202 26736 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.992982 26825 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:48.978600 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 376748us
I20260709 12:09:48.983697 25693 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:48.983816 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:48.996487 25689 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:48.990907 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:48.984704 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.985809 26822 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:48.993832 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:48.998348 25762 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:49.003257 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.005637 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.006455 25762 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.007514 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:49.012050 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.035768 25612 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:49.045396 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:49.004072 25732 connection.cc:256] RPC call timeout handler was delayed by -2.2866131190000942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 12:09:49.047986 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:49.048195 25732 connection.cc:256] RPC call timeout handler was delayed by -1.335604776000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 12:09:48.972316 26746 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:48.977869 26699 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:49.049647 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.053684 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:49.052109 25762 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:49.053524 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:48.978919 26848 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:09:48.999608 26796 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:09:49.059514 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.060016 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:49.013451 26736 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:48.970147 26667 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.061110 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.063393 25767 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:49.065965 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.071529 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.072254 25767 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.021952 26822 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:49.073256 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.074468 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:49.075949 25762 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:49.076894 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.055960 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.080304 25612 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:49.088400 25619 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:49.089651 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1041) took 1393 ms. Trace:
I20260709 12:09:49.090183 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.090829 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:49.086827 26553 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:49.092437 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.093163 26529 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.090060 25618 rpcz_store.cc:276] 0709 12:09:47.696591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.704920 (+  8329us) service_pool.cc:224] Handling call
0709 12:09:47.735958 (+ 31038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:48.242647 (+506689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.089401 (+846754us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540008e154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:49.089580 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129489792}
I20260709 12:09:49.075773 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.062341 26699 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.091058 25691 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:49.070757 26723 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:49.103487 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.096998 25686 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.109331 26860 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.113386 25694 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:49.151723 26671 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.101218 25761 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.159386 26749 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.161038 26749 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.162951 26851 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:49.163378 26851 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.164047 26805 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.164316 26851 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.165504 25613 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:49.165601 26851 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.166246 26508 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.084276 26822 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.168470 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:49.169024 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.169658 25766 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.170528 26822 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:49.171588 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.114547 25617 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:49.118863 26863 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:49.172686 26863 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.174997 26863 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:49.176259 26568 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.177305 26568 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:49.180408 26837 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.700s	user 0.007s	sys 0.009s
I20260709 12:09:49.182027 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.162146 26749 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:09:49.182826 25690 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:49.183887 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.185120 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.186918 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:49.191378 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.191557 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.195647 26672 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:49.121620 26699 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.125758 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.124769 26553 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.123780 25767 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:49.128237 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.134114 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.200433 25765 raft_consensus.cc:2410] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:49.201009 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.202854 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.199214 25688 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.204064 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.204881 25685 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:49.205238 26671 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.110770 26723 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.206872 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.127451 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.100409 26858 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:49.207116 26723 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.207805 26858 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.208321 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.208500 26723 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.208956 25762 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:49.209362 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.209848 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.151623 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.222122 26847 raft_consensus.cc:3055] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:49.222576 26847 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:49.222966 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.223891 25694 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:49.223438 26847 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:49.224637 26847 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.113941 26746 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.201308 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.136123 26835 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.139395 26599 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:49.210427 25759 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:49.224779 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.141033 26667 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.226913 25760 raft_consensus.cc:2410] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:09:49.227308 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60918us
W20260709 12:09:49.199761 26861 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:09:49.230022 26749 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:49.230516 26749 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.231235 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.231422 26749 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.232422 25760 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.233094 26749 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.225936 25765 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.238098 25613 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:49.210148 26858 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:49.212005 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.250846 25692 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:49.213721 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.251845 25689 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.205752 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.254302 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.254904 25685 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.214993 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.256150 25687 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:49.256395 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:49.256685 26854 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.257192 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:49.257365 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:49.257968 25687 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:49.215615 26516 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.214869 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.258214 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:49.260593 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:49.216997 26815 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.238983 25612 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:49.268082 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.270677 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 633) took 1005 ms. Trace:
I20260709 12:09:49.271121 25762 rpcz_store.cc:276] 0709 12:09:48.264894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.269643 (+1004749us) service_pool.cc:224] Handling call
0709 12:09:49.270036 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.270298 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:49.270331 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:49.270379 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:49.270420 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.270491 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:49.270616 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.273818 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 634) took 1008 ms. Trace:
I20260709 12:09:49.274160 25767 rpcz_store.cc:276] 0709 12:09:48.265124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.273109 (+1007985us) service_pool.cc:224] Handling call
0709 12:09:49.273373 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.273531 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:49.273555 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:49.273593 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:49.273621 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.273668 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:49.273764 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.278689 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.279838 25612 raft_consensus.cc:2410] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:49.249183 25766 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:49.255030 25764 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.361021 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.261639 25768 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.262172 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.218585 26699 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.275313 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.290436 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:49.291327 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.291177 26848 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:49.372189 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.292786 25686 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:49.293990 26516 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:49.294694 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51418us
I20260709 12:09:49.337589 26670 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.259114 25694 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:49.389469 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.391301 25766 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.186215 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.301781 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 636) took 1018 ms. Trace:
I20260709 12:09:49.304248 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:49.310067 25687 raft_consensus.cc:1240] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:49.310070 25619 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:49.311728 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.312350 26820 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:49.315218 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.276716 26795 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:49.315560 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 231349us
I20260709 12:09:49.281503 26851 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:49.320211 26803 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:49.330281 26857 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:49.342634 26303 leader_election.cc:336] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.574s (SENT)
I20260709 12:09:49.385908 26667 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:49.367766 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.415284 25618 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.370662 25689 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
W20260709 12:09:49.370534 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 53355.1us
I20260709 12:09:49.415714 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.417023 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:49.374321 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:49.374529 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84178.3us
I20260709 12:09:49.418787 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:49.419360 25764 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:49.335887 26826 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:49.383419 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:49.394101 26845 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.022s	sys 0.044s
I20260709 12:09:49.386983 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:49.297569 26850 log.cc:927] Time spent T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 12:09:49.392727 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:49.405481 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.400652 25762 rpcz_store.cc:276] 0709 12:09:48.283333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.300095 (+1016762us) service_pool.cc:224] Handling call
0709 12:09:49.300641 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.300917 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:49.300963 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:49.301021 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:49.301202 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.301305 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:49.301697 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.436395 25768 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.401100 25693 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:49.411859 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.437391 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.437896 25766 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.438069 25768 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:49.426719 26857 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:49.438786 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.439213 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.439438 25766 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:49.440577 25766 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.296432 25657 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:49.441187 26857 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:49.442571 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 637) took 1130 ms. Trace:
I20260709 12:09:49.445549 25766 rpcz_store.cc:276] 0709 12:09:48.312271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.440093 (+1127822us) service_pool.cc:224] Handling call
0709 12:09:49.440385 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.442196 (+  1811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.442489 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.431106 25611 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:49.447013 25613 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.447140 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.448359 25613 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.448652 25611 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.449601 25613 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.408448 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.450963 25610 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.437960 25688 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:49.452981 25761 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:49.456661 26749 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:49.456947 26820 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.457206 26749 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:49.407963 26851 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:49.457819 25688 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:49.457726 26749 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.420595 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.416965 25619 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.423036 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:49.385407 26848 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.386444 26670 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.345168 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:49.437382 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 94817.6us
I20260709 12:09:49.441267 25768 raft_consensus.cc:2410] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:49.444293 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 638) took 1131 ms. Trace:
I20260709 12:09:49.420075 25767 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:49.427023 26826 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:49.410777 25690 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
W20260709 12:09:49.429898 26845 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.023s	sys 0.045s
I20260709 12:09:49.424604 26803 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:49.485826 25767 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:49.484750 25762 rpcz_store.cc:276] 0709 12:09:48.312536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.443263 (+1130727us) service_pool.cc:224] Handling call
0709 12:09:49.443620 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.443869 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:49.443909 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:49.443973 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:49.444018 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.444090 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:49.444217 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.492681 25764 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:49.505947 25767 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:49.507563 25767 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.486439 25766 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:09:49.471009 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 174687us
W20260709 12:09:49.524427 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 93845us
I20260709 12:09:49.525628 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:49.531241 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.536707 25765 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:09:49.546945 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 129966us
I20260709 12:09:49.547927 25767 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.548072 25762 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.553340 25768 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:49.489531 26671 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.560603 25764 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:49.562631 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.565008 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.566419 25767 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:49.569047 25767 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:49.458253 26851 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:49.482604 25759 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.471005 26699 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.490286 26748 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.501256 26803 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:49.460376 26844 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.131s
W20260709 12:09:49.594879 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.470705 26805 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:49.529165 25761 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:49.600831 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52237.3us
I20260709 12:09:49.604817 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:49.637526 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 218862us
I20260709 12:09:49.472496 26529 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:09:49.472914 26835 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 12:09:49.476063 26825 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
W20260709 12:09:49.603592 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 68956.6us
I20260709 12:09:49.576952 26857 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.559296 26671 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:49.630410 25767 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:49.487346 26826 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.590339 26854 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:49.805276 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:49.755411 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:49.755928 25764 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:49.591516 26867 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:49.752684 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 157356us
W20260709 12:09:49.756085 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 151430us
I20260709 12:09:49.897557 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.759841 25616 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:49.605597 26748 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.904678 26858 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:49.905221 26858 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.905478 26748 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.480824 26670 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.761616 26516 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:49.479607 26848 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.861119 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 643) took 1266 ms. Trace:
I20260709 12:09:49.887454 26699 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:49.638038 26667 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:49.888932 25615 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:09:49.937096 26672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.007s	sys 0.043s
I20260709 12:09:49.644081 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 645) took 1079 ms. Trace:
I20260709 12:09:49.945310 25759 rpcz_store.cc:276] 0709 12:09:48.564839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.481787 (+916948us) service_pool.cc:224] Handling call
0709 12:09:49.482315 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.602579 (+120264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.638168 (+ 35589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.948997 25759 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.472286 26859 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 12:09:49.950891 26859 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:49.951370 26859 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:49.952586 26859 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.916345 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 23) took 1340 ms. Trace:
I20260709 12:09:49.925367 26815 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:09:49.961706 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 324091us
I20260709 12:09:49.895431 25767 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.963075 25583 leader_election.cc:400] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:49.892680 26854 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:49.903940 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.633000 26736 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.614992 26860 consensus_queue.cc:1059] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.248s
W20260709 12:09:49.898630 25760 consensus_meta.cc:287] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.665s	user 0.016s	sys 0.004s
W20260709 12:09:49.921976 26849 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.278s	user 0.007s	sys 0.003s
I20260709 12:09:49.938452 26699 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:49.939630 25764 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.989851 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1026) took 1033 ms. Trace:
I20260709 12:09:49.990434 25764 rpcz_store.cc:276] 0709 12:09:48.956808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.924949 (+968141us) service_pool.cc:224] Handling call
0709 12:09:49.939125 (+ 14176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.989437 (+ 50312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.989770 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.973343 26866 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.410s
I20260709 12:09:49.992604 25764 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:09:49.992836 26869 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.347s	user 0.000s	sys 0.000s
W20260709 12:09:49.993286 25685 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.000s
I20260709 12:09:49.993695 25685 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
W20260709 12:09:49.995954 26749 consensus_meta.cc:287] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.532s	user 0.004s	sys 0.006s
I20260709 12:09:49.996369 26749 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.975013 26854 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.998770 26877 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:49.999264 26877 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:49.999675 26877 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.892020 26553 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:49.926397 26826 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:49.861991 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.902666 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:49.970362 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 214803us
I20260709 12:09:49.975941 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1025) took 1019 ms. Trace:
W20260709 12:09:49.979976 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76135.3us
I20260709 12:09:50.008002 25767 rpcz_store.cc:276] 0709 12:09:48.956524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.894488 (+937964us) service_pool.cc:224] Handling call
0709 12:09:49.894955 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.963373 (+ 68418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.975849 (+ 12476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:50.009506 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.004124 26553 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:50.010773 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:49.933822 25761 rpcz_store.cc:276] 0709 12:09:48.563392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.453801 (+890409us) service_pool.cc:224] Handling call
0709 12:09:49.454128 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:49.748853 (+294725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.829257 (+ 80404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:50.011363 26553 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.012641 26553 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.906759 26748 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.012928 26699 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.015031 26699 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.018702 26736 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.018536 26667 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.003746 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 775) took 1018 ms. Trace:
I20260709 12:09:50.021420 25685 rpcz_store.cc:276] 0709 12:09:48.975475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.205499 (+230024us) service_pool.cc:224] Handling call
0709 12:09:49.994195 (+788696us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:49.983613 25658 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:49.900696 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:49.961216 26858 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:49.956931 26859 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.022913 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.027263 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.031706 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:50.032006 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 43957.2us
I20260709 12:09:50.033069 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:49.982079 26823 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:49.982235 25760 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:50.015198 26883 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:09:50.039089 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.003541 26887 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.043012 26860 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.040827 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.047205 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:09:50.048192 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 150090us
I20260709 12:09:50.049397 25764 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:50.050101 25583 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.051046 26516 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.051244 26860 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.052882 26516 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.053490 26860 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:50.054414 26723 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.054997 26508 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:50.045334 26858 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.055433 26749 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.055812 26858 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:50.035383 26815 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:50.056779 26815 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:50.057189 26815 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.055114 26672 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.058348 26888 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.045666 26885 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:50.060710 26885 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:50.061271 26885 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.056994 26858 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.062582 26858 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.035210 26736 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:09:50.048666 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1024) took 1092 ms. Trace:
I20260709 12:09:50.066632 25760 rpcz_store.cc:276] 0709 12:09:48.956213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.227696 (+271483us) service_pool.cc:224] Handling call
0709 12:09:50.045873 (+818177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:50.070104 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.036005 26746 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:50.070879 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.072808 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.082543 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.050570 26825 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:09:50.050420 26795 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.001s	sys 0.010s
I20260709 12:09:50.054142 26860 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:09:50.088016 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.086297 26823 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:09:50.070549 26568 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.893s	user 0.014s	sys 0.002s
I20260709 12:09:50.047470 26887 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:49.960582 25614 rpcz_store.cc:276] 0709 12:09:48.568250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:48.568408 (+   158us) service_pool.cc:224] Handling call
0709 12:09:48.568821 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:48.579004 (+ 10183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:48.586884 (+  7880us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:48.734496 (+147612us) log.cc:844] Serialized 26 byte log entry
0709 12:09:48.929974 (+195478us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:49.069484 (+139510us) log.cc:844] Serialized 14 byte log entry
0709 12:09:49.091067 (+ 21583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.097950 (+  6883us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:49.296300 (+198350us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:49.651217 (+354917us) raft_consensus.cc:1685] finished
0709 12:09:49.863417 (+212200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:49.908685 (+ 45268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4519,"prepare.queue_time_us":155275,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":13655,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":25149,"spinlock_wait_cycles":20439936,"thread_start_us":204953,"threads_started":2,"wal-append.queue_time_us":249965}
I20260709 12:09:50.078704 26723 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.094381 26746 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:50.097652 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.098348 26825 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:50.070711 26876 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:09:50.086509 26795 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.001s	sys 0.011s
I20260709 12:09:50.080857 26508 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.204914 26795 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.205564 26508 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.116110 26851 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.107367 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:09:50.207402 25617 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:09:50.207589 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 100279us
W20260709 12:09:50.143779 26871 log.cc:927] Time spent T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.672s	user 0.002s	sys 0.000s
I20260709 12:09:50.108589 26860 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:50.110656 26667 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.087208 26749 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:50.123183 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.164019 26529 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:09:50.105764 26872 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.618s	user 0.005s	sys 0.000s
I20260709 12:09:50.117269 25583 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:50.131186 26886 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:09:50.202122 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 104578us
I20260709 12:09:50.106186 26820 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.123246 26516 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:50.166960 26303 leader_election.cc:336] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 2.509s (SENT)
W20260709 12:09:50.207692 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:50.219226 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 102058us
W20260709 12:09:50.220036 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.110083 26803 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.121686 25768 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:50.215406 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.223503 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1023) took 1267 ms. Trace:
I20260709 12:09:50.223902 25768 rpcz_store.cc:276] 0709 12:09:48.955885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.570793 (+614908us) service_pool.cc:224] Handling call
0709 12:09:50.121023 (+550230us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:50.121336 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:50.223067 (+101731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:50.223424 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66278784}
I20260709 12:09:50.215659 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.106561 26889 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:50.217370 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 136829us
I20260709 12:09:50.220118 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.207613 26826 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:50.217995 26797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.002s	sys 0.012s
I20260709 12:09:50.226409 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.210379 26867 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.205837 26795 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.213843 26529 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:50.189433 26815 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.199496 26854 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.113765 26866 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 12:09:50.229965 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:50.237069 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.239553 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:50.240031 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.139406 26723 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.209645 26877 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.233946 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:50.234406 26797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.002s	sys 0.012s
I20260709 12:09:50.230579 26859 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.250792 25583 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.214063 26667 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.228996 26848 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.247639 26867 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:50.257382 26877 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.249008 26749 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.225801 26516 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.232645 26568 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.262329 26885 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.262993 26815 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.167431 26671 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.253011 26876 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:50.264945 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.265102 25614 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:50.250168 26823 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.265575 26897 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:50.299813 26897 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.301219 26897 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.266746 26859 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:50.267212 26529 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.221884 26886 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.269008 26667 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.269678 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 631) took 2005 ms. Trace:
I20260709 12:09:50.303009 26859 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.304754 26886 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.250778 26896 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.303663 25763 rpcz_store.cc:276] 0709 12:09:48.264126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:48.540923 (+276797us) service_pool.cc:224] Handling call
0709 12:09:49.234770 (+693847us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36eee 000000000036eb39 00007fbdb7caa1e0 00007fbdb7d730c4 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:49.235100 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:49.235569 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:49.235602 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:49.236178 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:09:49.421954 (+185776us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:49.422051 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.423184 (+  1133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:50.090765 (+667581us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:50.269411 (+178646us) raft_consensus.cc:1685] finished
0709 12:09:50.269445 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:50.269606 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1330,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":4361,"spinlock_wait_cycles":45131904,"thread_start_us":172831,"threads_started":1,"wal-append.queue_time_us":249520}
I20260709 12:09:50.243861 26894 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.222090 26820 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.307958 26820 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.274555 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:09:50.246716 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 79822.3us
W20260709 12:09:50.311189 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.280562 26848 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.232043 26889 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.291107 26854 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.293533 26516 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.263621 26860 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.328202 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:50.279639 26796 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.298060 26805 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:50.297983 26748 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.234717 26746 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.333932 26805 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.297266 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1018) took 1383 ms. Trace:
I20260709 12:09:50.312139 25615 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.309819 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:50.249375 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.293651 26671 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.306007 26894 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:09:50.344700 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 95400.5us
I20260709 12:09:50.346480 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.308571 26885 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.321872 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:50.303018 26529 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.341435 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.348316 25768 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:50.335691 25762 rpcz_store.cc:276] 0709 12:09:48.913350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.549742 (+636392us) service_pool.cc:224] Handling call
0709 12:09:50.123749 (+574007us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:50.124009 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:50.124497 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:50.124523 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:50.125137 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:09:50.219721 (+ 94584us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:50.291871 (+ 72150us) log.cc:844] Serialized 14 byte log entry
0709 12:09:50.292139 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:50.292221 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:50.292264 (+    43us) raft_consensus.cc:1685] finished
0709 12:09:50.296986 (+  4722us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:50.297185 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1722,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":443,"spinlock_wait_cycles":45428608,"thread_start_us":153874,"threads_started":2,"wal-append.queue_time_us":145623}
I20260709 12:09:50.350032 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.357936 25766 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:50.363454 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.364315 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.315444 26880 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.367849 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:50.368533 25764 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.317802 26803 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.334973 26805 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.372402 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.374061 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.369868 26823 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:50.374598 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64858.8us
I20260709 12:09:50.369953 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:50.315349 26847 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:09:50.336010 26749 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:09:50.369606 26516 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:50.387598 25766 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:50.370747 26854 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:09:50.389961 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.335417 26858 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.358992 26851 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.377241 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.375168 26844 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.381776 26796 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.377653 26568 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:50.376269 26866 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.475355 26866 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.444543 26672 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:09:50.477751 26866 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:50.391979 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.377377 26904 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.478773 26894 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.479223 26904 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.481032 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1094) took 1038 ms. Trace:
I20260709 12:09:50.481578 26904 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:50.340634 26896 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:09:50.458138 26858 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.471916 26844 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:50.484848 26858 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:50.442123 25764 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:09:50.442989 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52719.9us
I20260709 12:09:50.379114 26699 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:09:50.468888 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:50.507308 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 115418us
I20260709 12:09:50.429513 26553 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 12:09:50.393008 26880 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.394533 26815 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:50.487176 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.481462 25617 rpcz_store.cc:276] 0709 12:09:49.442772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.528346 (+ 85574us) service_pool.cc:224] Handling call
0709 12:09:49.571609 (+ 43263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:50.207858 (+636249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:50.480765 (+272907us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400361fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:50.480958 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461683072}
I20260709 12:09:50.390342 26823 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.427625 26825 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:09:50.471876 26568 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:50.472280 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:50.546886 25614 raft_consensus.cc:2368] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:50.547935 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.549000 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.550246 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.540037 26904 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:09:50.553586 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:50.540530 26858 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:50.554900 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.518623 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.490406 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.556074 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:50.556954 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.557299 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.558499 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.503952 26851 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:50.559095 25614 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:50.471153 26736 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:09:50.540079 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.442962 26888 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:09:50.535000 26516 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.544049 26880 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.544781 26568 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:50.560842 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.397564 26848 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.574851 25616 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
W20260709 12:09:50.576823 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 86581.2us
I20260709 12:09:50.519078 26796 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.379524 26867 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:50.602459 25617 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:50.536623 26823 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.620204 26893 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.620904 26893 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:50.622062 26893 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.623947 26893 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.542936 26844 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:50.646667 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69202.5us
I20260709 12:09:50.582679 26815 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.653522 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.654928 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.656044 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:50.578874 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 182303us
I20260709 12:09:50.578207 26699 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
W20260709 12:09:50.668977 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.582952 26516 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.663192 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:50.678165 26905 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:09:50.678444 26796 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.680187 26699 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:50.680557 26699 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:50.681777 26907 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:09:50.681507 26699 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.685840 26699 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:50.643266 26835 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:09:50.683898 26803 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.686988 26803 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.687896 26803 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.689100 26803 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.668442 26911 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:50.691286 26911 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.691666 26911 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.661675 26866 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.670611 26904 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:50.698729 26904 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.699291 26904 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.675792 26889 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:50.648474 26746 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:50.701359 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:50.702277 25690 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:50.671195 26826 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.703213 26826 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.707007 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.652510 26859 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:09:50.709568 26672 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.710085 26672 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:50.710599 26901 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.243s	user 0.000s	sys 0.004s
I20260709 12:09:50.711040 26672 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.712311 26672 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.716866 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1101) took 1158 ms. Trace:
W20260709 12:09:50.719030 26873 log.cc:927] Time spent T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 1.281s	user 0.007s	sys 0.010s
I20260709 12:09:50.721603 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1081) took 1433 ms. Trace:
I20260709 12:09:50.717429 25610 rpcz_store.cc:276] 0709 12:09:49.558240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.266382 (+708142us) service_pool.cc:224] Handling call
0709 12:09:50.266782 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:50.315190 (+ 48408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:50.336659 (+ 21469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:50.340816 (+  4157us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:50.356336 (+ 15520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:50.716336 (+360000us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b540016e9d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:50.716423 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:50.716774 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97883008}
I20260709 12:09:50.726866 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:50.729123 26908 log.cc:927] Time spent T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260709 12:09:50.730289 26859 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.722026 25612 rpcz_store.cc:276] 0709 12:09:49.287878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.288149 (+   271us) service_pool.cc:224] Handling call
0709 12:09:49.288631 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:49.292694 (+  4063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:49.292731 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:49.293280 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:09:49.404086 (+110806us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:49.404140 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:49.404211 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:50.718112 (+1313901us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:50.721175 (+  3063us) raft_consensus.cc:1685] finished
0709 12:09:50.721202 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:50.721515 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3243,"raft.queue_time_us":3358,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":179,"spinlock_wait_cycles":146525952,"thread_start_us":110371,"threads_started":1,"wal-append.queue_time_us":144175}
I20260709 12:09:50.733399 25762 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:50.737116 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 74063.8us
W20260709 12:09:50.738678 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 104748us
W20260709 12:09:50.739856 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 92491.9us
I20260709 12:09:50.743788 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.737874 26670 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.761462 25766 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:50.762730 25764 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:09:50.753803 26303 leader_election.cc:336] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.966s (SENT)
I20260709 12:09:50.765331 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.752720 26826 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.750537 26889 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.798435 25764 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:50.795454 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.745326 26860 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.821928 25762 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:50.823125 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.825233 26894 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:50.827879 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 84195.9us
I20260709 12:09:50.828670 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.827560 26823 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.832271 26877 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:50.833050 26877 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.834754 26919 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.835280 26919 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.836977 26749 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.838080 26667 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:50.841897 26516 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.844892 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:50.841279 26902 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.846487 26902 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.812469 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.837916 26749 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:50.850565 25610 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:09:50.850749 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 97751.8us
I20260709 12:09:50.851214 26910 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.858387 26894 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.861691 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.868953 26918 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.848836 26902 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.838860 26887 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:50.876024 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.877377 26893 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:50.851603 26303 leader_election.cc:336] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 2.053s (SENT)
W20260709 12:09:50.878408 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82893.7us
I20260709 12:09:50.886176 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.818935 26889 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.884562 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.878132 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.888587 26303 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:50.869678 26918 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.898893 26923 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.837901 26919 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.879990 26893 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:50.900624 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.888674 26887 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:50.911193 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.911998 25767 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:50.896862 26529 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:50.882974 26888 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:09:50.918560 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:50.925417 25764 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:50.864161 26877 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.921911 26568 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.922664 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.923748 26904 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:50.924306 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.924444 26886 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.900938 26897 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:50.928493 25762 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:50.932261 26887 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.932498 26847 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.942703 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:50.970201 26825 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.975625 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:50.976029 26825 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:50.959738 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 106339us
I20260709 12:09:50.978535 26825 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:50.943712 25764 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:50.958783 26854 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:50.960454 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:50.965294 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.985116 25762 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:50.914700 26893 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:50.967850 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 43632.6us
I20260709 12:09:50.939325 26529 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:50.971316 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:50.964376 26886 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.971020 26736 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.988631 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.992208 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:50.995335 25689 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.974002 26897 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:50.973634 26867 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:50.980079 26303 leader_election.cc:336] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.729s (SENT)
I20260709 12:09:51.006799 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:50.993839 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.008150 25762 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:50.990237 26795 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.009497 25686 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:51.015125 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.015295 26923 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.016384 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:50.986366 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:50.957569 26844 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:09:50.984434 26854 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:51.003254 26888 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.018229 25764 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:51.001550 26896 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.018834 25689 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:51.003607 26860 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.027906 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.029294 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.031563 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.031762 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:51.033185 26927 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:09:51.033603 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.034431 26867 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.034154 26854 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.034936 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:09:51.035673 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55644.4us
I20260709 12:09:51.040915 25688 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:51.041851 26904 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.043579 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.042093 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.044947 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.045692 25685 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:51.046329 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:50.994560 26891 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:09:51.002063 26736 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.012497 26795 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.017632 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.046499 26889 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.017473 26918 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.035557 26897 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:51.060748 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.060981 26795 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.062388 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.063439 25688 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:09:51.063728 26303 leader_election.cc:336] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 2.114s (SENT)
I20260709 12:09:51.065799 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.065939 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.026119 26888 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.066812 25688 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:51.035559 26854 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.041942 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.048902 25689 raft_consensus.cc:2410] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:09:51.064810 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.049563 26911 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.077169 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.083443 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.065997 26866 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.066036 26803 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:51.099947 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.101234 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.099037 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.105491 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.106223 26888 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.106498 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.109678 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.110638 25685 raft_consensus.cc:2410] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:51.110491 26568 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.114497 26929 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.106348 25686 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:51.121829 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.107594 26911 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.124567 26867 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.124992 26911 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:51.125604 26867 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:51.125967 26867 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:51.106933 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.126835 26867 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.128032 26867 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.129124 26893 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.130873 26890 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.132752 26749 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:51.133306 26749 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:51.129751 25688 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:09:51.134042 25688 pending_rounds.cc:85] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 1
I20260709 12:09:51.091459 26889 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.098326 26904 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.134334 25688 pending_rounds.cc:107] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:09:51.058658 26886 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.059494 26529 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.102587 26860 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.146121 25688 raft_consensus.cc:2889] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:51.118167 26910 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.152704 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.155541 26893 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.139163 26889 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:51.140393 26911 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:51.180240 26911 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.181790 26749 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:51.119786 26803 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.183863 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:51.171788 26910 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:51.172739 26886 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.142174 26904 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:51.176244 26795 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.178891 26889 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.147524 26736 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.201679 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:51.197248 26904 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.209643 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.205435 26736 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.243039 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.199071 26803 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.252315 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:51.252997 26928 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.243633 26337 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:51.257508 26887 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.253633 26736 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.287281 26928 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.289261 26736 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.289760 26928 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.290367 26803 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.204636 25694 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:51.290804 26803 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.243582 26796 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.291270 26803 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.291967 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.292678 25768 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:51.293635 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.255918 26880 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.290612 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.213347 26891 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:51.205106 26919 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:09:51.294238 25768 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:51.303887 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.286201 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:51.296396 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:51.298099 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45857us
I20260709 12:09:51.306133 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.307367 25583 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.307636 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:51.311513 26917 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:09:51.315198 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.317134 25688 raft_consensus.cc:2410] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:09:51.320369 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 198648us
I20260709 12:09:51.326751 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.327466 25692 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:51.325943 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.320358 26888 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:51.332974 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.319306 26877 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.319422 26826 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.320240 26568 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:51.320614 26918 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.314639 26796 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:51.335762 25583 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:51.320739 25763 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:51.332050 26897 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:09:51.347823 25692 raft_consensus.cc:2393] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:51.329164 26891 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:51.337888 26888 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.341293 26918 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:51.377277 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 54385.6us
I20260709 12:09:51.353048 26797 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.350907 26568 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:51.398681 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:51.398986 26899 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.998s	user 0.005s	sys 0.002s
I20260709 12:09:51.361830 26888 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:51.371675 26918 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.343808 26826 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.372256 26941 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.349166 26796 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.398605 26797 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.400967 26795 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.407998 26941 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:51.415369 26940 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:09:51.423223 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.424207 25690 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:51.424299 25685 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:51.416157 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.425841 25763 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:51.406968 26910 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.428274 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:51.407781 26893 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.426205 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.430614 26941 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.435058 26826 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.413739 26797 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.440864 26749 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.441593 26749 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.442042 26749 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.442420 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.443295 25690 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:51.444278 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:51.444660 26934 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:09:51.427147 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.449865 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.450304 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.450616 25687 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:51.451589 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.451691 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.451903 26304 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:51.452181 25687 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.452942 26910 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.453076 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.453359 26910 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.454602 26910 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.432044 26893 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:51.457257 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.434165 25685 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:51.462788 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.463241 25732 leader_election.cc:400] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:51.462770 25687 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:51.464339 25732 leader_election.cc:403] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:09:51.447947 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1114) took 1165 ms. Trace:
I20260709 12:09:51.429396 26891 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.464123 26893 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.464012 26858 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.465565 25614 rpcz_store.cc:276] 0709 12:09:50.275770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.435027 (+1159257us) service_pool.cc:224] Handling call
0709 12:09:51.435425 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:51.435619 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:51.435651 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:51.435697 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:51.435732 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:51.435792 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:51.438614 (+  2822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:51.445431 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.465071 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.475503 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.479615 26858 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:51.482120 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.482969 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.483475 25687 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.484375 26858 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:51.485321 26914 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.674s	user 0.004s	sys 0.001s
I20260709 12:09:51.486045 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.487006 25690 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:51.488030 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:51.490468 26942 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:09:51.490700 26796 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:51.492555 26939 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:09:51.486048 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.489290 25690 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:51.482009 26911 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.496367 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.501057 25762 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
W20260709 12:09:51.501250 26943 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:09:51.502117 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.498799 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:51.507766 26912 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.820s	user 0.000s	sys 0.008s
I20260709 12:09:51.508136 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.502974 26867 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.508992 25613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1110) took 1265 ms. Trace:
I20260709 12:09:51.509372 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.509461 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.510373 25761 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:51.514952 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.515928 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.505733 26904 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.515928 26890 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:09:51.517266 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.517984 26889 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.518990 26904 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.519695 25687 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:51.520120 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.457615 26568 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.523285 25687 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.509383 25613 rpcz_store.cc:276] 0709 12:09:50.243497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.243618 (+   121us) service_pool.cc:224] Handling call
0709 12:09:50.243980 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:50.297644 (+ 53664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:50.297696 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:50.309383 (+ 11687us) log.cc:844] Serialized 26 byte log entry
0709 12:09:50.526412 (+217029us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:50.526474 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:50.526582 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:51.501745 (+975163us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:51.508686 (+  6941us) raft_consensus.cc:1685] finished
0709 12:09:51.508712 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:51.508934 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21054,"raft.queue_time_us":23251,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":28097792,"thread_start_us":186232,"threads_started":2,"wal-append.queue_time_us":268331}
I20260709 12:09:51.537925 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:51.540395 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:51.542248 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.542975 25687 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:09:51.547031 26946 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 12:09:51.547549 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:51.546833 26894 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:51.522990 26890 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.546336 25763 raft_consensus.cc:2410] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:51.545637 26911 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.567093 26889 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.569375 26893 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.556159 26867 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:09:51.560647 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:51.551980 26932 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.535s	user 0.003s	sys 0.000s
I20260709 12:09:51.547087 25690 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.552289 26894 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.575165 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:51.552428 26904 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.571702 26889 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:51.581081 26894 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.579520 26867 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:51.587976 26867 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:51.589896 26867 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.583508 26749 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.583961 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.564402 25761 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:51.573316 26795 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:09:51.571022 26941 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.585877 26889 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:51.601405 26803 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.618392 26795 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:51.619014 26795 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:51.618460 26889 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.616674 26303 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.620211 26795 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.615442 25761 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.622238 26847 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.622041 26303 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.587085 26949 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:09:51.593022 26911 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:51.585481 26858 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.622032 26795 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.616554 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.635493 26889 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.635079 26847 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.642704 26823 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.624914 26918 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.634136 26911 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:51.649977 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:51.652956 25616 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:51.653578 25612 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.652010 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:51.660328 25615 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.644037 25694 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:51.663408 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:51.662789 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:51.666246 25611 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:51.668107 26896 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:51.668601 26896 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.666877 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.671742 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.671898 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:51.672597 25613 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:51.673513 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:51.668532 25690 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.679304 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.679615 25690 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.680168 25693 raft_consensus.cc:2368] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:51.680936 25690 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:51.681354 25693 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:51.685168 25693 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:51.686609 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:51.691100 25583 leader_election.cc:400] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 2 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3.
I20260709 12:09:51.664497 26904 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.693790 26891 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.700237 26749 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.703293 26529 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.706576 26904 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:51.720345 26904 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.693208 26671 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:09:51.694730 26854 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:09:51.710067 26529 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.724906 26529 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.706768 26796 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:09:51.729324 26748 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:51.700771 25690 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:51.718569 26798 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:09:51.732023 26890 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.732824 26890 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.701512 26949 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:09:51.734156 26803 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.701972 26886 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:09:51.732010 25690 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:51.694800 26820 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:09:51.735774 26886 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:51.736146 26886 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:51.733084 26893 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.736256 25692 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.736580 25690 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:51.736725 25768 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:51.737181 26886 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.740113 26888 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.742378 25768 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.742467 25693 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:09:51.747447 25768 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.744451 26888 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.740084 26890 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.744558 26797 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.745178 25688 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:51.752214 26803 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:51.752470 25688 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:51.752812 26803 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.753178 26797 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.753651 25688 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.755863 26803 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.741605 25692 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:51.760460 25692 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:51.761292 25693 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.763944 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.748349 25690 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:51.778658 25690 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:51.779687 25690 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.780804 25690 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.785006 26529 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.789710 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.729944 26748 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:09:51.805361 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:51.805955 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.762045 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:51.773303 26890 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.705171 26835 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.758708 26904 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:51.777994 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.764811 25768 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:51.849102 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.849786 25768 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:09:51.854431 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.767946 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.807302 25766 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:51.857913 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.858762 25766 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:09:51.868249 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 100444us
I20260709 12:09:51.869302 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.874387 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:51.878679 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 116756us
W20260709 12:09:51.885282 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:51.886224 26924 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.880s	user 0.005s	sys 0.000s
I20260709 12:09:51.823562 26889 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 12:09:51.886832 26951 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:09:51.848089 26886 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.887374 26748 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.847920 26670 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:09:51.888533 26748 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.888635 26670 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:51.889065 26670 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:51.803438 26893 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:51.823925 26803 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:09:51.890461 26904 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:51.890753 26952 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:09:51.891278 26885 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.891053 26904 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.825479 25685 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:51.891829 26885 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.893754 26904 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.828811 26887 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:09:51.852643 26918 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.872684 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.895877 25694 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.872330 26835 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.901232 26835 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.904341 26894 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.906592 26529 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.798635 26910 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:51.867304 26820 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:09:51.909022 26910 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.866684 26508 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:09:51.878764 26890 consensus_queue.cc:1243] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:09:51.891495 26941 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.911466 26858 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:51.911852 26858 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:51.913540 26858 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.915562 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:51.916623 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47458.7us
I20260709 12:09:51.920774 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.921955 25762 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:51.923450 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:51.924153 25615 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.924239 25768 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:09:51.930558 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.877110 26854 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.877691 26823 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.889992 26670 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.872136 26798 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:09:51.939430 26854 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.941483 26670 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:51.942018 26340 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:51.943993 26893 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.941442 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.945374 25760 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.933674 26820 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.947477 26820 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.762559 26911 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:51.949669 26820 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.943961 26854 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:51.923511 26529 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.871800 26891 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:09:51.963017 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.963965 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.931692 26553 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:51.967526 25617 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:51.969177 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:51.968729 25768 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:09:51.936622 26904 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:51.972468 26568 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.970610 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:51.976189 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1057) took 1022 ms. Trace:
I20260709 12:09:51.939709 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:51.979755 25615 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:51.981138 25767 rpcz_store.cc:276] 0709 12:09:50.953748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.727759 (+774011us) service_pool.cc:224] Handling call
0709 12:09:51.728165 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:51.728612 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:51.728646 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:51.729257 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 12:09:51.933398 (+204141us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:51.933442 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:51.933524 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:51.975957 (+ 42433us) raft_consensus.cc:1685] finished
0709 12:09:51.975979 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:51.976128 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2984,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":286,"thread_start_us":203733,"threads_started":1,"wal-append.queue_time_us":244548}
I20260709 12:09:51.984704 26508 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:51.959260 26529 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.993860 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:51.970557 26858 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.991858 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.988540 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 685) took 1002 ms. Trace:
I20260709 12:09:51.978185 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:51.989913 26508 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:51.978664 26553 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.005328 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.015394 25768 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.013075 25762 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.015781 25615 raft_consensus.cc:2368] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:52.016465 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 686) took 1030 ms. Trace:
I20260709 12:09:51.981339 26885 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.017423 25768 rpcz_store.cc:276] 0709 12:09:50.986334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.014017 (+1027683us) service_pool.cc:224] Handling call
0709 12:09:52.015076 (+  1059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.016127 (+  1051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.016408 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:52.018946 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.019526 25768 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.989650 25766 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:52.019363 25767 rpcz_store.cc:276] 0709 12:09:50.986039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.987047 (+1001008us) service_pool.cc:224] Handling call
0709 12:09:51.987817 (+   770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:51.988189 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:51.988227 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:51.988279 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:51.988307 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:51.988373 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:51.988483 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":124}
I20260709 12:09:52.022464 25768 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:09:52.023233 25767 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:52.025622 25768 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:51.988608 26894 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:51.994448 25685 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:51.996528 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:51.998149 26529 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.030699 25768 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:52.049386 25768 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:52.059192 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.060285 25615 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:52.039968 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.017572 26553 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:51.993737 26823 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:09:52.068831 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.034467 25690 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:52.076561 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.077889 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.083361 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.084709 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.086534 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.085810 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.092922 25692 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:52.094483 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.095611 25692 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:52.087142 25688 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:52.065480 26835 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.989274 26904 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:52.107829 25762 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:51.994220 26854 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:09:52.119459 25692 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:52.124200 25689 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:52.124912 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.125213 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1109) took 1882 ms. Trace:
I20260709 12:09:52.126930 25619 rpcz_store.cc:276] 0709 12:09:50.243127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.243242 (+   115us) service_pool.cc:224] Handling call
0709 12:09:50.251867 (+  8625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:50.278097 (+ 26230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:50.278149 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:50.290093 (+ 11944us) log.cc:844] Serialized 26 byte log entry
0709 12:09:50.961543 (+671450us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b18003fca60. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:09:50.996596 (+ 35053us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:50.996645 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:51.549294 (+552649us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:52.124874 (+575580us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b540037b4d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:52.124932 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:52.124985 (+    53us) raft_consensus.cc:1685] finished
0709 12:09:52.125000 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.125141 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5831,"raft.queue_time_us":6437,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":4432,"spinlock_wait_cycles":153730176,"thread_start_us":34757,"threads_started":1,"wal-append.queue_time_us":724107}
I20260709 12:09:52.129694 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.132970 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.130944 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.074190 26888 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:52.074090 26918 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.172914 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.098161 26867 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.132045 26835 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.133601 26746 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.169543 25694 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:52.150979 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.186067 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.187453 25619 raft_consensus.cc:2368] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:52.188426 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.170405 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.180495 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.146091 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1055) took 1183 ms. Trace:
I20260709 12:09:52.174479 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.207316 25692 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.143365 26889 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:52.203799 25766 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:52.189771 25616 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:52.208886 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.176723 26749 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.176990 26860 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:52.181180 26671 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:52.229900 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:52.230649 26960 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:09:52.181638 26835 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.204535 26867 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:52.206748 25761 rpcz_store.cc:276] 0709 12:09:50.951436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.623231 (+671795us) service_pool.cc:224] Handling call
0709 12:09:51.626989 (+  3758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:51.635378 (+  8389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:51.635974 (+   596us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:51.665529 (+ 29555us) log.cc:844] Serialized 26 byte log entry
0709 12:09:51.877592 (+212063us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:51.893114 (+ 15522us) log.cc:844] Serialized 14 byte log entry
0709 12:09:52.070603 (+177489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.077190 (+  6587us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:52.098424 (+ 21234us) raft_consensus.cc:1685] finished
0709 12:09:52.098444 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.134766 (+ 36322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1842,"prepare.queue_time_us":1937,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4890,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":3421,"thread_start_us":353382,"threads_started":2,"wal-append.queue_time_us":285678}
I20260709 12:09:52.258787 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.143275 26910 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 12:09:52.184587 26896 consensus_meta.cc:287] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.004s
I20260709 12:09:52.236933 25619 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:52.177520 26902 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:52.204883 26859 raft_consensus.cc:2764] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:09:52.181972 26918 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.209729 26746 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.209527 26889 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.242774 26671 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:52.249135 26957 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:09:52.256865 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 683) took 1340 ms. Trace:
I20260709 12:09:52.257055 26867 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:52.260380 25692 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:52.267946 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.267117 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.236296 26860 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:52.285581 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.285259 25765 rpcz_store.cc:276] 0709 12:09:50.916888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.917014 (+   126us) service_pool.cc:224] Handling call
0709 12:09:50.923144 (+  6130us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:09:50.932669 (+  9525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:50.932700 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:09:50.957311 (+ 24611us) log.cc:844] Serialized 52 byte log entry
0709 12:09:51.856287 (+898976us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180024efe0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:09:52.068916 (+212629us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:52.115640 (+ 46724us) log.cc:844] Serialized 14 byte log entry
0709 12:09:52.123192 (+  7552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.123270 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:52.256537 (+133267us) raft_consensus.cc:1685] finished
0709 12:09:52.256637 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.256792 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40920,"prepare.queue_time_us":51006,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":17903,"raft.run_cpu_time_us":478,"raft.run_wall_time_us":35238,"spinlock_wait_cycles":11458176,"thread_start_us":204704,"threads_started":1,"wal-append.queue_time_us":1216800}
I20260709 12:09:52.269896 25582 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.294302 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.297327 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:52.284085 26889 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:52.319406 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1056) took 1366 ms. Trace:
I20260709 12:09:52.319900 25759 rpcz_store.cc:276] 0709 12:09:50.952608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.672746 (+720138us) service_pool.cc:224] Handling call
0709 12:09:51.673084 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:51.690925 (+ 17841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:51.694971 (+  4046us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:51.735063 (+ 40092us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.013404 (+278341us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:52.016698 (+  3294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.024111 (+  7413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:52.319095 (+294984us) raft_consensus.cc:1685] finished
0709 12:09:52.319128 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.319335 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10976,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7516,"thread_start_us":260080,"threads_started":1,"wal-append.queue_time_us":361673}
I20260709 12:09:52.321259 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 689) took 1179 ms. Trace:
I20260709 12:09:52.321848 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.280428 26902 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.322495 25693 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.323151 25759 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:52.275169 26896 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.325249 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.325588 25759 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.325995 26896 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.300200 26860 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.327652 25759 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:52.328362 26671 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.329459 25759 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:09:52.330652 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71960.8us
W20260709 12:09:52.331008 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.331437 25768 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:52.331489 25732 leader_election.cc:400] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:52.331961 25732 leader_election.cc:403] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:52.332861 25768 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:52.333031 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.334456 26962 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:52.334533 26867 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.335521 26918 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.335637 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:52.281832 26823 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.281994 26826 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.338088 26823 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.338510 26826 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.339443 25762 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:09:52.339821 25762 pending_rounds.cc:85] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 1
I20260709 12:09:52.340049 25762 pending_rounds.cc:107] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:09:52.340283 25762 raft_consensus.cc:2889] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:52.304940 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.340534 26826 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.341499 25760 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:52.341830 26749 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:52.303376 25765 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.333899 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.343456 26796 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.343983 26796 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:52.345136 26723 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:52.345415 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:52.308311 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.346345 26941 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:52.347182 25686 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:52.324175 26902 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.347600 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.347857 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 626) took 1309 ms. Trace:
I20260709 12:09:52.348507 26941 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.348307 25686 rpcz_store.cc:276] 0709 12:09:51.038878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.549787 (+510909us) service_pool.cc:224] Handling call
0709 12:09:52.346748 (+796961us) spinlock_profiling.cc:243] Waited 915 us on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:52.346985 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.347603 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.347799 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2103680}
I20260709 12:09:52.350075 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.351105 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.351588 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.351773 25765 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:52.330025 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.352931 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.311000 26904 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:52.311308 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.312631 26928 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:52.312753 26746 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.314003 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:52.299310 26805 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:09:52.315308 26508 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.313941 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1053) took 1364 ms. Trace:
I20260709 12:09:52.317175 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.315299 26736 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.324150 26797 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.331853 26858 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.390836 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.392282 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.392885 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.392976 26736 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.306789 26848 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:09:52.345557 26723 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:52.395488 26736 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.307380 26553 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.321648 25766 rpcz_store.cc:276] 0709 12:09:51.141772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.021161 (+879389us) service_pool.cc:224] Handling call
0709 12:09:52.021403 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.209629 (+188226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.321007 (+111378us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400249ad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:52.321198 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418983168}
I20260709 12:09:52.408349 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.409724 25615 raft_consensus.cc:2410] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:52.386720 25761 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.411293 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.416531 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.417416 25615 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
W20260709 12:09:52.419059 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.418957 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.300031 26877 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.509466 26877 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.511757 26877 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.512482 25768 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:52.361585 25732 leader_election.cc:400] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:52.513852 25732 leader_election.cc:403] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:52.514191 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:52.514803 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 153377us
I20260709 12:09:52.516651 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.362058 26893 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.365306 25765 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:52.344875 26796 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.366652 26529 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.517777 25768 raft_consensus.cc:2410] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:52.369649 25760 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:52.369877 25685 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:09:52.370502 26835 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.371635 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:52.376669 25693 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:52.337972 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:52.381224 25691 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:09:52.382225 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 112450us
I20260709 12:09:52.340564 26823 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.367560 26749 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.307546 26820 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.397383 25616 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:52.395258 26723 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.390847 26746 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.398595 26797 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:52.401446 26889 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.376538 26928 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:52.403234 26858 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.382607 26891 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.395629 25614 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:52.404392 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1064) took 1216 ms. Trace:
I20260709 12:09:52.579704 25767 rpcz_store.cc:276] 0709 12:09:51.188410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.035677 (+847267us) service_pool.cc:224] Handling call
0709 12:09:52.040735 (+  5058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.041346 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.041389 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.042067 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.287520 (+245453us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:52.287568 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.287643 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:52.403770 (+116127us) raft_consensus.cc:1685] finished
0709 12:09:52.404021 (+   251us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.404279 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":12568,"thread_start_us":157189,"threads_started":1,"wal-append.queue_time_us":293110}
I20260709 12:09:52.580741 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.581537 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:52.582121 25767 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:52.544445 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.414001 25694 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:09:52.305981 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.285944 26888 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:52.421288 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.428136 25687 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.589883 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 627) took 1550 ms. Trace:
I20260709 12:09:52.431367 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.434841 25658 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:52.590232 25687 rpcz_store.cc:276] 0709 12:09:51.039218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.551407 (+512189us) service_pool.cc:224] Handling call
0709 12:09:52.067617 (+516210us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36eee 000000000036eb39 00007fbdb7caa1e0 00007fbdb7d730c4 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:52.067896 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.427859 (+359963us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b540007ea20. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd2dc0 00007fbdb2d5d1c0 00007fbdb2d5e231 00007fbdb2d5ad8f 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c
0709 12:09:52.589646 (+161787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.589828 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201020544}
W20260709 12:09:52.590966 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 156310us
I20260709 12:09:52.592617 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.593410 25687 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:52.593497 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:52.441941 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.594606 25617 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.595347 25767 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:52.595690 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.596395 25617 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:52.596490 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.597155 25767 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:52.597237 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:52.388010 25763 rpcz_store.cc:276] 0709 12:09:50.949194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.594047 (+644853us) service_pool.cc:224] Handling call
0709 12:09:51.594586 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:51.595121 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:51.595172 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:51.595916 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.026855 (+430939us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b180007c3c0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:09:52.212720 (+185865us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:52.215910 (+  3190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.231742 (+ 15832us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:52.313561 (+ 81819us) raft_consensus.cc:1685] finished
0709 12:09:52.313595 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.313870 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1436,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":9301,"spinlock_wait_cycles":16024448,"thread_start_us":159770,"threads_started":1,"wal-append.queue_time_us":695910}
I20260709 12:09:52.444257 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:51.395537 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.450136 26553 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.525337 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.389851 26860 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.457181 26508 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.462363 25517 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 177) took 4803 ms. Trace:
I20260709 12:09:52.467376 26805 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.471267 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 40) took 4202 ms. Trace:
I20260709 12:09:52.478327 25516 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 2, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.480271 26736 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:52.481483 26968 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:52.518537 25613 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:52.522282 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.523995 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:52.553627 25691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 607) took 1580 ms (client timeout 1729 ms). Trace:
W20260709 12:09:52.659471 25691 rpcz_store.cc:269] 0709 12:09:50.972844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.972978 (+   134us) service_pool.cc:224] Handling call
0709 12:09:52.180299 (+1207321us) spinlock_profiling.cc:243] Waited 897 us on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:09:52.553314 (+373015us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5400327154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:52.553555 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232560768}
I20260709 12:09:52.661095 25691 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:09:52.528316 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.544328 25688 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:52.518712 25615 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.539064 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.664132 25762 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.550206 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.526705 25619 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:52.520939 26893 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:52.598634 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:52.577903 25761 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.555382 26304 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.605674 25694 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:52.552593 26820 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.626784 26854 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.610852 26889 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:52.611429 26970 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:09:52.611822 25658 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:52.684552 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 72845.4us
I20260709 12:09:52.615268 26826 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:52.524158 26529 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.620323 25617 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:52.687819 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1134) took 1020 ms. Trace:
I20260709 12:09:52.688242 25617 rpcz_store.cc:276] 0709 12:09:51.666984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.619813 (+952829us) service_pool.cc:224] Handling call
0709 12:09:52.620138 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.687543 (+ 67405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.687760 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:52.689783 25617 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:52.548624 26835 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.685828 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.630784 26888 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.633788 26797 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:52.588862 26886 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:09:52.579319 26891 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:52.700404 25612 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.651620 25760 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.588910 26723 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.637074 25517 rpcz_store.cc:276] 0709 12:09:47.660972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.661184 (+   212us) service_pool.cc:224] Handling call
0709 12:09:52.462250 (+4801066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:48.271887 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:48.272483 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:48.272526 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:09:48.272538 (+    12us) tablet.cc:662] Decoding operations
0709 12:09:48.273199 (+   661us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:48.273251 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:48.273281 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:09:48.274090 (+   809us) tablet.cc:701] Row locks acquired
0709 12:09:48.274118 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:09:48.308400 (+ 34282us) write_op.cc:270] Start()
0709 12:09:48.308608 (+   208us) write_op.cc:276] Timestamp: P: 1783598988293441 usec, L: 0
0709 12:09:48.308644 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:09:48.394034 (+ 85390us) log.cc:844] Serialized 2108 byte log entry
0709 12:09:48.785751 (+391717us) op_driver.cc:464] REPLICATION: finished
0709 12:09:49.144660 (+358909us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdafc510ac 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb6791ef0
0709 12:09:49.637958 (+493298us) write_op.cc:301] APPLY: starting
0709 12:09:49.758813 (+120855us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:49.899280 (+140467us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:49.908745 (+  9465us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:49.996810 (+ 88065us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:49.997016 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:09:49.997061 (+    45us) write_op.cc:312] APPLY: finished
0709 12:09:49.997550 (+   489us) log.cc:844] Serialized 46 byte log entry
0709 12:09:49.997818 (+   268us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:49.997926 (+   108us) write_op.cc:454] Released schema lock
0709 12:09:49.997977 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:50.035060 (+ 37083us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:50.039675 (+  4615us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":175090,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":800074,"apply.run_cpu_time_us":4090,"apply.run_wall_time_us":397264,"num_ops":5,"prepare.queue_time_us":122793,"prepare.run_cpu_time_us":5766,"prepare.run_wall_time_us":144754,"replication_time_us":435069,"spinlock_wait_cycles":7076608,"thread_start_us":739134,"threads_started":2}]]}
I20260709 12:09:52.663172 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.638551 25515 rpcz_store.cc:276] 0709 12:09:48.268987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:48.269185 (+   198us) service_pool.cc:224] Handling call
0709 12:09:52.471170 (+4201985us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:48.438379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:48.439131 (+   752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:48.439174 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:09:48.439202 (+    28us) tablet.cc:662] Decoding operations
0709 12:09:48.443534 (+  4332us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:48.447249 (+  3715us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:48.449596 (+  2347us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:48.467122 (+ 17526us) tablet.cc:701] Row locks acquired
0709 12:09:48.467157 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:09:48.474218 (+  7061us) write_op.cc:270] Start()
0709 12:09:48.480768 (+  6550us) write_op.cc:276] Timestamp: P: 1783598988469358 usec, L: 0
0709 12:09:48.492866 (+ 12098us) op_driver.cc:348] REPLICATION: starting
0709 12:09:48.516267 (+ 23401us) log.cc:844] Serialized 538 byte log entry
0709 12:09:49.600946 (+1084679us) op_driver.cc:464] REPLICATION: finished
0709 12:09:49.964542 (+363596us) write_op.cc:301] APPLY: starting
0709 12:09:49.964651 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:49.964804 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:49.964959 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:49.965261 (+   302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:49.965472 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:49.965547 (+    75us) write_op.cc:312] APPLY: finished
0709 12:09:49.965835 (+   288us) log.cc:844] Serialized 22 byte log entry
0709 12:09:49.966059 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:49.966162 (+   103us) write_op.cc:454] Released schema lock
0709 12:09:49.966214 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:49.980843 (+ 14629us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:49.988245 (+  7402us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2279731,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":358939,"apply.run_cpu_time_us":2144,"apply.run_wall_time_us":8519,"num_ops":1,"prepare.queue_time_us":99891,"prepare.run_cpu_time_us":4845,"prepare.run_wall_time_us":88717,"replication_time_us":1087671,"thread_start_us":329094,"threads_started":1}]]}
I20260709 12:09:52.705099 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.658453 25765 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.708117 25616 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:52.667429 25767 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
W20260709 12:09:52.451756 25583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.729s (SENT) [suppressed 24 similar messages]
I20260709 12:09:52.630043 25759 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:09:52.668148 25764 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:52.573427 26746 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.610458 26796 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:52.678210 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:52.626999 26568 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:09:52.663048 26904 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:52.683851 26970 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.626577 26667 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:09:52.700868 25617 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:52.723628 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45636.4us
W20260709 12:09:52.723186 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:52.720108 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.676110 26858 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:09:52.656992 26805 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.716471 25619 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:52.725833 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:52.695079 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 136558us
I20260709 12:09:52.666873 26736 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.699144 26844 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.683771 26896 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:09:52.723151 26941 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.757201 26941 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.757654 26941 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.723588 26970 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:52.663130 26968 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:52.706321 26891 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.733613 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:52.726596 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 109885us
I20260709 12:09:52.735881 25619 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:52.683290 26902 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:09:52.785645 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.790678 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:52.791990 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:52.793404 25694 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:52.795506 25688 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.710117 26893 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.715771 26529 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.727836 26918 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:09:52.725117 26904 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.750954 25516 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.667807 26928 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.754551 26984 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.702091 26886 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:52.767464 25611 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:52.772373 25616 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:52.786068 26844 raft_consensus.cc:697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:52.723843 26894 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.723718 26911 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:52.782218 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 330491us
I20260709 12:09:52.784519 25619 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:52.739171 26962 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:09:52.796571 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:52.740047 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54259.7us
I20260709 12:09:52.840056 25658 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:52.765506 26797 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:52.802248 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:52.843158 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55348.9us
W20260709 12:09:52.807844 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:52.844003 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.822393 25691 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:52.830133 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 96625.9us
W20260709 12:09:52.837218 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.809551 26826 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:52.771099 26949 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:52.845484 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.808943 26854 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:52.788951 26926 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:09:52.848505 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.848702 25619 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:52.812677 26893 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:52.810221 26795 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:09:52.825409 26984 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.854205 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1135) took 1180 ms. Trace:
I20260709 12:09:52.805284 26796 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:09:52.824224 26749 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:52.867609 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:52.846714 26975 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:09:52.829720 26886 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:52.849831 26805 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.851459 26949 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:52.838390 26894 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.866746 26962 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:09:52.834683 26670 consensus_queue.cc:1175] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "04e6206f9e924fb3931891bf3a64b392" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:09:52.880709 26860 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:52.842389 26911 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:52.881377 26984 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:52.928785 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.909951 26902 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:09:52.953426 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73327.6us
I20260709 12:09:52.954417 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.954322 25516 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.960438 25516 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.930648 26797 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:52.968922 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:52.945017 26736 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.928438 26885 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:09:52.945436 26820 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:52.955472 26926 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:52.965761 25516 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.912047 26844 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:53.017824 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:53.025416 25516 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.027637 26797 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.028065 26999 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:09:53.031366 26894 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:52.957577 26949 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.003438 26997 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:52.996043 26796 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.938638 26854 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.047080 25516 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.016747 26998 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:53.016300 26994 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.078614 25516 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.023483 26902 consensus_queue.cc:1059] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:09:52.956331 26893 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:53.045923 26805 consensus_queue.cc:1175] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c781e437472a42e2a6162b67b1c7bbbd" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
W20260709 12:09:53.097288 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 79566.2us
W20260709 12:09:53.091979 26996 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:09:53.069803 26826 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:53.111629 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.107523 26904 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:53.096503 26986 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:09:53.110970 25516 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.092440 26998 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.125093 26998 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.103855 26796 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:53.127736 26968 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:53.102895 26949 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.112491 26894 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.103466 26997 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:53.125102 26826 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.139436 25516 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.138213 26902 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:09:53.108211 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 215745us
I20260709 12:09:53.149892 25516 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:53.171344 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 326116us
W20260709 12:09:53.181329 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 313299us
I20260709 12:09:53.185969 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:53.191083 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:53.192318 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:53.110705 26994 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.152346 26902 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:53.184942 26749 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:53.199550 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:53.144821 26894 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:53.200333 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86871.7us
I20260709 12:09:53.216324 27002 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:53.217557 26894 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.217646 26858 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 12:09:53.218629 26991 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:09:53.218902 26867 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.222851 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.224381 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1137) took 1499 ms. Trace:
I20260709 12:09:53.224488 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.224896 25614 rpcz_store.cc:276] 0709 12:09:51.724859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.657778 (+932919us) service_pool.cc:224] Handling call
0709 12:09:52.698852 (+ 41074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.770755 (+ 71903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.774797 (+  4042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.846891 (+ 72094us) log.cc:844] Serialized 26 byte log entry
0709 12:09:53.003974 (+157083us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.017766 (+ 13792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.034851 (+ 17085us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:53.224146 (+189295us) raft_consensus.cc:1685] finished
0709 12:09:53.224177 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.224317 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15402,"raft.queue_time_us":42855,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":16842,"thread_start_us":67009,"threads_started":1,"wal-append.queue_time_us":261764}
I20260709 12:09:53.226466 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.227120 25688 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:53.227238 25614 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:53.200766 25732 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:53.227627 25614 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:53.228081 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.233060 25688 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:53.173431 26911 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.235906 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:52.876543 25610 rpcz_store.cc:276] 0709 12:09:51.673395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.615207 (+941812us) service_pool.cc:224] Handling call
0709 12:09:52.615622 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.615851 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:52.707481 (+ 91630us) log.cc:844] Serialized 14 byte log entry
0709 12:09:52.853761 (+146280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:52.853846 (+    85us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:52.853912 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.853992 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.854135 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13200,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":57449,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":185157,"threads_started":2,"wal-append.queue_time_us":235290}
I20260709 12:09:53.240532 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.229928 25614 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.242376 25614 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.183019 26859 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:53.221246 26886 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.251886 26886 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:53.253255 25616 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:09:53.217633 27006 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:53.259294 26858 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:53.259480 27006 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.263032 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.197311 26904 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:53.213842 26968 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.272810 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:53.244724 26867 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:53.414302 26820 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.414814 25688 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:53.415853 26508 consensus_meta.cc:287] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.781s	user 0.012s	sys 0.000s
I20260709 12:09:53.416896 25688 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:53.416610 26902 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:53.418545 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 147951us
W20260709 12:09:53.406975 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:53.410749 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 225847us
W20260709 12:09:53.411906 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.244918 26926 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:53.423318 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:53.436437 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 199528us
I20260709 12:09:53.438371 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:53.440649 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:53.265301 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:53.269877 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:53.212958 26796 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.460745 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:53.336462 27004 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:53.422043 26911 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:53.494436 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57194.1us
I20260709 12:09:53.493966 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:53.336695 26983 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:53.271646 27006 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:53.418792 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 220215us
I20260709 12:09:53.443295 26902 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:53.480434 26986 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:09:53.468717 26904 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.450230 26860 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:53.478901 26820 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:53.539192 25614 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:09:53.262036 26997 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.246s
I20260709 12:09:53.479233 26867 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.550565 25614 pending_rounds.cc:85] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 1
I20260709 12:09:53.562170 25614 pending_rounds.cc:107] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 12:09:53.533124 26941 consensus_meta.cc:287] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.005s
I20260709 12:09:53.562534 25614 raft_consensus.cc:2889] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:53.486533 25690 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:53.508498 26508 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:53.505270 26983 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.448932 26968 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.468290 27002 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
W20260709 12:09:53.538936 26723 consensus_meta.cc:287] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.829s	user 0.005s	sys 0.013s
I20260709 12:09:53.547669 26749 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:09:53.564038 26972 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:09:53.560885 26893 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:53.561239 26820 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:53.544081 26797 consensus_queue.cc:1059] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:53.573849 26886 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:53.509428 26911 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.560890 26858 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:53.580994 26749 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.503152 27004 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.511749 27001 consensus_queue.cc:1059] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:09:53.569181 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1150) took 1226 ms. Trace:
I20260709 12:09:53.609612 25614 rpcz_store.cc:276] 0709 12:09:52.342536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.226810 (+884274us) service_pool.cc:224] Handling call
0709 12:09:53.227111 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.568632 (+341521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.569080 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:53.575387 26848 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:09:53.593962 26820 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:53.597939 26891 consensus_meta.cc:287] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.008s
I20260709 12:09:53.561766 26860 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.549682 26904 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.570243 26941 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.591104 25692 raft_consensus.cc:2410] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:53.567860 26867 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.611124 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:53.625319 26860 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:53.625909 27000 log.cc:927] Time spent T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.484s	user 0.000s	sys 0.005s
W20260709 12:09:53.626447 26998 consensus_meta.cc:287] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.501s	user 0.003s	sys 0.008s
I20260709 12:09:53.626870 26998 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.563665 27007 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:53.629856 25693 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:09:53.576078 26983 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.632098 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1153) took 1233 ms. Trace:
I20260709 12:09:53.632587 25611 rpcz_store.cc:276] 0709 12:09:52.398546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.411017 (+ 12471us) service_pool.cc:224] Handling call
0709 12:09:53.631894 (+1220877us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540021d754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:53.632019 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409152256}
I20260709 12:09:53.594748 26886 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:53.614513 25767 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.633309 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:53.606990 26749 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.603855 26893 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.637588 26994 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.608036 26858 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.639092 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1146) took 1634 ms. Trace:
I20260709 12:09:53.640017 26968 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:53.644774 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:53.637001 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 705) took 1831 ms. Trace:
I20260709 12:09:53.653484 25616 rpcz_store.cc:276] 0709 12:09:52.004589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.825991 (+821402us) service_pool.cc:224] Handling call
0709 12:09:52.847304 (+ 21313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.253923 (+406619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.638832 (+384909us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001e0ad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:53.639025 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932919040}
I20260709 12:09:53.682768 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:53.683782 25765 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:53.625958 26860 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.708266 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:53.711344 25614 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:53.712229 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 216090us
I20260709 12:09:53.722364 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:53.731158 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:53.622736 26891 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:53.722965 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:53.706837 26994 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:53.745893 26886 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.757310 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:53.769335 25616 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:53.771296 25618 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:53.772868 26886 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:53.729972 26860 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.772382 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 828) took 1195 ms. Trace:
I20260709 12:09:53.793836 25616 rpcz_store.cc:276] 0709 12:09:52.576914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.747524 (+1170610us) service_pool.cc:224] Handling call
0709 12:09:53.768896 (+ 21372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.769844 (+   948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.772303 (+  2459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:53.782653 25614 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:53.805675 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.789938 26891 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:53.823083 26891 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.824747 26891 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.825521 26904 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.835506 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 669) took 1358 ms. Trace:
I20260709 12:09:53.836529 26904 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.837534 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1089) took 1326 ms. Trace:
I20260709 12:09:53.729889 27010 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:09:53.682051 25759 rpcz_store.cc:276] 0709 12:09:51.805549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.351602 (+546053us) service_pool.cc:224] Handling call
0709 12:09:52.374590 (+ 22988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.715662 (+341072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.636661 (+920999us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400165654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:53.636919 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528665344}
I20260709 12:09:53.850432 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:53.851254 27004 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:53.851737 25759 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:53.852826 25616 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:53.808475 25614 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:53.838025 25768 rpcz_store.cc:276] 0709 12:09:52.511251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.681814 (+170563us) service_pool.cc:224] Handling call
0709 12:09:52.710554 (+ 28740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.710836 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.710882 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:52.710945 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:52.710991 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.711064 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.837285 (+1126221us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b540024aed0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:53.837454 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65277312}
I20260709 12:09:53.836123 25687 rpcz_store.cc:276] 0709 12:09:52.469039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.608648 (+139609us) service_pool.cc:224] Handling call
0709 12:09:52.609042 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.802429 (+193387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.802481 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:52.802548 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:52.802596 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.827141 (+1024545us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400267854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:53.827210 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.827387 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443915648}
I20260709 12:09:53.763092 26998 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:53.812448 26860 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.837111 26904 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.766664 26994 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:53.828299 26997 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:09:54.096709 25764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1078) took 1969 ms (client timeout 1924 ms). Trace:
W20260709 12:09:54.028290 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 538030us
W20260709 12:09:54.110654 25764 rpcz_store.cc:269] 0709 12:09:52.127326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.392564 (+265238us) service_pool.cc:224] Handling call
0709 12:09:54.096346 (+1703782us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540030c5d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:54.096481 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631104384}
I20260709 12:09:54.109773 26568 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:53.912050 27006 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:53.915959 26820 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.085672 27032 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:54.060263 26902 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.001s
I20260709 12:09:53.806005 27024 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:53.912804 26858 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:53.992336 25688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.019s	sys 0.023s
W20260709 12:09:54.148082 25688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.025s	sys 0.025s
I20260709 12:09:53.902501 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1091) took 1382 ms. Trace:
I20260709 12:09:54.035658 27002 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.968147 26891 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.043298 25658 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:54.111159 26997 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.116982 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:54.092375 26553 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:54.120187 27003 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:09:54.185555 25582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.016s	sys 0.048s
I20260709 12:09:54.125496 25694 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:09:54.186028 25582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.016s	sys 0.048s
I20260709 12:09:54.125993 26671 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.095877 26896 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.089457 25514 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132), now has a pending config: VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129), VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130), VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131), VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 3 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:54.149035 25762 rpcz_store.cc:276] 0709 12:09:52.520559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.703270 (+182711us) service_pool.cc:224] Handling call
0709 12:09:53.901450 (+1198180us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:09:53.901728 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.901941 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.901980 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.902047 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:53.902094 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.902203 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.902405 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6848256}
W20260709 12:09:54.031220 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.911101 26941 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.915572 26746 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.127357 26994 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:53.869160 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:53.916069 25612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1147) took 1574 ms (client timeout 1827 ms). Trace:
I20260709 12:09:53.972595 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 672) took 1502 ms. Trace:
I20260709 12:09:53.856769 25767 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:53.943040 25615 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:53.892807 26911 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:54.150362 27024 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.160638 26823 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.213244 25768 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:54.161111 26918 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.161267 27006 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.161468 26926 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.161788 26997 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:54.161898 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 118710us
I20260709 12:09:54.157823 26858 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.147842 26568 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:54.114439 26928 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.163009 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:54.162163 26968 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:54.158550 27032 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:54.165527 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:54.161285 26820 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:54.166426 25618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59338 (request call id 26) took 1915 ms (client timeout 2105 ms). Trace:
W20260709 12:09:53.856142 26970 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.091s	user 0.015s	sys 0.000s
W20260709 12:09:54.186832 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 692936us
W20260709 12:09:53.969959 26993 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 1.094s	user 0.000s	sys 0.002s
W20260709 12:09:53.943311 26949 consensus_meta.cc:287] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.004s
W20260709 12:09:53.908113 26977 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 1.308s	user 0.007s	sys 0.011s
W20260709 12:09:53.912032 26984 consensus_meta.cc:287] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.973s	user 0.007s	sys 0.006s
I20260709 12:09:54.190182 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:54.238895 27006 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:53.870216 26748 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:54.097380 26749 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.059092 26736 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:09:53.910791 26867 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:53.934247 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:54.203238 25514 catalog_manager.cc:5697] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 2 to 4, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:54.230324 26918 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.240068 26858 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.025398 26987 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.040587 26983 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.283741 26748 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:09:54.299600 27036 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:09:54.168810 26860 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.213807 25689 rpcz_store.cc:276] 0709 12:09:52.470286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.621070 (+150784us) service_pool.cc:224] Handling call
0709 12:09:52.621358 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.789952 (+168594us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:53.147359 (+357407us) log.cc:844] Serialized 14 byte log entry
0709 12:09:53.179589 (+ 32230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.179659 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:53.179703 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.971635 (+791932us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800395f20. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419
0709 12:09:53.972265 (+   630us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002d3054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:53.972330 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.972511 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6975,"prepare.queue_time_us":61510,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2765,"raft.queue_time_us":122,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"spinlock_wait_cycles":420525696,"thread_start_us":364593,"threads_started":2,"wal-append.queue_time_us":32189,"wal-append.run_cpu_time_us":1498,"wal-append.run_wall_time_us":1006148}
I20260709 12:09:54.218825 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:54.213563 25612 rpcz_store.cc:269] 0709 12:09:52.341609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.391875 (+ 50266us) service_pool.cc:224] Handling call
0709 12:09:52.444103 (+ 52228us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b5800003398. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36eee 000000000036eb39 00007fbdb7caa1e0 00007fbdb7d730c4 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:09:53.915863 (+1471760us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b54003610d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:53.915999 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231065088}
I20260709 12:09:54.185720 27003 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:54.201624 26896 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:54.188638 26553 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:54.207860 26671 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:54.220065 25763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 719) took 1658 ms (client timeout 1941 ms). Trace:
I20260709 12:09:54.167498 27002 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.213512 27034 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.213218 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:54.290412 27006 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.223637 26911 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:54.245187 25618 rpcz_store.cc:269] 0709 12:09:52.250982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.391927 (+140945us) service_pool.cc:224] Handling call
0709 12:09:54.166211 (+1774284us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540021c854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:54.166362 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3169971072}
I20260709 12:09:54.248672 25582 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:54.358894 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 110346us
I20260709 12:09:54.279783 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:54.237296 26941 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.293859 27031 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.247500 25687 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:09:54.241062 26305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.029s
I20260709 12:09:54.243961 26968 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.286010 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:54.230124 26823 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.243726 25690 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:54.384249 26671 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.384858 26671 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.029626 26985 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.238514 26926 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.292558 27030 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.299127 25759 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:54.295015 25514 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:54.310168 25762 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:54.311761 25689 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:09:54.313175 25583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.010s	sys 0.037s
W20260709 12:09:54.402619 25583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.010s	sys 0.037s
I20260709 12:09:54.301177 26867 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.367056 26820 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:09:54.346400 26854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.018s	sys 0.026s
I20260709 12:09:54.220690 26994 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.310375 26904 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:54.249632 26970 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.355286 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1082) took 1849 ms. Trace:
I20260709 12:09:54.384249 26823 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:54.324851 26723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.031s
I20260709 12:09:54.288944 26984 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.375617 26748 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:54.367655 26305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.010s	sys 0.029s
I20260709 12:09:54.380986 26968 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.387253 25694 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:54.377671 26941 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:54.385735 26671 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.317034 26860 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.354703 25685 raft_consensus.cc:2376] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
I20260709 12:09:54.469776 25691 raft_consensus.cc:2368] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
W20260709 12:09:54.390127 25567 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.023s	sys 0.023s
I20260709 12:09:54.354314 27034 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:54.441110 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:54.428318 26854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.019s	sys 0.026s
W20260709 12:09:54.322964 25763 rpcz_store.cc:269] 0709 12:09:52.556660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.679552 (+122892us) service_pool.cc:224] Handling call
0709 12:09:54.116677 (+1437125us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:09:54.215268 (+ 98591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18574080}
I20260709 12:09:54.387655 26902 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:09:54.368377 26911 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.433597 26877 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:54.393620 26896 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.460665 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 836) took 1216 ms. Trace:
I20260709 12:09:54.513602 25692 rpcz_store.cc:276] 0709 12:09:53.244737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.262629 (+ 17892us) service_pool.cc:224] Handling call
0709 12:09:54.460431 (+1197802us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400327654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:54.460596 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":738633472}
W20260709 12:09:54.440330 26723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.014s	sys 0.031s
I20260709 12:09:54.413805 26820 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.427521 26796 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.299707 26987 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.396540 26985 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.391219 27003 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.408847 27030 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:54.430207 25766 rpcz_store.cc:276] 0709 12:09:52.505560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.518402 (+ 12842us) service_pool.cc:224] Handling call
0709 12:09:52.518778 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.522001 (+  3223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.522032 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.522657 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.601610 (+ 78953us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:52.601651 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.601732 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:53.907436 (+1305704us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:54.326577 (+419141us) raft_consensus.cc:1685] finished
0709 12:09:54.326614 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.355208 (+ 28594us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":17996672,"thread_start_us":78546,"threads_started":1,"wal-append.queue_time_us":59225}
I20260709 12:09:54.481384 26826 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.378803 27031 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.456002 26823 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.458375 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1098) took 1017 ms. Trace:
W20260709 12:09:54.527948 27035 log.cc:927] Time spent T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:09:54.522469 26820 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.427249 26867 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.457481 26805 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:09:54.532164 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 837) took 1287 ms. Trace:
I20260709 12:09:54.512583 26877 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:54.476708 26748 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.518424 26749 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:54.510500 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 274758us
I20260709 12:09:54.492084 25610 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.526043 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:54.536756 26894 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.496853 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:09:54.477934 25567 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.023s	sys 0.024s
I20260709 12:09:54.432873 26994 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.536552 25688 rpcz_store.cc:276] 0709 12:09:53.245023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.417916 (+172893us) service_pool.cc:224] Handling call
0709 12:09:53.418440 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:53.419528 (+  1088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.419581 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:53.420310 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.148690 (+728380us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:54.148757 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.148865 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:54.531884 (+383019us) raft_consensus.cc:1685] finished
0709 12:09:54.531908 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.532085 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":223,"thread_start_us":727894,"threads_started":1,"wal-append.queue_time_us":868386}
I20260709 12:09:54.539827 26858 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:54.541158 27003 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.562902 25766 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.527556 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:54.524994 26796 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.539505 27032 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.550000 26896 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:54.575347 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:54.553234 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1105) took 1043 ms. Trace:
I20260709 12:09:54.555554 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:54.587308 25658 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:54.538780 26826 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.571270 26880 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:54.611356 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:54.580113 27006 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.579139 26749 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.539717 26823 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:54.624347 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:54.575413 27038 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.578696 27004 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.623157 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:54.630072 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:54.633512 25612 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:54.635247 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:54.636037 25612 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.612864 26902 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:54.639998 25766 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:54.623878 26880 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.610299 26926 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.617864 26723 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.628425 27006 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.645831 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:54.643095 26984 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.613323 27002 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:54.649968 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 464681us
I20260709 12:09:54.611123 26736 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:09:54.579402 26894 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.644794 26902 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:54.624516 25763 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:54.629540 26918 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.531018 25761 rpcz_store.cc:276] 0709 12:09:53.440502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.445318 (+  4816us) service_pool.cc:224] Handling call
0709 12:09:53.562289 (+116971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.578617 (+ 16328us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:54.018638 (+440021us) log.cc:844] Serialized 14 byte log entry
0709 12:09:54.393478 (+374840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.397976 (+  4498us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.409572 (+ 11596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.431086 (+ 21514us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.455823 (+ 24737us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":649539,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":42,"raft.queue_time_us":2035,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":16522,"thread_start_us":745910,"threads_started":2,"wal-append.queue_time_us":514358}
W20260709 12:09:54.661873 27046 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:09:54.672976 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:54.688763 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:54.585686 26877 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.710094 25766 raft_consensus.cc:2410] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:54.661296 26941 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:54.629276 26749 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.661502 26671 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.670188 26970 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.640064 27004 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.684296 27006 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.639724 27038 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:54.869477 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:54.752512 25731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.023s	sys 0.007s
I20260709 12:09:54.733043 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1100) took 1290 ms. Trace:
W20260709 12:09:54.970588 25731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.027s	sys 0.008s
W20260709 12:09:54.969502 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 280861us
I20260709 12:09:54.676764 26835 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:54.668597 27058 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:54.970719 25764 rpcz_store.cc:276] 0709 12:09:53.443050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.141009 (+697959us) service_pool.cc:224] Handling call
0709 12:09:54.141463 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.141746 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:54.536772 (+395026us) log.cc:844] Serialized 14 byte log entry
0709 12:09:54.732570 (+195798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.732650 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.732704 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.732787 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.732966 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24549,"prepare.queue_time_us":92550,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":24708,"spinlock_wait_cycles":33704704,"thread_start_us":555412,"threads_started":2}
I20260709 12:09:54.790313 25612 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:54.985668 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 345005us
W20260709 12:09:54.879297 27053 log.cc:927] Time spent T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:09:54.966570 27062 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:09:54.814745 27048 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:09:54.846536 27050 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 12:09:54.937187 27047 log.cc:927] Time spent T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 12:09:54.950446 27039 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.348s	user 0.003s	sys 0.000s
I20260709 12:09:54.996731 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.003990 25766 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.813733 26823 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:54.815773 26736 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:09:54.811432 27034 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.967633 27065 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:54.913441 26867 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:54.870740 26805 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.677227 26926 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.311s
I20260709 12:09:54.741974 26984 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:54.613976 25759 rpcz_store.cc:276] 0709 12:09:53.509454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.460273 (+950819us) service_pool.cc:224] Handling call
0709 12:09:54.492593 (+ 32320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.516284 (+ 23691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.520304 (+  4020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.522154 (+  1850us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.528218 (+  6064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.537235 (+  9017us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.548878 (+ 11643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.810778 26891 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.944856 25761 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:54.730505 26911 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:54.868013 26886 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:55.075059 26886 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.067808 26805 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:54.676652 26723 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.077508 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1103) took 1610 ms. Trace:
I20260709 12:09:54.703665 27002 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.300s
W20260709 12:09:55.050320 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.077942 25762 rpcz_store.cc:276] 0709 12:09:53.466730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.411379 (+944649us) service_pool.cc:224] Handling call
0709 12:09:54.411870 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.492212 (+ 80342us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:54.512625 (+ 20413us) log.cc:844] Serialized 14 byte log entry
0709 12:09:54.671480 (+158855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.671624 (+   144us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.671688 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.077267 (+405579us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54003183d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.077317 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.077444 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232454,"prepare.queue_time_us":20732,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":6413,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":49583,"spinlock_wait_cycles":184088960,"thread_start_us":158261,"threads_started":1,"wal-append.queue_time_us":527364}
I20260709 12:09:55.080790 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 838) took 1835 ms. Trace:
I20260709 12:09:55.075359 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:55.081460 25693 rpcz_store.cc:276] 0709 12:09:53.245729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.427323 (+181594us) service_pool.cc:224] Handling call
0709 12:09:53.427814 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:53.630523 (+202709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.080499 (+1449976us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54003b8154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.080721 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463802624}
I20260709 12:09:55.042322 26736 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:55.082553 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1106) took 1548 ms. Trace:
I20260709 12:09:55.082979 25761 rpcz_store.cc:276] 0709 12:09:53.534701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.760781 (+1226080us) service_pool.cc:224] Handling call
0709 12:09:54.920845 (+160064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.073966 (+153121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.082488 (+  8522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:55.083454 26736 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.085485 26736 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:55.086933 27031 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.087177 26926 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.087744 26926 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:55.089238 25691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 831) took 1868 ms (client timeout 2026 ms). Trace:
W20260709 12:09:55.089859 25691 rpcz_store.cc:269] 0709 12:09:53.220530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.242108 (+ 21578us) service_pool.cc:224] Handling call
0709 12:09:55.088948 (+1846840us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003453d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:55.089145 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449713408}
W20260709 12:09:55.091097 27052 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:09:55.091609 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1097) took 1651 ms. Trace:
I20260709 12:09:55.092074 25765 rpcz_store.cc:276] 0709 12:09:53.440056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.440272 (+   216us) service_pool.cc:224] Handling call
0709 12:09:55.091311 (+1651039us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400316ad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:55.091522 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556764544}
I20260709 12:09:54.947715 26820 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.002180 26941 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:54.873658 26968 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.011886 26796 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.002122 26985 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:54.701928 26997 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.075294 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1162) took 1623 ms. Trace:
I20260709 12:09:54.886162 26902 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.051998 26949 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.089131 26926 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.014997 26835 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:55.046900 27008 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:55.039739 26826 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.108446 25614 rpcz_store.cc:276] 0709 12:09:53.451870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.862988 (+411118us) service_pool.cc:224] Handling call
0709 12:09:53.863443 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.935644 (+ 72201us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:09:53.935706 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.935780 (+    74us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.935829 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.074938 (+1139109us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b540016eed4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.075007 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.075204 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34959,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":164741888}
I20260709 12:09:55.055527 27071 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:55.021726 26970 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 12:09:55.210872 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1163) took 1577 ms. Trace:
W20260709 12:09:55.214191 25659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.052s	sys 0.093s
W20260709 12:09:55.214843 25659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.053s	sys 0.093s
I20260709 12:09:55.108166 26859 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.019449 26877 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.104890 27056 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.116667 27002 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.118330 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1099) took 1668 ms. Trace:
I20260709 12:09:55.121579 26994 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.218564 26859 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:55.223280 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:55.212481 25616 rpcz_store.cc:276] 0709 12:09:53.633443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.860758 (+227315us) service_pool.cc:224] Handling call
0709 12:09:53.885728 (+ 24970us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:53.896234 (+ 10506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.896291 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:53.957267 (+ 60976us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.426314 (+469047us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.426355 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.426432 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.210467 (+784035us) raft_consensus.cc:1685] finished
0709 12:09:55.210504 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.210764 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1439,"raft.queue_time_us":81727,"raft.run_cpu_time_us":458,"raft.run_wall_time_us":24919,"thread_start_us":460891,"threads_started":1,"wal-append.queue_time_us":606599}
I20260709 12:09:55.093178 26984 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.099480 26891 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.174098 26902 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:55.188911 27008 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.117367 26941 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.098649 27065 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.235829 26340 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 1.
I20260709 12:09:55.226972 26985 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:55.227100 26826 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.179611 27030 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:55.239671 26928 consensus_meta.cc:287] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.998s	user 0.013s	sys 0.003s
I20260709 12:09:55.233582 26880 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.290133 25611 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:55.278535 27008 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.276669 26926 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.280498 26970 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.232777 27002 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.287098 26826 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:55.295295 25660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.068s	sys 0.152s
W20260709 12:09:55.325909 25660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.068s	sys 0.152s
I20260709 12:09:55.280921 26671 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:55.319077 27069 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:09:55.320842 27004 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.235826 26859 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.223423 27071 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:55.351442 27068 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:09:55.321095 27006 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.322965 26749 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.288967 26985 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.375228 27071 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.329039 27058 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:09:55.358466 27003 consensus_meta.cc:287] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.770s	user 0.016s	sys 0.001s
I20260709 12:09:55.363777 25763 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:09:55.346027 27077 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:55.355682 26984 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.328373 26970 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:55.427054 26748 consensus_meta.cc:287] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.878s	user 0.013s	sys 0.006s
W20260709 12:09:55.427371 27078 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:09:55.427536 26891 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:55.413702 27015 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 1.841s	user 0.017s	sys 0.000s
I20260709 12:09:55.432525 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 28) took 3180 ms. Trace:
I20260709 12:09:55.348204 27038 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.341504 26835 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.407866 26859 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.432945 25619 rpcz_store.cc:276] 0709 12:09:52.251598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.880180 (+628582us) service_pool.cc:224] Handling call
0709 12:09:52.880555 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.928023 (+ 47468us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:52.928057 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.941925 (+ 13868us) log.cc:844] Serialized 26 byte log entry
0709 12:09:53.228945 (+287020us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:53.229002 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.229096 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.286391 (+2057295us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:55.432165 (+145774us) raft_consensus.cc:1685] finished
0709 12:09:55.432190 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.432432 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6927,"raft.queue_time_us":71464,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":139,"spinlock_wait_cycles":8935168,"thread_start_us":273938,"threads_started":2,"wal-append.queue_time_us":551497}
I20260709 12:09:55.347023 26671 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:55.423023 26820 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:55.455101 27064 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 12:09:55.455798 25687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.015s	sys 0.026s
W20260709 12:09:55.456137 25687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.015s	sys 0.026s
W20260709 12:09:55.465951 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:55.463328 27074 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 12:09:55.459568 26997 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:55.476505 26989 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 2.501s	user 0.000s	sys 0.019s
W20260709 12:09:55.476938 27072 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:09:55.231271 25760 rpcz_store.cc:276] 0709 12:09:53.440881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.460639 (+ 19758us) service_pool.cc:224] Handling call
0709 12:09:53.540758 (+ 80119us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:53.997864 (+457106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.018523 (+ 20659us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.085877 (+ 67354us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.527257 (+441380us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.528097 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.536540 (+  8443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.068879 (+532339us) raft_consensus.cc:1685] finished
0709 12:09:55.068915 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.108868 (+ 39953us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171482,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":17870,"thread_start_us":851879,"threads_started":2,"wal-append.queue_time_us":543368}
W20260709 12:09:55.485282 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.434422 27077 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:55.493667 27077 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:09:55.526479 27076 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 12:09:55.527374 27067 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:09:55.530074 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1102) took 2086 ms. Trace:
I20260709 12:09:55.533349 25768 rpcz_store.cc:276] 0709 12:09:53.443683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.398829 (+955146us) service_pool.cc:224] Handling call
0709 12:09:54.430759 (+ 31930us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.455573 (+ 24814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.455608 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.460361 (+  4753us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.640833 (+180472us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.640876 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.640950 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.529731 (+888781us) raft_consensus.cc:1685] finished
0709 12:09:55.529769 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.529987 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2504,"raft.queue_time_us":9508,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":4081,"thread_start_us":145351,"threads_started":1,"wal-append.queue_time_us":799736}
I20260709 12:09:55.530592 25762 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:55.418244 27058 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.482695 27065 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.528452 26941 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.543850 25613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1138) took 3818 ms. Trace:
I20260709 12:09:55.544180 25613 rpcz_store.cc:276] 0709 12:09:51.725193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.656951 (+931758us) service_pool.cc:224] Handling call
0709 12:09:52.657343 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.657718 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.657749 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.695607 (+ 37858us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.780095 (+ 84488us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:52.780141 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.780214 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:53.869742 (+1089528us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b4800242dd8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:09:55.254217 (+1384475us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:55.543616 (+289399us) raft_consensus.cc:1685] finished
0709 12:09:55.543638 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.543794 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":928,"raft.run_cpu_time_us":17891,"raft.run_wall_time_us":1204336,"spinlock_wait_cycles":55298048,"thread_start_us":51003,"threads_started":1,"wal-append.queue_time_us":138399}
I20260709 12:09:55.546396 27065 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:55.542757 27083 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:09:55.546126 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 731) took 1046 ms. Trace:
W20260709 12:09:55.552911 27016 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 1.989s	user 0.003s	sys 0.010s
I20260709 12:09:55.551992 25763 rpcz_store.cc:276] 0709 12:09:54.497836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.464627 (+966791us) service_pool.cc:224] Handling call
0709 12:09:55.536319 (+ 71692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.540914 (+  4595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.540967 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:55.541038 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:55.541095 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.541179 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.543786 (+  2607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:55.545413 27002 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.556911 26970 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.559392 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 729) took 1068 ms. Trace:
I20260709 12:09:55.559923 25765 rpcz_store.cc:276] 0709 12:09:54.491218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.093035 (+601817us) service_pool.cc:224] Handling call
0709 12:09:55.093664 (+   629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:55.100113 (+  6449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.100165 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:55.111610 (+ 11445us) log.cc:844] Serialized 26 byte log entry
0709 12:09:55.416445 (+304835us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:55.416498 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.416593 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.559122 (+142529us) raft_consensus.cc:1685] finished
0709 12:09:55.559148 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.559313 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5900,"raft.queue_time_us":7104,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":17322,"thread_start_us":188520,"threads_started":1,"wal-append.queue_time_us":336545}
I20260709 12:09:55.556519 26985 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.559849 25761 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:55.550202 27065 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.570446 27058 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.571740 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:55.575575 26941 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:55.572824 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:55.576210 26941 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.577004 25691 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:55.573484 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:55.574287 27038 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:55.578399 25693 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:55.580024 26941 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.581550 26886 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.582363 27065 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.582857 26795 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.583259 26795 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:55.584486 27024 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.584360 26795 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.585409 26795 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:55.588477 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:55.568251 26896 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.955s	user 0.017s	sys 0.000s
I20260709 12:09:55.586666 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 732) took 1070 ms. Trace:
I20260709 12:09:55.590590 27056 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:09:55.607758 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.586440 27008 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.611032 26994 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.610908 26941 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.607622 27024 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.618597 26941 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.619474 26994 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.621094 26941 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.621479 26994 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:55.622502 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.624876 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.625829 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.626580 25619 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:55.626777 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.618659 27024 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.627871 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:55.628834 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.636164 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.641448 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:55.647625 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.648883 25616 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:09:55.649950 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.651098 25614 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:55.652475 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.652833 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.653900 25619 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:55.655319 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.656978 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.634960 26896 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.628440 27073 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:55.604053 25761 rpcz_store.cc:276] 0709 12:09:54.498906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.528974 (+1030068us) service_pool.cc:224] Handling call
0709 12:09:55.550334 (+ 21360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.565026 (+ 14692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.569017 (+  3991us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:55.660884 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47614.5us
I20260709 12:09:55.661990 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.617278 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 827) took 3041 ms. Trace:
I20260709 12:09:55.640331 27065 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.665081 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.667260 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.666276 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.668027 25612 raft_consensus.cc:2410] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:09:55.669178 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.669095 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.669937 25612 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:55.671407 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.663225 26885 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:55.676404 26889 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:55.676923 26885 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.677129 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 50) took 1553 ms. Trace:
I20260709 12:09:55.667409 27073 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.677704 25687 rpcz_store.cc:276] 0709 12:09:54.124059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.143379 (+ 19320us) service_pool.cc:224] Handling call
0709 12:09:54.143783 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.247318 (+103535us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:09:54.507924 (+260606us) log.cc:844] Serialized 14 byte log entry
0709 12:09:55.456472 (+948548us) log.cc:844] Serialized 14 byte log entry
0709 12:09:55.460115 (+  3643us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:55.460175 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:55.460220 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.676878 (+216658us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000a9954. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.676933 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.677067 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10799,"prepare.queue_time_us":639315,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1669,"raft.queue_time_us":128351,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":25889,"spinlock_wait_cycles":237342464,"thread_start_us":931984,"threads_started":2,"wal-append.queue_time_us":616208}
I20260709 12:09:55.680634 27073 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.681372 26910 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:55.665824 26896 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:55.684125 27057 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 1.011s	user 0.004s	sys 0.009s
W20260709 12:09:55.685989 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.686553 27024 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:55.686719 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.687253 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1168) took 1857 ms. Trace:
W20260709 12:09:55.687474 25767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1096) took 2250 ms (client timeout 1754 ms). Trace:
I20260709 12:09:55.682024 26910 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:55.688313 25766 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:09:55.687927 25767 rpcz_store.cc:269] 0709 12:09:53.437055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.437915 (+   860us) service_pool.cc:224] Handling call
0709 12:09:55.687253 (+2249338us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001b9c54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:55.687385 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403220736}
I20260709 12:09:55.667173 25610 rpcz_store.cc:276] 0709 12:09:52.576532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.270503 (+693971us) service_pool.cc:224] Handling call
0709 12:09:53.400722 (+130219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.460187 (+1059465us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b54004969a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd2dc0 00007fbdb2d5dd87 00007fbdb2d5e470 00007fbdb2d5ad8f 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c
0709 12:09:54.571659 (+111472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.616854 (+1045195us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400419954. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.617183 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414091904}
I20260709 12:09:55.687667 25617 rpcz_store.cc:276] 0709 12:09:53.830455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.101571 (+271116us) service_pool.cc:224] Handling call
0709 12:09:54.101837 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.104795 (+  2958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.104844 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.105380 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.472299 (+366919us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.472359 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.472461 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.683478 (+1211017us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:55.686963 (+  3485us) raft_consensus.cc:1685] finished
0709 12:09:55.686984 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.687188 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7658,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"spinlock_wait_cycles":13542656,"thread_start_us":313937,"threads_started":1,"wal-append.queue_time_us":516220}
I20260709 12:09:55.692298 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.692723 26893 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.693192 25617 raft_consensus.cc:2410] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:55.696334 26910 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:55.692189 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:55.677088 26889 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.697731 26889 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.698840 27065 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:55.699422 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.677516 26885 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.701746 27065 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.704828 25687 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
W20260709 12:09:55.687260 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:55.706166 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.734611 26997 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.735381 26997 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.698200 26894 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.736953 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:55.743973 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.736640 25767 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:55.748320 25612 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:55.749696 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.755213 26885 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.737399 26886 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:55.757897 26886 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.761134 26886 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.744875 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.729341 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:55.729382 27001 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.721817 26877 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.746169 26997 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:55.785120 26553 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:55.791821 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.807121 25617 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:55.808665 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.809499 25617 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:55.809537 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 72617.5us
I20260709 12:09:55.811790 27090 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.812459 27090 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.792755 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.744338 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.815825 25614 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:55.794996 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.796638 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.797659 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 802) took 3859 ms. Trace:
I20260709 12:09:55.798745 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.816957 25615 rpcz_store.cc:276] 0709 12:09:51.938703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.696524 (+757821us) service_pool.cc:224] Handling call
0709 12:09:53.916232 (+1219708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.220850 (+304618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.797461 (+1576611us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003610d0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:55.797602 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804105984}
I20260709 12:09:55.800201 25613 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.818372 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:55.819319 25732 connection.cc:256] RPC call timeout handler was delayed by -1.3188784290000513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 12:09:55.819267 25615 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:55.817838 26893 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.820152 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.820511 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.820506 26893 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.820784 25619 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:55.821369 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.822513 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:55.822515 25732 connection.cc:256] RPC call timeout handler was delayed by -1.3155260319999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 12:09:55.823556 25612 raft_consensus.cc:2410] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:55.824126 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.824512 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.824870 25616 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:09:55.825500 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:55.826021 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1329780300000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:09:55.826493 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0575123890000668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 12:09:55.826314 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.828619 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.827936 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.829346 25612 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
W20260709 12:09:55.829578 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0306231790000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:09:55.829991 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0139683180000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 12:09:55.830137 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.830837 25614 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:55.833288 25615 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:55.837502 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.851274 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.852361 25612 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:55.860147 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.854341 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.805922 25759 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:55.827924 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 49) took 1698 ms. Trace:
I20260709 12:09:55.864395 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:55.865656 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.873845 25617 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:55.836280 26835 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.889678 25613 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:55.842790 27058 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:55.887612 25619 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:09:55.878913 26984 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:55.863905 27004 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.888743 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:55.806205 27001 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.814787 26877 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:55.841370 27024 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:09:55.946851 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:09:55.900600 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.862102 26885 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:55.969270 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.906291 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.958748 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:55.863482 27075 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.014s	sys 0.017s
I20260709 12:09:55.978699 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:55.853648 26859 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.840044 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:09:56.000450 25614 raft_consensus.cc:606] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:55.852586 26886 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.000927 25614 raft_consensus.cc:614] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:55.875074 27073 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:55.956332 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:55.965615 25612 raft_consensus.cc:2376] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4. Re-sending same reply.
I20260709 12:09:55.980302 25613 raft_consensus.cc:2410] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:55.992378 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.010107 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.011205 25614 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:55.891448 26746 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.954427 27090 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:55.895738 25658 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:55.889627 26835 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:55.941466 27081 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.505s	user 0.000s	sys 0.006s
W20260709 12:09:56.007266 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.024196 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:55.905792 26997 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.954727 26984 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.864063 26820 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.996035 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:55.998450 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 151794us
I20260709 12:09:56.042676 26984 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.039094 27090 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.042858 26820 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.043651 27090 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.045140 26820 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.030997 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:55.999293 27058 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:56.045763 27090 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.045877 27058 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.944345 26926 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:09:56.048693 27024 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.041087 25692 raft_consensus.cc:2410] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:09:55.863862 26894 consensus_queue.cc:1059] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.168s
I20260709 12:09:56.044116 25619 raft_consensus.cc:2368] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:55.978806 27095 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:56.051419 26987 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.052397 26997 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.052727 26568 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:56.054207 27008 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.054505 26988 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:56.055111 26723 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.041886 26835 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.057065 26877 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:56.060557 27049 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 1.500s	user 0.012s	sys 0.008s
I20260709 12:09:56.063109 26926 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.981431 26885 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.000089 26859 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:56.067584 26896 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.068077 26893 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:56.054028 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 158418us
I20260709 12:09:56.104467 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:56.105567 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:56.039407 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.035847 25693 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:56.073792 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 724) took 1584 ms. Trace:
I20260709 12:09:56.106673 25766 rpcz_store.cc:276] 0709 12:09:54.489769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.016311 (+526542us) service_pool.cc:224] Handling call
0709 12:09:55.688060 (+671749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:55.688736 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.073523 (+384787us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54001b9c50. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:56.073707 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543502720}
I20260709 12:09:56.034785 27097 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:09:56.107635 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.107999 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.108669 25766 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.073650 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.080304 25765 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:56.109442 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.109668 25692 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:56.110565 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.110945 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.089709 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:56.112728 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.112941 25619 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:56.113799 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.114390 25619 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:56.115144 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.055989 26860 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.070758 27090 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.979264 27004 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.098237 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.158974 25768 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:56.073108 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.032495 26886 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.032996 27073 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:56.110098 25693 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:56.090346 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.115692 25619 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:56.116354 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.086647 26988 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:56.163420 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.208410 25766 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:56.213191 25766 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:55.879895 25686 rpcz_store.cc:276] 0709 12:09:54.123714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.126528 (+  2814us) service_pool.cc:224] Handling call
0709 12:09:54.126852 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.378626 (+251774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.388629 (+ 10003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.395032 (+  6403us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:54.399749 (+  4717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.801833 (+1402084us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54003462d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.805108 (+  3275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.822019 (+ 16911us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525271808}
I20260709 12:09:56.119006 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.121043 25688 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:56.213773 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:56.215040 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.186167 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.221158 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.221719 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.110590 26859 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.100525 27001 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.096046 26926 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:09:56.222271 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.161324 26893 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.223894 25619 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:56.249336 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.216820 26988 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.186228 27095 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:09:56.160810 26568 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:56.099174 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.240810 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.241470 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:56.225414 25766 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:09:56.207165 26885 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.182718 26896 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.250777 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.278939 25619 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:56.098935 26894 raft_consensus.cc:3055] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:56.163460 26860 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.216058 26820 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:56.256197 26926 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:56.257607 26889 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 12:09:56.259593 26886 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.261209 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:56.263101 25611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1159) took 2812 ms (client timeout 3128 ms). Trace:
W20260709 12:09:56.287758 25611 rpcz_store.cc:269] 0709 12:09:53.450973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.729984 (+279011us) service_pool.cc:224] Handling call
0709 12:09:56.262890 (+2532906us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400303754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:56.263038 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3507423616}
I20260709 12:09:56.276947 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.191988 26826 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.280704 26918 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:56.283315 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:56.097615 27099 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.185s
I20260709 12:09:56.299718 27004 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.305977 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.278764 25759 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:56.307384 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.308302 25610 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:56.309231 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.309056 26988 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.287961 26820 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.279011 27095 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:56.251544 27058 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.318122 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.297291 26746 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:56.304104 26918 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:56.302162 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 839) took 2135 ms. Trace:
I20260709 12:09:56.348063 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.348694 25759 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:09:56.310626 26826 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.347426 25690 rpcz_store.cc:276] 0709 12:09:54.165335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.384850 (+219515us) service_pool.cc:224] Handling call
0709 12:09:54.414137 (+ 29287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.574601 (+160464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.582145 (+  7544us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.646528 (+ 64383us) log.cc:844] Serialized 26 byte log entry
0709 12:09:55.121078 (+474550us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:55.124653 (+  3575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.584008 (+459355us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540031fbd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:55.584061 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:56.244416 (+660355us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b2400102668. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafaf49c4 00007fbdafaf2acb 00007fbdafcaddc9 00007fbdafcada55 00007fbdafcacfb0 00007fbdb2923488 00007fbdb2923be8 00007fbdb28fb398 00007fbdb28f676a 00007fbdb28f5bb6
0709 12:09:56.285063 (+ 40647us) raft_consensus.cc:1685] finished
0709 12:09:56.285088 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.300472 (+ 15384us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9881,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":6964,"spinlock_wait_cycles":307214976,"thread_start_us":426461,"threads_started":1,"wal-append.queue_time_us":618856}
I20260709 12:09:56.355046 26835 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.350090 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.356081 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.356338 25691 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:56.356570 25759 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:56.357524 26835 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.280586 26568 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:56.284605 26860 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.289986 25766 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:56.377084 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.378911 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.379693 25766 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.281062 26894 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:56.253594 26893 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.347548 26918 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:56.284376 26896 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.292402 26889 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.334300 26820 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.316298 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.336506 26805 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.314523 26926 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.337839 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 726) took 1847 ms. Trace:
I20260709 12:09:56.339675 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:56.340509 27073 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:56.341002 26997 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.303704 26983 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.341495 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.422513 25766 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:56.374099 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.526795 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1109) took 2384 ms. Trace:
I20260709 12:09:56.304540 25619 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:56.528834 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.527446 25764 rpcz_store.cc:276] 0709 12:09:54.142583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.980770 (+838187us) service_pool.cc:224] Handling call
0709 12:09:55.020689 (+ 39919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:55.047876 (+ 27187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.047929 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:55.058173 (+ 10244us) log.cc:844] Serialized 26 byte log entry
0709 12:09:56.069492 (+1011319us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b18003609a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:09:56.365878 (+296386us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:56.365959 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.366033 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:56.525883 (+159850us) raft_consensus.cc:1685] finished
0709 12:09:56.525929 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.526465 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26572,"raft.queue_time_us":26705,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":13841,"spinlock_wait_cycles":14066560,"thread_start_us":295830,"threads_started":1,"wal-append.queue_time_us":1343826}
I20260709 12:09:56.529579 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:56.396415 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.530773 25619 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
W20260709 12:09:56.531702 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.532802 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.532466 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.334582 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.385427 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1172) took 1753 ms. Trace:
I20260709 12:09:56.285945 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.535079 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.400786 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.536494 25614 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.534691 25618 rpcz_store.cc:276] 0709 12:09:54.631978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.921813 (+289835us) service_pool.cc:224] Handling call
0709 12:09:54.955618 (+ 33805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.285463 (+329845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.285503 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:55.285565 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:55.285596 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.385107 (+1099511us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400418f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:56.385177 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.385359 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758071040}
I20260709 12:09:56.538491 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.540555 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.540828 25618 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:56.539544 25614 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:56.514034 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.334906 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.319020 25611 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:56.543381 25610 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:56.544018 25612 pending_rounds.cc:85] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 1
I20260709 12:09:56.360623 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.544390 25612 pending_rounds.cc:107] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:09:56.544837 25612 raft_consensus.cc:2889] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:09:56.284734 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 241237us
I20260709 12:09:56.536319 25615 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:56.404413 25762 rpcz_store.cc:276] 0709 12:09:54.490361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.080095 (+589734us) service_pool.cc:224] Handling call
0709 12:09:55.530302 (+450207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.536664 (+  6362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.337443 (+800779us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b540034fb50. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:56.337750 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933985024}
I20260709 12:09:56.548014 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:56.548313 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.548636 25619 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:56.550328 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.551335 25760 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:09:56.523316 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.551769 25615 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.527596 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.552942 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:56.508399 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.553949 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.546334 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.554813 25766 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.554963 25759 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:09:56.555814 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.556229 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.544420 25611 pending_rounds.cc:85] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 2
I20260709 12:09:56.556866 25611 pending_rounds.cc:107] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:09:56.557123 25611 raft_consensus.cc:2889] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:56.557739 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.551573 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.533205 25689 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.559471 25685 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:56.559937 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:56.560082 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.560573 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.561622 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.536306 25686 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:56.521147 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.549960 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.410888 26337 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:56.430444 26893 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.431073 26671 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:56.306162 26984 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.436501 26859 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.459636 26896 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.428463 26894 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:56.337853 27103 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:09:56.344841 26988 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.460489 26994 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:09:56.457970 27058 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.652582 25514 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 41) took 3823 ms. Trace:
I20260709 12:09:56.654436 25692 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:56.656560 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.239878 27090 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.411504 27095 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.376869 27099 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:56.667445 26304 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:56.667866 27099 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.669234 26910 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:56.669696 26910 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:56.383407 27101 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:56.455921 26968 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.562822 25689 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:09:56.672905 27101 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.674147 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.674401 26889 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.563062 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.675215 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.675977 25687 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:56.676052 25768 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:56.563539 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.565012 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.677145 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.677613 25762 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:56.572391 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:56.580353 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.566711 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.589159 25731 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:09:56.593480 26859 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.565429 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.568840 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:56.567166 25759 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:56.574435 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.563391 25761 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.562243 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.562690 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.434916 26568 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.456429 26860 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.620054 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:56.623795 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.645326 26984 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.646457 27030 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:09:56.659128 25692 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:56.670066 26910 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:56.782366 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.677911 25768 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:56.808116 25615 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.826786 25691 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:56.828677 25763 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
W20260709 12:09:56.833189 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 185794us
I20260709 12:09:56.836642 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.837468 25689 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:56.835412 26910 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:56.807232 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.840164 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.814529 25617 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:56.813681 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.814357 27030 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:56.653107 25514 rpcz_store.cc:276] 0709 12:09:52.813452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.846451 (+ 32999us) service_pool.cc:224] Handling call
0709 12:09:56.634593 (+3788142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:54.487329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:54.581994 (+ 94665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:54.584041 (+  2047us) write_op.cc:435] Acquired schema lock
0709 12:09:54.584066 (+    25us) tablet.cc:662] Decoding operations
0709 12:09:54.687315 (+103249us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:54.702954 (+ 15639us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:54.732016 (+ 29062us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:09:54.816437 (+ 84421us) tablet.cc:701] Row locks acquired
0709 12:09:54.816470 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:09:54.881490 (+ 65020us) write_op.cc:270] Start()
0709 12:09:54.921209 (+ 39719us) write_op.cc:276] Timestamp: P: 1783598994874047 usec, L: 0
0709 12:09:54.923568 (+  2359us) op_driver.cc:348] REPLICATION: starting
0709 12:09:55.066679 (+143111us) log.cc:844] Serialized 1749 byte log entry
0709 12:09:55.690678 (+623999us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b540001c820. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2cd26b8 00007fbdb2cd22fa 00007fbdb2d56965 00007fbdb2d56e09 00007fbdb6791581 00007fbdb6790d58 00007fbdb67959f1 00007fbdb67959a9 00007fbdb6795939 00007fbdb6795901
0709 12:09:56.336403 (+645725us) op_driver.cc:464] REPLICATION: finished
0709 12:09:56.453818 (+117415us) write_op.cc:301] APPLY: starting
0709 12:09:56.456329 (+  2511us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:56.468402 (+ 12073us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:56.468433 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:56.468988 (+   555us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:56.469188 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:09:56.469241 (+    53us) write_op.cc:312] APPLY: finished
0709 12:09:56.469445 (+   204us) log.cc:844] Serialized 34 byte log entry
0709 12:09:56.471601 (+  2156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.471719 (+   118us) write_op.cc:454] Released schema lock
0709 12:09:56.471767 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:56.472140 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.472167 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64765,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":115296,"apply.run_cpu_time_us":2279,"apply.run_wall_time_us":20119,"num_ops":3,"prepare.queue_time_us":3011,"prepare.run_cpu_time_us":11230,"prepare.run_wall_time_us":1217949,"replication_time_us":1409724,"spinlock_wait_cycles":176898816,"thread_start_us":114940,"threads_started":1}]]}
I20260709 12:09:56.820924 25613 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:56.643884 27024 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:56.823186 25690 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:56.807585 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.808367 25764 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.838629 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.856549 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.859390 26910 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:09:56.863866 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.864388 25765 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.865545 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.859391 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.871601 25692 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:56.872511 25768 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:56.873662 25759 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:09:56.811676 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.879266 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.874598 25767 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
W20260709 12:09:56.880709 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.895320 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:56.832305 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:09:56.898589 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.784709 27090 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.866545 26893 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:56.912658 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.912516 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.910596 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:56.915377 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.916630 25762 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:09:56.919251 25764 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:56.921387 25617 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:56.919728 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 331057us
I20260709 12:09:56.922678 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:56.925721 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 89960.7us
I20260709 12:09:56.927928 25689 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:56.931526 26889 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:56.931504 27073 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.932345 26889 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:56.932960 26889 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.933041 26894 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.937515 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:56.939867 25763 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:56.958567 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.960310 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:56.961848 25759 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:56.941020 26795 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:56.968552 26795 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:56.969455 27101 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:56.971156 27126 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:09:56.973124 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:56.946494 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.949258 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.976596 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:56.955626 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.978106 25690 raft_consensus.cc:2368] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
W20260709 12:09:56.940863 27076 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:09:56.979090 25685 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:09:56.979959 26918 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.008s
I20260709 12:09:56.980240 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:56.918699 27030 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:56.981057 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.983807 27030 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:56.963274 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.924508 27099 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:56.964401 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:56.985725 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.986577 25686 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:56.986841 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.987486 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.962114 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:56.988164 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:56.988947 25691 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:56.999706 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:56.989975 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.008667 25764 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:57.008505 25766 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:56.977634 25687 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.033282 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.033922 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:57.035763 25617 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:56.980377 26918 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:57.038763 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 101447us
I20260709 12:09:57.008456 25763 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.056747 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.058079 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:57.058759 25619 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.054653 25615 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:57.047335 25692 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:57.064136 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.065326 25690 raft_consensus.cc:2410] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:57.066665 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 176) took 8338 ms. Trace:
I20260709 12:09:57.047137 25658 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:57.070919 25768 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:57.078310 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.081166 25761 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:56.988204 25686 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:57.067159 25516 rpcz_store.cc:276] 0709 12:09:48.728296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:48.728620 (+   324us) service_pool.cc:224] Handling call
0709 12:09:50.160465 (+1431845us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:09:50.887012 (+726547us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400002490. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc37640 00007fbdb8b0e846 00007fbdb8c1890e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:09:57.066433 (+6179421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:53.968175 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:53.968807 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:53.968847 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:09:53.968866 (+    19us) tablet.cc:662] Decoding operations
0709 12:09:53.969955 (+  1089us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:53.970042 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:53.970071 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:09:53.971731 (+  1660us) tablet.cc:701] Row locks acquired
0709 12:09:53.971751 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:09:53.972070 (+   319us) write_op.cc:270] Start()
0709 12:09:53.972218 (+   148us) write_op.cc:276] Timestamp: P: 1783598993972025 usec, L: 0
0709 12:09:53.972246 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:09:54.041966 (+ 69720us) log.cc:844] Serialized 4454 byte log entry
0709 12:09:55.698557 (+1656591us) op_driver.cc:464] REPLICATION: finished
0709 12:09:55.730642 (+ 32085us) write_op.cc:301] APPLY: starting
0709 12:09:55.730769 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:55.731124 (+   355us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:55.731323 (+   199us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:55.733008 (+  1685us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:55.733382 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:09:55.733455 (+    73us) write_op.cc:312] APPLY: finished
0709 12:09:55.747769 (+ 14314us) log.cc:844] Serialized 82 byte log entry
0709 12:09:55.766672 (+ 18903us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:55.766891 (+   219us) write_op.cc:454] Released schema lock
0709 12:09:55.767149 (+   258us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:55.767821 (+   672us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:55.767854 (+    33us) write_op.cc:454] Released schema lock
0709 12:09:56.312509 (+544655us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5832a 00007fbdb2cddf14 00007fbdb2cddec3 00007fbdb2cdde38 00007fbdb2cdddf3 00007fbdb2cdd0dc 00007fbdb2d06e16 00007fbdb2ceecbb 00007fbdb2cd939d 00007fbdb2cdcd75
Metrics: {"mutex_wait_us":1504065,"reported_tablets":24,"spinlock_wait_cycles":1911246848,"child_traces":[["op",{"apply.queue_time_us":31816,"apply.run_cpu_time_us":4995,"apply.run_wall_time_us":37105,"num_ops":11,"prepare.queue_time_us":509649,"prepare.run_cpu_time_us":32958,"prepare.run_wall_time_us":457962,"raft.queue_time_us":1176017,"raft.run_cpu_time_us":56130,"raft.run_wall_time_us":980985,"replication_time_us":1726145,"spinlock_wait_cycles":560118656,"thread_start_us":728591,"threads_started":4,"wal-append.queue_time_us":503140}]]}
I20260709 12:09:57.046551 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.111569 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.112831 25759 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:09:57.114385 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 74782.3us
I20260709 12:09:57.107398 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.117383 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.120740 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.122663 25765 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:57.123826 25766 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:57.131319 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 34) took 1193 ms. Trace:
W20260709 12:09:57.135046 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.135293 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.131866 25614 rpcz_store.cc:276] 0709 12:09:55.937537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.538116 (+600579us) service_pool.cc:224] Handling call
0709 12:09:56.538592 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:56.539088 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:09:56.844259 (+305171us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.130670 (+286411us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.130901 (+   231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.130965 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:57.131011 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.131091 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.131249 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13071,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":22036,"thread_start_us":165894,"threads_started":1}
I20260709 12:09:57.140928 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.106961 26918 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.114446 27024 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:09:57.148983 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.155017 26568 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:09:57.158645 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 150676us
I20260709 12:09:57.158622 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.131872 26795 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.159991 25691 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:09:57.171227 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1209) took 1054 ms. Trace:
W20260709 12:09:57.172313 25760 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.002s
I20260709 12:09:57.174664 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:57.175523 25768 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:09:57.176775 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.181658 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:57.181545 25766 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:57.179836 25612 rpcz_store.cc:276] 0709 12:09:56.116923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.542807 (+425884us) service_pool.cc:224] Handling call
0709 12:09:56.543428 (+   621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:56.545778 (+  2350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:56.545833 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:56.565864 (+ 20031us) log.cc:844] Serialized 26 byte log entry
0709 12:09:56.631857 (+ 65993us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:56.631906 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.632000 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:57.170967 (+538967us) raft_consensus.cc:1685] finished
0709 12:09:57.170989 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.171145 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":65387,"threads_started":1,"wal-append.queue_time_us":470988}
I20260709 12:09:57.186326 25692 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:57.163375 25689 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:57.180976 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.193928 27040 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.194777 27040 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.196763 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 744) took 1099 ms. Trace:
I20260709 12:09:57.197317 27040 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.197219 25765 rpcz_store.cc:276] 0709 12:09:56.096996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.110312 (+ 13316us) service_pool.cc:224] Handling call
0709 12:09:57.196482 (+1086170us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540030bbd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:57.196673 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275209088}
W20260709 12:09:57.198863 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 322674us
I20260709 12:09:57.202653 26968 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.204718 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:57.206419 26983 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:57.206964 26983 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:57.207427 26983 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:57.215626 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.217233 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.155750 26568 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:57.217914 25762 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
W20260709 12:09:57.225178 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 43673.8us
I20260709 12:09:57.230103 27024 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:57.230638 27024 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.231032 27024 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:57.233088 25732 leader_election.cc:400] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 2. Current term is 3.
I20260709 12:09:57.236092 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 748) took 1019 ms. Trace:
I20260709 12:09:57.236510 25759 rpcz_store.cc:276] 0709 12:09:56.216383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.967780 (+751397us) service_pool.cc:224] Handling call
0709 12:09:57.083767 (+115987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.113255 (+ 29488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.235855 (+122600us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400164c50. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:57.236017 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265816320}
I20260709 12:09:57.237957 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 705) took 1192 ms. Trace:
I20260709 12:09:57.238410 25693 rpcz_store.cc:276] 0709 12:09:56.045076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.163054 (+117978us) service_pool.cc:224] Handling call
0709 12:09:57.237584 (+1074530us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54003453d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:57.237766 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870562176}
W20260709 12:09:57.237990 26994 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.001s
I20260709 12:09:57.242514 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.244181 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.244650 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 709) took 1180 ms. Trace:
I20260709 12:09:57.245244 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.245036 25693 rpcz_store.cc:276] 0709 12:09:56.064141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.239499 (+1175358us) service_pool.cc:224] Handling call
0709 12:09:57.239968 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.244261 (+  4293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.244293 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.244360 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:57.244392 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.244456 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.244564 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.251736 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:57.246151 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.253057 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:57.265128 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.246073 25768 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:09:57.185650 25517 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.220616 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:57.238063 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.187755 25760 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:09:57.247728 25686 raft_consensus.cc:2410] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:57.277534 25765 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:57.273247 27040 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.277486 25687 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
W20260709 12:09:57.284559 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 69981.7us
I20260709 12:09:57.273995 25517 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:57.250686 27124 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.388s	user 0.000s	sys 0.007s
I20260709 12:09:57.253698 26568 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.290230 25658 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:57.290624 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.291426 25759 raft_consensus.cc:2410] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:57.294477 25761 raft_consensus.cc:2410] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:09:57.302171 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:57.302706 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.305665 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.311682 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.312916 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:57.304781 26826 consensus_meta.cc:287] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.012s
W20260709 12:09:57.319849 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.320118 25761 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:57.321210 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.323199 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1196) took 1211 ms. Trace:
I20260709 12:09:57.323585 26334 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:57.323781 27058 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:57.324433 27058 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:57.323601 25616 rpcz_store.cc:276] 0709 12:09:56.111839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.558293 (+446454us) service_pool.cc:224] Handling call
0709 12:09:56.558741 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:56.559139 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:56.559166 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:56.559770 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:09:56.628851 (+ 69081us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:56.628879 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:56.628937 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:56.993224 (+364287us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:09:57.250383 (+257159us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b2000040ff8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2909b91 00007fbdb292ba19 00007fbdb28f68c3 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169 00007fbdb28ff131 00007fbdb28fe42d 0000000000388634
0709 12:09:57.322813 (+ 72430us) raft_consensus.cc:1685] finished
0709 12:09:57.322837 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.322971 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78273152,"thread_start_us":68606,"threads_started":1,"wal-append.queue_time_us":192335}
I20260709 12:09:57.327737 25687 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:57.328423 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 713) took 1218 ms. Trace:
I20260709 12:09:57.328734 25687 rpcz_store.cc:276] 0709 12:09:56.109702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.288745 (+1179043us) service_pool.cc:224] Handling call
0709 12:09:57.327531 (+ 38786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.328157 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.328342 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.332615 25763 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:57.333364 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1113) took 1048 ms. Trace:
I20260709 12:09:57.297394 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 724) took 1025 ms. Trace:
I20260709 12:09:57.334725 25686 rpcz_store.cc:276] 0709 12:09:56.269224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.136969 (+867745us) service_pool.cc:224] Handling call
0709 12:09:57.295088 (+158119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.337347 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 57) took 1083 ms. Trace:
I20260709 12:09:57.346503 25762 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:57.347633 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.317265 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:57.365926 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.367969 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.348470 25517 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.380947 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 703) took 1330 ms. Trace:
I20260709 12:09:57.391440 25689 rpcz_store.cc:276] 0709 12:09:56.044355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.224200 (+1179845us) service_pool.cc:224] Handling call
0709 12:09:57.288970 (+ 64770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.372894 (+ 83924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.372924 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.372986 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:57.373019 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.373085 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.373224 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.393971 26968 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:57.333984 25763 rpcz_store.cc:276] 0709 12:09:56.284962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.959912 (+674950us) service_pool.cc:224] Handling call
0709 12:09:57.333286 (+373374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.309110 27040 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.337852 25686 rpcz_store.cc:276] 0709 12:09:56.254148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.335811 (+1081663us) service_pool.cc:224] Handling call
0709 12:09:57.336390 (+   579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.336773 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.336816 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.336909 (+    93us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:57.336958 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.337043 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.337232 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.376742 25765 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
W20260709 12:09:57.395488 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 85759.8us
W20260709 12:09:57.388032 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 102650us
I20260709 12:09:57.406282 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 717) took 1128 ms. Trace:
I20260709 12:09:57.409520 25689 rpcz_store.cc:276] 0709 12:09:56.266887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.393107 (+1126220us) service_pool.cc:224] Handling call
0709 12:09:57.393673 (+   566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.393994 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.394036 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.394104 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:57.394155 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.394232 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.395312 (+  1080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.402943 25517 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.413383 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:57.415513 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.376113 27101 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:09:57.357314 26889 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:57.375212 26983 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:57.422869 25766 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:09:57.425386 25768 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:09:57.427218 26926 consensus_meta.cc:287] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.007s	user 0.009s	sys 0.009s
I20260709 12:09:57.428009 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:57.428769 25763 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:57.386934 27058 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.418349 25517 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.420632 26968 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:57.441212 25687 raft_consensus.cc:1240] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 4. Current term is 5. Ops: []
W20260709 12:09:57.443621 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.441831 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 751) took 1146 ms. Trace:
I20260709 12:09:57.424618 27099 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.452857 25615 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:57.455312 25765 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:57.447211 25517 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.462919 26820 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:09:57.448110 27099 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.479288 25766 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:57.478705 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:57.485761 25765 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:09:57.471150 25582 connection.cc:256] RPC call timeout handler was delayed by -1.0903011129998958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 12:09:57.487363 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.472074 25517 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.514339 25612 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:57.482616 27099 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:57.522454 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 61811us
W20260709 12:09:57.517808 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52915.5us
I20260709 12:09:57.529181 25517 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:57.517400 27095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.002s	sys 0.014s
I20260709 12:09:57.507671 26984 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:09:57.542428 25582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.622s (SENT) [suppressed 18 similar messages]
I20260709 12:09:57.548280 25517 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 3, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:57.546165 27095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.003s	sys 0.015s
I20260709 12:09:57.553593 25517 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.547338 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:57.462958 26968 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.549716 25686 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:09:57.583137 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.575353 25517 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.586490 25688 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:57.551599 26893 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 12:09:57.594355 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54558.4us
I20260709 12:09:57.599058 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 700) took 1602 ms. Trace:
I20260709 12:09:57.590008 26795 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:57.598433 27097 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:57.589643 26988 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:57.611058 25619 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.006s
I20260709 12:09:57.609807 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:57.637774 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.600219 26928 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.595440 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 844) took 1049 ms. Trace:
I20260709 12:09:57.599670 25691 rpcz_store.cc:276] 0709 12:09:55.993519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.192155 (+1198636us) service_pool.cc:224] Handling call
0709 12:09:57.304152 (+111997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.338593 (+ 34441us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:09:57.441535 (+102942us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.590812 (+149277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.590873 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:57.590917 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.595310 (+  4393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.595445 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78953,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":5164,"thread_start_us":189118,"threads_started":2}
I20260709 12:09:57.648972 25619 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:57.596256 25685 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:57.663897 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 699) took 1670 ms. Trace:
W20260709 12:09:57.624958 25613 consensus_meta.cc:287] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.005s
I20260709 12:09:57.666510 25613 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
W20260709 12:09:57.667907 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.607421 26889 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:57.669828 27101 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:57.669703 26988 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.670466 27101 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.670850 27101 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:57.672412 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 701) took 1678 ms. Trace:
I20260709 12:09:57.672501 26988 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.672834 25692 rpcz_store.cc:276] 0709 12:09:55.993821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.188063 (+1194242us) service_pool.cc:224] Handling call
0709 12:09:57.293866 (+105803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:57.320381 (+ 26515us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:57.433470 (+113089us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.547770 (+114300us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:57.568431 (+ 20661us) log.cc:844] Serialized 26 byte log entry
0709 12:09:57.568600 (+   169us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:57.568657 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.568753 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:57.672181 (+103428us) raft_consensus.cc:1685] finished
0709 12:09:57.672206 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.672350 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59072,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":135612,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":263,"thread_start_us":189340,"threads_started":2,"wal-append.queue_time_us":142144}
I20260709 12:09:57.669553 26928 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.669430 25613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1216) took 1087 ms. Trace:
W20260709 12:09:57.679071 25688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 714) took 1490 ms (client timeout 1646 ms). Trace:
W20260709 12:09:57.679473 25688 rpcz_store.cc:269] 0709 12:09:56.189033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.221571 (+ 32538us) service_pool.cc:224] Handling call
0709 12:09:57.678888 (+1457317us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400328f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:57.679014 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659140480}
W20260709 12:09:57.679920 26894 consensus_meta.cc:287] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.003s
I20260709 12:09:57.599401 27040 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.607196 26795 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.680855 25688 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5. Ops: []
I20260709 12:09:57.680945 25612 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:57.677897 25613 rpcz_store.cc:276] 0709 12:09:56.581683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.855513 (+273830us) service_pool.cc:224] Handling call
0709 12:09:57.669364 (+813851us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:57.681452 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 66233.6us
I20260709 12:09:57.648512 26983 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:57.666237 25690 rpcz_store.cc:276] 0709 12:09:55.993207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.190869 (+1197662us) service_pool.cc:224] Handling call
0709 12:09:57.253566 (+ 62697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.287629 (+ 34063us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:09:57.319629 (+ 32000us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.663513 (+343884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.663574 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:57.663617 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.663690 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.663839 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18928,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":37935,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8302,"thread_start_us":240698,"threads_started":2,"wal-append.queue_time_us":206044}
I20260709 12:09:57.687001 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:57.685032 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 866) took 1029 ms. Trace:
I20260709 12:09:57.681484 25764 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:57.680325 26928 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.596540 27024 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.690428 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 712) took 1597 ms. Trace:
W20260709 12:09:57.706367 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.685825 26795 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:57.692906 25692 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
W20260709 12:09:57.694020 27106 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:09:57.682046 27097 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:57.720077 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:57.695936 27139 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.234s	user 0.001s	sys 0.001s
W20260709 12:09:57.703723 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.676669 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 718) took 1407 ms. Trace:
I20260709 12:09:57.687845 25688 rpcz_store.cc:276] 0709 12:09:56.655673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.680286 (+1024613us) service_pool.cc:224] Handling call
0709 12:09:57.680660 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.684614 (+  3954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.684969 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.702673 26889 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.713714 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 862) took 1059 ms. Trace:
I20260709 12:09:57.711771 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:57.731565 25692 rpcz_store.cc:276] 0709 12:09:56.654121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.680599 (+1026478us) service_pool.cc:224] Handling call
0709 12:09:57.692663 (+ 12064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.713334 (+ 20671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.713634 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.706393 25693 rpcz_store.cc:276] 0709 12:09:56.092941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.286656 (+1193715us) service_pool.cc:224] Handling call
0709 12:09:57.314850 (+ 28194us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:09:57.404166 (+ 89316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.404211 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:09:57.425758 (+ 21547us) log.cc:844] Serialized 52 byte log entry
0709 12:09:57.558750 (+132992us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:57.558792 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.558967 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:57.690157 (+131190us) raft_consensus.cc:1685] finished
0709 12:09:57.690179 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.690366 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33379,"raft.queue_time_us":39750,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":8270,"spinlock_wait_cycles":78720,"thread_start_us":102639,"threads_started":1,"wal-append.queue_time_us":219846}
I20260709 12:09:57.712636 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:57.445184 25767 rpcz_store.cc:276] 0709 12:09:56.295861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.974177 (+678316us) service_pool.cc:224] Handling call
0709 12:09:56.974685 (+   508us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:09:56.975269 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:56.975306 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:09:56.976039 (+   733us) log.cc:844] Serialized 52 byte log entry
0709 12:09:57.284486 (+308447us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:57.436726 (+152240us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.438174 (+  1448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.438294 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:57.438342 (+    48us) raft_consensus.cc:1685] finished
0709 12:09:57.438352 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.441768 (+  3416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028,"raft.queue_time_us":14073,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":4209,"thread_start_us":425087,"threads_started":2,"wal-append.queue_time_us":415511}
I20260709 12:09:57.733323 25759 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:57.665845 25686 rpcz_store.cc:276] 0709 12:09:56.544361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.444163 (+899802us) service_pool.cc:224] Handling call
0709 12:09:57.484244 (+ 40081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.575189 (+ 90945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.593416 (+ 18227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.744019 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:57.705765 27040 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:57.722757 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:57.677850 25691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:09:57.754220 25691 raft_consensus.cc:606] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:57.754678 25691 raft_consensus.cc:614] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:57.756045 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:57.756700 25767 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:57.757764 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 262810us
I20260709 12:09:57.731529 26889 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.760987 25616 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.750188 26994 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:57.744939 27097 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:57.763823 26893 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.768209 25694 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:57.728652 25685 rpcz_store.cc:276] 0709 12:09:56.267374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.979864 (+712490us) service_pool.cc:224] Handling call
0709 12:09:57.675168 (+695304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.768524 26893 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:57.762445 26889 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:57.827936 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 115493us
I20260709 12:09:57.810036 26893 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:57.838281 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 118276us
I20260709 12:09:57.768266 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:57.863581 25616 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
W20260709 12:09:57.863832 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.809934 27040 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:57.884637 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.866572 26894 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:57.902379 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1125) took 1583 ms. Trace:
I20260709 12:09:57.862810 26994 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:57.919314 27160 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.901777 27024 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:09:57.935218 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 130017us
I20260709 12:09:57.902743 26894 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:09:57.926913 27155 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:09:57.937410 25767 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:57.935436 25610 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.008s
W20260709 12:09:57.936790 26568 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.006s
I20260709 12:09:57.917563 25762 rpcz_store.cc:276] 0709 12:09:56.319109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.347511 (+1028402us) service_pool.cc:224] Handling call
0709 12:09:57.390578 (+ 43067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.438220 (+ 47642us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:57.750637 (+312417us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.901842 (+151205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.901925 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:57.901986 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.902086 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.902291 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19068,"prepare.queue_time_us":229072,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6019,"thread_start_us":376008,"threads_started":2}
I20260709 12:09:57.927173 27040 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.927989 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:57.951241 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:57.951903 25767 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:09:57.953310 25583 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.622s (SENT)
W20260709 12:09:57.955045 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 126137us
I20260709 12:09:57.955727 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:57.926180 26893 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.946081 26926 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:57.960119 26994 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:09:57.957309 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 251884us
I20260709 12:09:57.949350 26568 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.928612 27101 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.947810 25610 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:09:57.966398 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:57.972468 25762 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.968639 26894 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:57.992888 26894 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.978752 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:57.994086 26889 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.996299 25768 raft_consensus.cc:2368] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4.
W20260709 12:09:57.996277 25694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 728) took 1679 ms (client timeout 1622 ms). Trace:
W20260709 12:09:57.996845 25694 rpcz_store.cc:269] 0709 12:09:56.317170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.347771 (+ 30601us) service_pool.cc:224] Handling call
0709 12:09:57.996056 (+1648285us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54000aad54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:57.996205 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292093824}
I20260709 12:09:57.997267 26889 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:57.999681 26795 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.002182 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 752) took 1703 ms. Trace:
I20260709 12:09:57.970624 26926 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:57.989707 27101 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:57.979044 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1218) took 1001 ms. Trace:
I20260709 12:09:58.007753 25762 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:57.982792 27159 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.003806 25761 rpcz_store.cc:276] 0709 12:09:56.298357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.322204 (+1023847us) service_pool.cc:224] Handling call
0709 12:09:57.347246 (+ 25042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.375948 (+ 28702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.375986 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.382970 (+  6984us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:57.383033 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.383139 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.001924 (+618785us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b5400316fd0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:58.002091 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56625408}
I20260709 12:09:57.990309 27156 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.011384 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48409us
I20260709 12:09:57.990005 26893 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:58.002162 26795 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:57.983438 26568 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.015268 27159 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:58.008201 25610 rpcz_store.cc:276] 0709 12:09:56.975184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.976284 (+  1100us) service_pool.cc:224] Handling call
0709 12:09:57.976159 (+999875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:58.018065 27159 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.023169 26926 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.025775 27099 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:58.029778 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.039108 25760 raft_consensus.cc:2368] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4.
I20260709 12:09:58.039454 25765 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:09:58.042718 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1133) took 1052 ms. Trace:
I20260709 12:09:58.043286 25764 rpcz_store.cc:276] 0709 12:09:56.990243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.024116 (+ 33873us) service_pool.cc:224] Handling call
0709 12:09:58.042490 (+1018374us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54003188d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:09:58.042637 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434912512}
I20260709 12:09:58.045737 27099 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:58.068142 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 723) took 1799 ms. Trace:
I20260709 12:09:58.073189 27169 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:09:58.068651 25689 rpcz_store.cc:276] 0709 12:09:56.268958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.417324 (+1148366us) service_pool.cc:224] Handling call
0709 12:09:57.446173 (+ 28849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.463561 (+ 17388us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:09:57.463918 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:09:58.067619 (+603701us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18003eef60. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb2d53060 00007fbdb2d65716 00007fbdb2d76287
0709 12:09:58.067740 (+   121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:58.067802 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:58.067844 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.067924 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.068059 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":734,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":37378,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":14341,"spinlock_wait_cycles":25233152,"thread_start_us":163524,"threads_started":2,"wal-append.queue_time_us":184217}
I20260709 12:09:58.080169 27169 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:09:58.080467 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.082149 26926 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.082461 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.083024 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:58.083038 26926 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.084225 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.085187 26568 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:58.085595 26568 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.085976 26568 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.086102 26926 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.080991 27169 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.089416 26859 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.093432 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.094573 26896 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.095005 26896 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.095381 26896 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.099547 27169 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:09:58.107215 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.101121 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 56) took 1907 ms. Trace:
I20260709 12:09:58.109754 25687 rpcz_store.cc:276] 0709 12:09:56.193449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.329479 (+1136030us) service_pool.cc:224] Handling call
0709 12:09:57.329829 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.443313 (+113484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.100779 (+657466us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003c3cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:09:58.101037 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255667456}
W20260709 12:09:58.111747 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.113024 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.097391 26568 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.115044 26859 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.115191 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.115680 26859 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.116349 27151 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:58.117048 26568 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.116752 26859 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:58.117537 27137 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.604s	user 0.000s	sys 0.006s
I20260709 12:09:58.118362 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.116902 27151 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.119223 25657 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.119508 27151 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.120774 27095 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:58.124764 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.125846 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.127465 26568 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.129014 26826 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.129509 25610 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:58.133900 26568 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.125766 26968 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.129722 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.135746 27030 consensus_queue.cc:1059] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:58.137588 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:58.142619 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.146026 25732 connection.cc:256] RPC call timeout handler was delayed by -2.2560912760000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 12:09:58.160990 25732 connection.cc:256] RPC call timeout handler was delayed by -2.245291275999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 12:09:58.164242 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:58.163540 25732 connection.cc:256] RPC call timeout handler was delayed by -2.1588912760000767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 12:09:58.166810 27152 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.166388 26568 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.167913 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.154803 27095 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.174497 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.161998 26968 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.177413 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.165314 27030 raft_consensus.cc:3055] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:58.178721 26988 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.186081 27030 raft_consensus.cc:740] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:58.186295 26988 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.172068 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:58.187338 25610 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:58.188125 27030 consensus_queue.cc:260] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.189720 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:58.190442 25612 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:58.190560 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:58.191360 25617 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:58.189824 27030 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.186741 26988 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.193292 27152 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.193831 27152 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.197029 27152 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.183329 26968 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.186004 26896 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.206764 25619 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.210561 25616 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:58.215154 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.207963 27156 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:09:58.229156 26896 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.231981 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.233619 26896 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.234050 26896 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.234097 25582 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.234545 26896 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.235211 27158 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.237874 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:58.248864 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.246819 27158 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:58.250694 27156 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:58.250402 27152 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:09:58.258050 27158 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.265811 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.269373 25658 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.271306 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.272567 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.266539 26859 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:09:58.279757 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46414.8us
I20260709 12:09:58.280865 27159 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:58.281713 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45514
I20260709 12:09:58.289683 25619 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:09:58.298164 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.298024 26988 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.291057 27159 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.299535 27159 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.300879 26988 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.274760 27152 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:58.302637 27152 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.303110 27152 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.298193 25762 raft_consensus.cc:606] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.304945 25762 raft_consensus.cc:614] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:09:58.308636 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.274075 26826 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:58.310485 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.320644 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.290807 26918 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.324653 26795 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.319630 26826 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.327435 26984 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:58.341101 26984 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.341566 26984 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.270396 27156 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.347925 26896 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.333186 26826 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:09:58.355748 27181 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 12:09:58.326804 26918 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.359436 26918 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.363538 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.364665 27151 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:58.366725 26896 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.374536 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.375538 26896 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.375958 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.376926 26795 raft_consensus.cc:2764] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:09:58.379452 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.375980 26896 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.383275 26896 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.388000 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:58.395939 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 227823us
W20260709 12:09:58.396606 25732 connection.cc:256] RPC call timeout handler was delayed by -2.1309912760000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:09:58.396935 25732 connection.cc:256] RPC call timeout handler was delayed by -2.092291275999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:09:58.397703 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0643912759999239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:09:58.398072 25732 connection.cc:256] RPC call timeout handler was delayed by -1.9950912760000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 12:09:58.398464 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.399261 27099 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.399699 26893 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.399853 26894 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.399976 27099 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.400316 26893 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.400727 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.400943 27101 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.402050 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.402750 26889 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:58.403187 26889 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:09:58.403542 27099 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:58.403596 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.404091 27161 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.404814 26893 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:58.404969 27161 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:58.405833 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:58.400728 26894 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.406538 25760 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:09:58.407096 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:58.407763 25765 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:58.408164 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:58.408973 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:58.409700 25765 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 2: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:58.410409 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:58.410634 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:58.410845 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:58.411378 26334 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 1.
I20260709 12:09:58.406082 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:09:58.412855 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.412789 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:58.404282 26889 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.414637 26894 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:58.402093 27101 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:58.414985 26889 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.411713 25765 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:58.418090 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.411491 25759 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 1.
I20260709 12:09:58.388655 27159 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.420114 26303 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.421831 27182 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.422019 26303 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.423241 27030 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.425868 26568 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:58.426815 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.427145 26568 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.396100 27152 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.427836 26795 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.427870 27058 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:58.428426 26795 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.428838 26795 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.427703 26568 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.427706 27095 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.429387 26568 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.429654 27095 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.431416 27030 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.431073 27095 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.422178 27159 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:58.432547 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53233.3us
I20260709 12:09:58.432685 27095 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.431718 26859 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.440114 25764 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:09:58.441834 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.422577 27182 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.446539 25687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:09:58.450376 25687 raft_consensus.cc:606] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:09:58.450793 25687 raft_consensus.cc:614] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:58.399250 26826 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.436898 26859 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.459168 25582 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.460337 27156 raft_consensus.cc:2764] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:09:58.452732 27182 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.463686 27156 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.463841 26303 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.465636 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.466463 27030 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.466478 27156 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.467242 27030 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.467307 27156 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.467725 27030 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.468034 27156 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.467260 26859 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.474402 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.495471 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:58.501698 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 56274.6us
I20260709 12:09:58.502993 25657 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.497968 26896 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.494342 26984 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.508827 26984 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.509263 26896 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.466071 26918 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.466018 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:58.512179 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45514
I20260709 12:09:58.512892 25764 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:58.512959 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47139.6us
I20260709 12:09:58.513319 25764 raft_consensus.cc:614] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:58.503777 27159 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.506451 26826 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.506323 27156 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.514349 27129 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.517863 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:58.532138 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:09:58.533849 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59635.6us
I20260709 12:09:58.525470 26984 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.522953 27129 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.543126 27129 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.545773 25615 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:58.539521 27156 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.546507 26994 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.554296 26994 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.556749 26994 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:58.547291 26968 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:58.560612 26968 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.561039 26968 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.526458 27159 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:58.556259 26795 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.565980 25619 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:58.565783 27159 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:58.566738 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.541656 26984 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:58.568636 26984 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.571115 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.572201 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.572502 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.572850 25616 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.573325 25610 raft_consensus.cc:2368] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:09:58.574818 25617 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:58.577186 25658 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.539497 26918 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.547058 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.578543 26988 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:58.579236 27156 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.579294 26988 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.579838 27156 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:58.580456 26988 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.580830 27156 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.528330 27152 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.559569 27030 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.581990 25617 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:09:58.582826 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60661.9us
I20260709 12:09:58.583982 25658 leader_election.cc:400] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:09:58.586748 26568 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.593763 25658 leader_election.cc:403] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:09:58.588165 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:58.589251 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:58.599996 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.603327 26795 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.606981 26568 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.589010 25516 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129), VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130), VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131), VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 3 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.610170 25616 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:58.610102 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.621721 25582 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.625918 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:58.628970 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:58.599996 26896 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:58.631433 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.609670 27152 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:58.604349 27151 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:09:58.630219 25764 raft_consensus.cc:2376] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4. Re-sending same reply.
I20260709 12:09:58.624806 26795 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:09:58.644472 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47892.8us
I20260709 12:09:58.645572 25616 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.645570 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.628155 25516 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.609982 26826 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:09:58.599736 27129 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.618870 26918 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:09:58.653196 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.654893 26568 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:58.647920 27158 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.657537 26568 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.658120 27058 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:58.657994 27095 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.658082 25582 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.648967 27169 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.646966 26795 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.663012 27158 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.664294 27182 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.681392 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:09:58.690945 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:58.693408 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:58.667037 26988 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.666657 26568 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.656024 27159 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:09:58.668915 27129 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.669688 26859 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.669742 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:58.673349 27030 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.673622 26984 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.694562 25517 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 174) took 1874 ms. Trace:
I20260709 12:09:58.688858 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.696919 25616 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:58.678818 27058 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.685531 26795 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:58.691156 27158 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:58.734234 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 64154.6us
I20260709 12:09:58.699986 26896 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.700095 27196 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.699252 27152 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:09:58.715518 26988 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:58.747046 27205 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:09:58.720788 26994 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:58.724009 26859 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.690505 27182 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:58.939067 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:58.774449 27205 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.952661 27205 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:09:58.953012 26859 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.954643 27200 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.956192 27200 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:58.956820 27200 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:58.884960 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 194426us
I20260709 12:09:58.959219 25619 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:58.732190 25517 rpcz_store.cc:276] 0709 12:09:56.810440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.810712 (+   272us) service_pool.cc:224] Handling call
0709 12:09:58.685142 (+1874430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:58.024524 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:58.035122 (+ 10598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:58.035178 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:09:58.035197 (+    19us) tablet.cc:662] Decoding operations
0709 12:09:58.037521 (+  2324us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:58.037624 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:58.037651 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:09:58.125682 (+ 88031us) tablet.cc:701] Row locks acquired
0709 12:09:58.125751 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:09:58.126043 (+   292us) write_op.cc:270] Start()
0709 12:09:58.126347 (+   304us) write_op.cc:276] Timestamp: P: 1783598998125864 usec, L: 0
0709 12:09:58.126400 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:09:58.127234 (+   834us) log.cc:844] Serialized 4454 byte log entry
0709 12:09:58.391447 (+264213us) op_driver.cc:464] REPLICATION: finished
0709 12:09:58.510792 (+119345us) write_op.cc:301] APPLY: starting
0709 12:09:58.510915 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:58.511206 (+   291us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:58.511361 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:58.512954 (+  1593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:58.513311 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:09:58.513377 (+    66us) write_op.cc:312] APPLY: finished
0709 12:09:58.513773 (+   396us) log.cc:844] Serialized 82 byte log entry
0709 12:09:58.513965 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.514131 (+   166us) write_op.cc:454] Released schema lock
0709 12:09:58.514196 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:58.541774 (+ 27578us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.575480 (+ 33706us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":114151,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":119034,"apply.run_cpu_time_us":3988,"apply.run_wall_time_us":19098,"num_ops":11,"prepare.queue_time_us":152164,"prepare.run_cpu_time_us":31650,"prepare.run_wall_time_us":211455,"raft.queue_time_us":107130,"raft.run_cpu_time_us":10187,"raft.run_wall_time_us":69350,"replication_time_us":264848,"thread_start_us":328778,"threads_started":4,"wal-append.queue_time_us":138087}]]}
I20260709 12:09:58.960740 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 42) took 1713 ms. Trace:
W20260709 12:09:58.922719 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 177791us
I20260709 12:09:58.747411 27169 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:09:58.775437 27196 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:58.739347 26896 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.786863 25614 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:09:58.971277 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.842450 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.942978 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.945115 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 132086us
W20260709 12:09:58.943215 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.942713 27101 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:09:58.940768 27197 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.201s	user 0.005s	sys 0.009s
I20260709 12:09:58.983003 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:58.949595 25687 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:58.950748 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.966462 27169 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:58.966333 27058 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:58.973054 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.988175 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.988627 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.771862 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:58.961234 25516 rpcz_store.cc:276] 0709 12:09:57.247156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.247382 (+   226us) service_pool.cc:224] Handling call
0709 12:09:58.960662 (+1713280us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:58.659785 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:58.660411 (+   626us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:58.660460 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:09:58.660474 (+    14us) tablet.cc:662] Decoding operations
0709 12:09:58.661027 (+   553us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:58.661089 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:58.661118 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:09:58.661409 (+   291us) tablet.cc:701] Row locks acquired
0709 12:09:58.661425 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:09:58.661592 (+   167us) write_op.cc:270] Start()
0709 12:09:58.661709 (+   117us) write_op.cc:276] Timestamp: P: 1783598998661541 usec, L: 0
0709 12:09:58.661727 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:09:58.663719 (+  1992us) log.cc:844] Serialized 988 byte log entry
0709 12:09:58.666743 (+  3024us) op_driver.cc:464] REPLICATION: finished
0709 12:09:58.667455 (+   712us) write_op.cc:301] APPLY: starting
0709 12:09:58.667547 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:58.667665 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:58.667762 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:58.668141 (+   379us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:58.668277 (+   136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:09:58.668310 (+    33us) write_op.cc:312] APPLY: finished
0709 12:09:58.668479 (+   169us) log.cc:844] Serialized 28 byte log entry
0709 12:09:58.668640 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.668738 (+    98us) write_op.cc:454] Released schema lock
0709 12:09:58.668787 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:58.669158 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.669185 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":22231,"mutex_wait_us":30512,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":477,"apply.run_cpu_time_us":1671,"apply.run_wall_time_us":1671,"num_ops":2,"prepare.queue_time_us":235,"prepare.run_cpu_time_us":3249,"prepare.run_wall_time_us":6261,"replication_time_us":4860}]]}
I20260709 12:09:58.975080 26896 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.963001 26968 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.019867 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.020629 25765 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.963968 26994 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:59.022732 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.990119 25515 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 2 to 3, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.024082 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.024885 25764 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.029090 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.029963 25759 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:59.032225 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.025337 25515 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 3 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 4 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:59.039163 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 56291.7us
I20260709 12:09:59.035195 25515 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 2 to 3, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.001777 27101 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.038771 27152 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:09:59.046566 25657 leader_election.cc:400] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4.
I20260709 12:09:59.050047 25687 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:59.055825 25616 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.052953 25765 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:59.063072 25515 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:59.070031 25515 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:59.072716 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:59.072080 25515 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.046394 27207 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.051589 26984 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:59.080209 25515 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:59.082898 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 389546us
I20260709 12:09:59.005281 26988 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.084560 25515 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 3, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:59.085843 25764 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:09:59.038448 26859 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.090471 25515 catalog_manager.cc:5697] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 2 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:59.100884 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:59.087692 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.112620 27205 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:59.113710 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46908.4us
I20260709 12:09:59.114914 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:09:59.115396 27205 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.118319 27101 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:59.119122 27101 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:59.112820 25515 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:59.119889 27101 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.122913 25515 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 2 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 4 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.094141 25610 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.125538 25657 leader_election.cc:400] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4.
I20260709 12:09:59.130898 25515 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 1 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:09:59.132087 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:09:59.134716 25583 leader_election.cc:336] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.809s (SENT)
I20260709 12:09:59.085031 27095 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:09:59.108805 27156 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:59.142817 25582 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:59.127228 26826 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.188143 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.060794 27196 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:59.307168 25689 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
W20260709 12:09:59.308734 25583 leader_election.cc:336] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.038s (SENT)
I20260709 12:09:59.309316 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:59.311128 25688 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:09:59.263590 27156 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:59.242944 26968 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.323439 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.109910 27158 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.325136 25689 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:09:59.326618 27158 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.123126 26303 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:09:59.327785 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 226980us
I20260709 12:09:59.139889 26795 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.331106 26795 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.331957 27030 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.332621 27030 raft_consensus.cc:697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:59.334479 25615 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:09:59.321986 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.184576 26988 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.244153 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.346076 25690 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.236737 27209 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.138772 27212 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.244455 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.245079 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.352612 25692 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.226058 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.186196 26918 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.312691 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:59.313213 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 124127us
I20260709 12:09:59.318387 26994 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:59.318797 27213 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:59.323091 27217 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:09:59.330669 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.242787 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.246012 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.245239 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.346982 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.363722 25583 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.646s (SENT)
W20260709 12:09:59.347910 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 205155us
I20260709 12:09:59.347842 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:59.348688 25759 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:09:59.356151 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.316862 27156 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:09:59.355415 26994 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:09:59.372381 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.376580 25694 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.376977 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.350507 27200 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:09:59.349527 27209 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.378015 25687 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.373550 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.368076 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:09:59.352128 27212 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:09:59.333709 27030 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:59.384339 25691 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.387321 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.386657 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:09:59.388434 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.390295 26968 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:59.380271 26994 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.380498 27213 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:09:59.376942 27156 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.397162 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.398368 27212 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.398659 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.402725 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.358772 27101 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:59.404088 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.405247 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.402851 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.408110 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:59.394021 26994 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:59.412822 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:09:59.413446 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.416814 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48813.6us
I20260709 12:09:59.417539 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.386513 25686 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.419102 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.419883 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.419090 25616 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:59.386242 27220 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.422926 26826 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:59.446094 27200 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.446512 27220 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.357242 26918 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.447713 26826 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.448251 26826 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.448992 27220 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:09:59.449185 26918 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.449908 25689 raft_consensus.cc:2376] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
I20260709 12:09:59.416196 27058 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.450479 26826 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:09:59.451103 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3869923480001489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:09:59.451474 25657 connection.cc:256] RPC call timeout handler was delayed by -1.0485923480000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:09:59.451730 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.453193 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.453608 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.453835 25686 raft_consensus.cc:2376] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
I20260709 12:09:59.435722 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.466734 25691 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.467425 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.468107 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.469316 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.436033 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.437618 26859 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.441686 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:59.441702 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:09:59.445483 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:59.446785 27200 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.425520 27095 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:09:59.454417 25765 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:59.454972 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:59.455296 27158 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.386745 27159 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:59.455935 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.534216 26896 consensus_meta.cc:287] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 12:09:59.572726 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.573438 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.435447 26795 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.389544 27209 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.421959 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.470552 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.425067 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.484038 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.524503 25692 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.499119 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.469859 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.481841 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.528365 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.589612 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.589800 25764 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:09:59.531953 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:59.533326 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.532470 25612 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:09:59.522718 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.538817 25616 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:09:59.590370 25692 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:09:59.557817 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.558187 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.557915 25761 raft_consensus.cc:1240] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.593750 25691 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.566948 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.594897 25768 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:59.559207 27204 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:09:59.571938 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:59.571888 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.582448 25759 raft_consensus.cc:2376] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3. Re-sending same reply.
I20260709 12:09:59.600955 25611 raft_consensus.cc:2368] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:09:59.584703 25689 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:59.590355 25762 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:59.592806 25760 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:59.576239 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.603029 25767 raft_consensus.cc:2368] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:09:59.592693 25766 raft_consensus.cc:2376] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3. Re-sending same reply.
I20260709 12:09:59.593994 26337 raft_consensus.cc:2393] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:09:59.604295 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.609129 25765 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:09:59.557860 27095 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:09:59.575568 27196 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.617496 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.575285 26795 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.622076 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.622395 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.623235 25767 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.627610 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.627403 26568 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:59.627792 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.628257 25760 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.628711 25766 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.567889 27220 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:09:59.640647 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.641955 25689 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.634717 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.632395 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:09:59.635860 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.636551 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.646623 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.647557 25759 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:09:59.648312 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.649046 25688 raft_consensus.cc:2410] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:59.605044 26826 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.605602 25685 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:59.583042 26896 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:09:59.602134 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 156809us
I20260709 12:09:59.663324 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.630815 27205 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:59.608649 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.662144 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.689736 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.701416 25766 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.593797 26994 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:09:59.627480 26795 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.659324 25762 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:09:59.675451 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:09:59.677321 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:59.706940 25616 raft_consensus.cc:2368] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:59.693002 25767 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:59.704044 25689 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:09:59.673507 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:09:59.709857 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.693965 27217 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:09:59.714972 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.735103 25611 raft_consensus.cc:2410] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:09:59.716945 26568 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.735973 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:59.719066 27224 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:09:59.719923 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:09:59.720292 27223 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:09:59.720762 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.728461 26896 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.729171 25619 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:09:59.647913 27196 raft_consensus.cc:697] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:09:59.717268 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.739310 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.674860 27216 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:09:59.737672 25616 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:09:59.748914 25732 leader_election.cc:336] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.624s (SENT)
I20260709 12:09:59.676250 26826 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.756378 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.883924 25693 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:09:59.866606 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.832971 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 378034us
I20260709 12:09:59.827310 25766 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:09:59.889720 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:09:59.772697 25611 raft_consensus.cc:1217] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:09:59.783756 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.892385 25767 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:09:59.766752 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 93509.8us
I20260709 12:09:59.787119 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.889729 25762 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.781417 25690 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:09:59.894717 25611 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:09:59.892259 25689 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.745064 25760 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:09:59.897663 25612 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:09:59.902772 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.903254 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.904036 25611 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:59.906078 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.906807 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.908114 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.908516 25690 raft_consensus.cc:2368] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:09:59.909622 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.911345 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.918747 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:09:59.898669 26988 consensus_meta.cc:287] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.002s
I20260709 12:09:59.926107 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:09:59.927994 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.928804 25767 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.919523 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:09:59.920603 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.921123 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:09:59.924151 25692 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:59.889843 27205 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:09:59.769598 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.891754 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:09:59.763163 27212 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:09:59.936544 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.775411 27200 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:09:59.899241 26994 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.761693 26334 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:09:59.787225 26337 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.952556 25616 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:10:00.000023 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:09:59.952652 25760 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.906796 27220 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.006848 27220 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.008410 26338 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.958616 25612 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:09:59.961787 25762 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:10:00.017982 27058 consensus_meta.cc:287] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.567s	user 0.014s	sys 0.000s
I20260709 12:09:59.963351 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.971417 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.029351 25691 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.030493 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.031984 25691 raft_consensus.cc:2410] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:00.033273 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.935384 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.034848 25766 raft_consensus.cc:2368] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:10:00.036010 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:00.036789 25766 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:00.031039 25690 raft_consensus.cc:2393] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:09:59.980218 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.981683 25689 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:00.039917 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.039813 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.761701 27156 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.040825 25766 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:00.041807 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.034041 25691 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:00.043931 27156 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.044466 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.045728 25691 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:00.040831 25689 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:00.047475 26304 leader_election.cc:336] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.570s (SENT)
I20260709 12:10:00.047677 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:00.028476 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.048609 25689 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:00.051512 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:00.054154 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 305247us
I20260709 12:10:00.054600 25689 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.047878 25766 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:00.053165 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.061535 25759 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.051646 25760 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:00.064199 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:00.067013 25760 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:00.068563 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.068828 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.069310 25760 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.069535 25615 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.065322 27058 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.047679 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:00.072543 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.077791 25767 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:00.078454 25689 raft_consensus.cc:2393] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 2: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:00.082659 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:00.082960 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.092291 25689 raft_consensus.cc:2393] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:00.093724 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 88221.5us
I20260709 12:09:59.986523 25685 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
W20260709 12:10:00.010315 27232 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:00.090444 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.010246 27220 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:00.139446 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:09:59.971452 27205 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:09:59.970813 27196 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:00.124257 25687 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:10:00.110211 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.154138 25616 raft_consensus.cc:1217] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:10:00.154840 25616 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:00.155323 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:00.156909 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.152218 25689 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:00.140148 25691 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.159821 25615 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:00.110430 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 63007.5us
W20260709 12:10:00.171104 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.127008 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.002314 26994 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.108271 25759 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:10:00.140079 25766 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:00.127008 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.166985 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.178381 25767 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.179320 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.180409 25766 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.181632 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:00.182379 25766 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:00.183230 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.183774 25766 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.098308 25610 raft_consensus.cc:1240] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:00.110558 27216 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:00.117897 25760 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:00.115432 25694 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:00.190238 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.191004 25760 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.194612 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:00.195953 25759 raft_consensus.cc:2393] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 3: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:00.192705 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.207592 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.208420 25615 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:00.209558 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:00.209841 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.210862 25691 raft_consensus.cc:2393] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:00.210929 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.214044 25759 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:00.215036 25759 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:00.221323 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.223177 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.226393 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.223701 25760 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:00.227349 25689 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:00.228552 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:00.225525 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 130247us
I20260709 12:10:00.156013 26896 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:00.164244 27243 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:00.237310 25759 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.224032 25690 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.242048 25759 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.246949 25613 raft_consensus.cc:1217] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 12:10:00.247649 25613 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:00.243847 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 161300us
I20260709 12:10:00.251645 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.253147 25615 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.253304 25690 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:00.093433 27058 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.207311 27207 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.207258 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.268285 25759 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:00.338627 27238 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:10:00.316422 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.318006 25762 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:00.475410 25685 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.476228 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 765) took 1102 ms. Trace:
I20260709 12:10:00.476608 25685 rpcz_store.cc:276] 0709 12:09:59.373719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.474592 (+1100873us) service_pool.cc:224] Handling call
0709 12:10:00.474988 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.475911 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.476163 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.477701 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.478444 25614 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:00.479506 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.480679 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.239941 26338 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:00.332001 27233 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:10:00.483062 26337 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:00.333719 27235 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 12:10:00.484127 27245 log.cc:927] Time spent T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:00.344910 27244 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.485605 25685 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:00.485962 27244 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:00.486644 27244 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.360906 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.491096 25617 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.492869 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:00.332880 27239 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:10:00.315763 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:00.494623 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.495767 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.424678 26918 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:00.343652 26334 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:00.216306 27216 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.318975 25761 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:00.421540 27058 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.324554 26826 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.347973 27156 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.348963 27247 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:00.325336 27243 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.353674 27251 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 12:10:00.423880 27209 consensus_meta.cc:287] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.003s
I20260709 12:10:00.434772 27095 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.436688 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.354732 27205 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:00.347261 26994 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:00.535713 25763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.026s
I20260709 12:10:00.350632 27212 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:00.555308 25763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.026s
I20260709 12:10:00.428207 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:00.556197 25688 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.556799 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1165) took 1002 ms. Trace:
I20260709 12:10:00.520074 26918 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:00.421492 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.559644 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.557499 25763 rpcz_store.cc:276] 0709 12:09:59.555685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.695641 (+139956us) service_pool.cc:224] Handling call
0709 12:09:59.782797 (+ 87156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:59.822721 (+ 39924us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:59.999710 (+176989us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.556277 (+556567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.556365 (+    88us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:00.556425 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.556522 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.556722 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":630,"prepare.queue_time_us":325578,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"thread_start_us":584234,"threads_started":2}
I20260709 12:10:00.561172 26918 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.561542 25763 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:00.555173 25686 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:00.563968 25686 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.564908 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 868) took 1112 ms. Trace:
I20260709 12:10:00.462107 25767 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:00.397630 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.322404 26340 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.459194 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:00.416450 27101 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:00.408059 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.468163 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 769) took 1076 ms. Trace:
I20260709 12:10:00.317512 25766 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:00.472409 25759 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:00.583271 25761 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:00.583895 25761 pending_rounds.cc:85] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 2
I20260709 12:10:00.584236 25761 pending_rounds.cc:107] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:00.584595 25761 raft_consensus.cc:2889] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:00.490171 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1276) took 1180 ms. Trace:
I20260709 12:10:00.496670 25615 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:00.498801 25762 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:00.493860 25617 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
W20260709 12:10:00.510010 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.524168 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.531411 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 285871us
I20260709 12:10:00.565300 25686 rpcz_store.cc:276] 0709 12:09:59.452542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.563436 (+1110894us) service_pool.cc:224] Handling call
0709 12:10:00.563762 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.564638 (+   876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.564838 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.531883 27156 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.591310 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.604174 25614 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:00.526199 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 770) took 1133 ms. Trace:
W20260709 12:10:00.587620 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.528096 27247 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:00.601006 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.600534 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.593194 25688 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:00.611987 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.612277 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 772) took 1219 ms. Trace:
I20260709 12:10:00.605739 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.611054 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.580812 27101 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:00.589102 25610 rpcz_store.cc:276] 0709 12:09:59.310128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.311723 (+  1595us) service_pool.cc:224] Handling call
0709 12:09:59.333110 (+ 21387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.203047 (+869937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.489855 (+286808us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400418054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:00.490084 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688506752}
I20260709 12:10:00.593858 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1162) took 1057 ms. Trace:
I20260709 12:10:00.608670 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.581771 25694 rpcz_store.cc:276] 0709 12:09:59.391945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.398351 (+  6406us) service_pool.cc:224] Handling call
0709 12:10:00.467944 (+1069593us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54003b8b54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:00.468083 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446677248}
I20260709 12:10:00.622888 25694 raft_consensus.cc:1240] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.623518 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 67) took 1084 ms. Trace:
I20260709 12:10:00.621524 25764 rpcz_store.cc:276] 0709 12:09:59.536826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.643440 (+106614us) service_pool.cc:224] Handling call
0709 12:09:59.696452 (+ 53012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:59.707212 (+ 10760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:59.707322 (+   110us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:59.712352 (+  5030us) log.cc:844] Serialized 26 byte log entry
0709 12:09:59.981290 (+268938us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:00.208872 (+227582us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.444375 (+235503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.444513 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:00.593501 (+148988us) raft_consensus.cc:1685] finished
0709 12:10:00.593535 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.593775 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140203,"prepare.queue_time_us":181750,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":117013,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":40,"spinlock_wait_cycles":664320,"thread_start_us":506358,"threads_started":3,"wal-append.queue_time_us":444762}
I20260709 12:10:00.623833 25694 rpcz_store.cc:276] 0709 12:09:59.539453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.622363 (+1082910us) service_pool.cc:224] Handling call
0709 12:10:00.622718 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.623271 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.623463 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.619081 25688 rpcz_store.cc:276] 0709 12:09:59.393177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.557034 (+1163857us) service_pool.cc:224] Handling call
0709 12:10:00.568484 (+ 11450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.611771 (+ 43287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.612191 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.612811 25615 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:00.593722 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 286369us
I20260709 12:10:00.604189 25583 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:00.575193 27095 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:00.635051 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:00.534662 27209 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:00.612989 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.615773 26795 consensus_meta.cc:287] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.004s
W20260709 12:10:00.613746 27248 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.275s	user 0.001s	sys 0.003s
I20260709 12:10:00.604250 25686 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.648746 25688 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.648765 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:00.688447 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 887) took 1140 ms. Trace:
I20260709 12:10:00.688539 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.689002 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:00.652942 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 48897.4us
I20260709 12:10:00.690407 25732 leader_election.cc:400] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:10:00.639066 27158 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.619271 25685 rpcz_store.cc:276] 0709 12:09:59.392285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.477653 (+1085368us) service_pool.cc:224] Handling call
0709 12:10:00.477981 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.486076 (+  8095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.522733 (+ 36657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.652630 26994 raft_consensus.cc:2764] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:00.533799 27243 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:00.690912 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.664142 27247 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.665519 25761 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.670872 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.589221 27255 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:00.632864 27216 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.651440 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.690718 25732 leader_election.cc:403] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:00.655158 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.688843 25688 rpcz_store.cc:276] 0709 12:09:59.547778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.626673 (+1078895us) service_pool.cc:224] Handling call
0709 12:10:00.648551 (+ 21878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.688118 (+ 39567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.688386 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:00.686669 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.630908 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 165521us
I20260709 12:10:00.697449 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:00.708010 27158 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.695938 25615 raft_consensus.cc:2376] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4. Re-sending same reply.
I20260709 12:10:00.622529 27207 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.704424 25614 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:00.711315 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 196039us
I20260709 12:10:00.696017 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:00.692762 27254 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:00.722515 27220 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4.
I20260709 12:10:00.722375 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:00.724570 27207 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.724949 27243 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:00.722362 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:00.670734 26795 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.694767 27250 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:00.748111 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57837.7us
I20260709 12:10:00.741644 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:00.717700 27247 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.709529 27158 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:00.720800 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 878) took 1253 ms. Trace:
I20260709 12:10:00.761809 27260 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:00.773113 25732 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.733s (SENT)
I20260709 12:10:00.776829 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:00.778250 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:00.778455 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:00.778455 25694 raft_consensus.cc:606] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:00.779906 25694 raft_consensus.cc:614] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:00.782356 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:00.747007 26988 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.787899 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1266) took 1827 ms. Trace:
I20260709 12:10:00.789373 25614 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:00.762584 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:00.796738 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.788368 25619 rpcz_store.cc:276] 0709 12:09:58.960585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.960703 (+   118us) service_pool.cc:224] Handling call
0709 12:09:58.961061 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:59.887944 (+926883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.787552 (+899608us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400419454. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:00.787826 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1765900160}
W20260709 12:10:00.783188 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 58677.6us
I20260709 12:10:00.811033 25619 raft_consensus.cc:3055] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.811043 25618 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:00.757913 27212 consensus_queue.cc:1059] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:00.774039 27260 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:00.814823 25619 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:00.820480 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1289) took 1145 ms. Trace:
I20260709 12:10:00.820119 25619 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:00.811419 25732 leader_election.cc:336] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.962s (SENT)
I20260709 12:10:00.728300 27101 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.823024 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:00.784608 26988 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:00.821658 25619 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.786039 27204 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.772045 27030 consensus_queue.cc:1059] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:00.793242 27156 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.821071 25611 rpcz_store.cc:276] 0709 12:09:59.675344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.922755 (+247411us) service_pool.cc:224] Handling call
0709 12:09:59.923118 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:59.973164 (+ 50046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:59.973212 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:59.984912 (+ 11700us) log.cc:844] Serialized 26 byte log entry
0709 12:10:00.480748 (+495836us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b18003fe140. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:10:00.586164 (+105416us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:00.586444 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.586898 (+   454us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:00.814218 (+227320us) raft_consensus.cc:1685] finished
0709 12:10:00.814244 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.820365 (+  6121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18782,"raft.queue_time_us":19582,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":16473,"spinlock_wait_cycles":126433152,"thread_start_us":105194,"threads_started":1,"wal-append.queue_time_us":645371}
I20260709 12:10:00.816248 27220 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:00.833794 26988 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.774997 25686 rpcz_store.cc:276] 0709 12:09:59.455454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.603552 (+1148098us) service_pool.cc:224] Handling call
0709 12:10:00.603990 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.694900 (+ 90910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.709143 (+ 14243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.835111 27101 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.851429 25766 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.852787 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 796) took 1129 ms. Trace:
W20260709 12:10:00.853312 25732 leader_election.cc:336] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 2.022s (SENT)
I20260709 12:10:00.853605 25766 rpcz_store.cc:276] 0709 12:09:59.723291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.850686 (+1127395us) service_pool.cc:224] Handling call
0709 12:10:00.851177 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.852312 (+  1135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.852629 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.840574 27250 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.857601 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.847754 27209 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.859781 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:00.860476 25619 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 4. (term mismatch)
I20260709 12:10:00.861174 25766 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:00.861259 25619 pending_rounds.cc:85] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 3
I20260709 12:10:00.862244 25619 pending_rounds.cc:107] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
W20260709 12:10:00.861415 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.862679 25619 raft_consensus.cc:2917] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 12:10:00.863435 25619 raft_consensus.cc:2889] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:00.863909 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:00.864303 26795 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:00.864550 27263 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:10:00.864884 26340 raft_consensus.cc:2393] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:00.865103 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.866199 25766 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:00.867161 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 803) took 1141 ms. Trace:
I20260709 12:10:00.867448 25766 rpcz_store.cc:276] 0709 12:09:59.725431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.863040 (+1137609us) service_pool.cc:224] Handling call
0709 12:10:00.863406 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.866901 (+  3495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.867111 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.869383 25766 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:00.862555 27221 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.860500 27230 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:00.870059 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 804) took 1144 ms. Trace:
I20260709 12:10:00.867751 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53278 (request call id 64) took 2182 ms. Trace:
I20260709 12:10:00.871389 25619 rpcz_store.cc:276] 0709 12:09:58.683960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.684120 (+   160us) service_pool.cc:224] Handling call
0709 12:09:59.012198 (+328078us) log.cc:844] Serialized 508 byte log entry
0709 12:09:59.420998 (+408800us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b54001b24a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd4142 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634 0000000000388479 00007fbdafc6e475
0709 12:09:59.444056 (+ 23058us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b2c000fcb58. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1663a0a 00007fbdb1663693 00007fbdb1663631 00007fbdb2d97b52 00007fbdb2d97cf5 00007fbdb2cd4691 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69
0709 12:09:59.450081 (+  6025us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b180014bec0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d97d01 00007fbdb2cd4691 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634 0000000000388479
0709 12:10:00.865912 (+1415831us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7944,"mutex_wait_us":45073,"raft.queue_time_us":100326,"raft.run_cpu_time_us":16216,"raft.run_wall_time_us":481514,"spinlock_wait_cycles":100108032,"thread_start_us":74437,"threads_started":1,"wal-append.queue_time_us":315319,"wal-append.run_cpu_time_us":2296,"wal-append.run_wall_time_us":1047417}
I20260709 12:10:00.870767 25766 rpcz_store.cc:276] 0709 12:09:59.725732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.868573 (+1142841us) service_pool.cc:224] Handling call
0709 12:10:00.868881 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.869767 (+   886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.869978 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.874732 27230 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.875156 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:00.880671 27230 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:00.886547 27258 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.107s	user 0.000s	sys 0.002s
I20260709 12:10:00.865840 27158 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:00.887787 27265 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:00.888460 27260 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:00.889469 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 794) took 1167 ms. Trace:
I20260709 12:10:00.893807 25760 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:00.894556 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 806) took 1168 ms. Trace:
I20260709 12:10:00.896679 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 751) took 1568 ms. Trace:
I20260709 12:10:00.897364 25692 rpcz_store.cc:276] 0709 12:09:59.328109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.355401 (+1027292us) service_pool.cc:224] Handling call
0709 12:10:00.355784 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:00.726182 (+370398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.726225 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:00.743368 (+ 17143us) log.cc:844] Serialized 52 byte log entry
0709 12:10:00.850995 (+107627us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:00.851084 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.882222 (+ 31138us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400265f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:00.882313 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:00.896227 (+ 13914us) raft_consensus.cc:1685] finished
0709 12:10:00.896250 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.896585 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12822,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":16924,"spinlock_wait_cycles":850871168,"thread_start_us":66855,"threads_started":1,"wal-append.queue_time_us":108357}
I20260709 12:10:00.908104 27244 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:00.910115 25765 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.894852 25760 rpcz_store.cc:276] 0709 12:09:59.746878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.892859 (+1145981us) service_pool.cc:224] Handling call
0709 12:10:00.893335 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.894244 (+   909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.894498 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.921211 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 766) took 1540 ms. Trace:
I20260709 12:10:00.931684 25760 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:00.932440 25764 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.932790 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1170) took 1206 ms. Trace:
I20260709 12:10:00.933182 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1175) took 1204 ms. Trace:
I20260709 12:10:00.933657 25764 rpcz_store.cc:276] 0709 12:09:59.728555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.931701 (+1203146us) service_pool.cc:224] Handling call
0709 12:10:00.932243 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.932900 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.933123 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.940182 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1292) took 1206 ms. Trace:
I20260709 12:10:00.962740 25612 rpcz_store.cc:276] 0709 12:09:59.734137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.010916 (+276779us) service_pool.cc:224] Handling call
0709 12:10:00.011358 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.772156 (+760798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.772200 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.772255 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:00.772296 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.939488 (+167192us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b5400361fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:00.939841 (+   353us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.940090 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749079424}
I20260709 12:10:00.963752 25764 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.945084 25768 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:00.966753 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1176) took 1237 ms. Trace:
I20260709 12:10:00.933199 25760 rpcz_store.cc:276] 0709 12:09:59.726671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.930898 (+1204227us) service_pool.cc:224] Handling call
0709 12:10:00.931288 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.932445 (+  1157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.932724 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.970155 25760 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:10:00.971274 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1179) took 1241 ms. Trace:
I20260709 12:10:00.921855 25687 rpcz_store.cc:276] 0709 12:09:59.380421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.404948 (+ 24527us) service_pool.cc:224] Handling call
0709 12:10:00.920942 (+1515994us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54003ffa54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:00.921135 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255315712}
W20260709 12:10:00.951884 25693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 754) took 1622 ms (client timeout 1767 ms). Trace:
I20260709 12:10:00.973906 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1178) took 1235 ms. Trace:
W20260709 12:10:00.973501 25693 rpcz_store.cc:269] 0709 12:09:59.328940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.375292 (+ 46352us) service_pool.cc:224] Handling call
0709 12:10:00.951573 (+1576281us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b54001950d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:00.951775 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167093632}
I20260709 12:10:00.967602 25768 rpcz_store.cc:276] 0709 12:09:59.728916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.944048 (+1215132us) service_pool.cc:224] Handling call
0709 12:10:00.944526 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.966366 (+ 21840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.966676 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.974948 25764 rpcz_store.cc:276] 0709 12:09:59.729612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.962921 (+1233309us) service_pool.cc:224] Handling call
0709 12:10:00.963465 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.964867 (+  1402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.965223 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.889899 25763 rpcz_store.cc:276] 0709 12:09:59.722574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.562792 (+840218us) service_pool.cc:224] Handling call
0709 12:10:00.563354 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:00.564335 (+   981us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:10:00.564506 (+   171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:00.565172 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:10:00.738971 (+173799us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:00.742533 (+  3562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.752807 (+ 10274us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:00.886980 (+134173us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:00.889113 (+  2133us) raft_consensus.cc:1685] finished
0709 12:10:00.889145 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.889398 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":209,"spinlock_wait_cycles":7540608,"thread_start_us":139847,"threads_started":1,"wal-append.queue_time_us":216909}
I20260709 12:10:00.978991 25760 rpcz_store.cc:276] 0709 12:09:59.729946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.969296 (+1239350us) service_pool.cc:224] Handling call
0709 12:10:00.969783 (+   487us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:00.970843 (+  1060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.971148 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:00.980482 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:00.989449 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:00.992003 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.996503 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:01.018148 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.018636 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 807) took 1268 ms. Trace:
I20260709 12:10:01.019367 25768 rpcz_store.cc:276] 0709 12:09:59.749977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.003032 (+1253055us) service_pool.cc:224] Handling call
0709 12:10:01.017744 (+ 14712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.018016 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.018061 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:01.018129 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:01.018181 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.018292 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.018487 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:01.029140 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:01.030421 25612 raft_consensus.cc:606] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:01.030988 25612 raft_consensus.cc:614] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:01.031672 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.007241 27207 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:01.056993 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 873) took 1322 ms. Trace:
I20260709 12:10:01.016069 27216 raft_consensus.cc:3055] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:01.058348 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 800) took 1333 ms. Trace:
I20260709 12:10:01.062383 25763 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.063215 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:01.063553 25618 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:01.057559 25616 rpcz_store.cc:276] 0709 12:09:59.734138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.004122 (+269984us) service_pool.cc:224] Handling call
0709 12:10:00.098324 (+ 94202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:00.160791 (+ 62467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.056678 (+895887us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b5400302850. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:01.056911 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178994432}
I20260709 12:10:01.065393 25619 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:01.072786 25759 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.073559 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 799) took 1349 ms. Trace:
I20260709 12:10:01.065541 25768 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:01.073906 25759 rpcz_store.cc:276] 0709 12:09:59.724209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.066990 (+1342781us) service_pool.cc:224] Handling call
0709 12:10:01.072582 (+  5592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.073310 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.073499 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:01.066612 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.034718 25502 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet fa0600a571a0457f804bf9bf88fd9fd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:10:01.068518 25767 rpcz_store.cc:276] 0709 12:09:59.724544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.015417 (+1290873us) service_pool.cc:224] Handling call
0709 12:10:01.015819 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.057866 (+ 42047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.057935 (+    69us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:01.057994 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:01.058028 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.058099 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.058248 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:01.007366 27213 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:01.077656 25689 raft_consensus.cc:2410] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:01.079660 25616 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:01.077986 25502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 122668us
I20260709 12:10:01.081389 27244 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:01.074510 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1181) took 1311 ms. Trace:
I20260709 12:10:01.085670 25768 rpcz_store.cc:276] 0709 12:09:59.763717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.064858 (+1301141us) service_pool.cc:224] Handling call
0709 12:10:01.065171 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.074220 (+  9049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.074455 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:01.088549 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.089293 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:01.090194 25616 raft_consensus.cc:606] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:01.090768 25616 raft_consensus.cc:614] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:01.092581 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 808) took 1341 ms. Trace:
I20260709 12:10:01.093098 25768 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:01.067222 27216 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.097702 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1182) took 1333 ms. Trace:
I20260709 12:10:01.093050 25762 rpcz_store.cc:276] 0709 12:09:59.750688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.048963 (+298275us) service_pool.cc:224] Handling call
0709 12:10:01.092268 (+1043305us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400165654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:01.092415 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325188480}
I20260709 12:10:01.103540 25768 rpcz_store.cc:276] 0709 12:09:59.764144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.087425 (+1323281us) service_pool.cc:224] Handling call
0709 12:10:01.092449 (+  5024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.094185 (+  1736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.096474 (+  2289us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b5400165650. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:01.096924 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10632064}
I20260709 12:10:01.108420 25764 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.108932 25764 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:01.109742 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 328671us
I20260709 12:10:01.109930 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1190) took 1180 ms. Trace:
I20260709 12:10:01.115245 25583 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:01.115061 25759 rpcz_store.cc:276] 0709 12:09:59.930065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.101888 (+1171823us) service_pool.cc:224] Handling call
0709 12:10:01.109334 (+  7446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.109563 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.109595 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:01.109648 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:01.109686 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.109747 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.109866 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:01.119185 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.127808 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.164881 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 805) took 1438 ms. Trace:
I20260709 12:10:01.165503 25766 rpcz_store.cc:276] 0709 12:09:59.726036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.878012 (+1151976us) service_pool.cc:224] Handling call
0709 12:10:00.878595 (+   583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:00.880861 (+  2266us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:10:00.880899 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:00.881839 (+   940us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.058995 (+177156us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.059046 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.059134 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:01.164553 (+105419us) raft_consensus.cc:1685] finished
0709 12:10:01.164591 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.164791 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":163,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":173980,"threads_started":1,"wal-append.queue_time_us":280796}
I20260709 12:10:01.168145 25766 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:01.172055 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.109812 25764 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.197427 25764 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.110903 27216 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.199183 26896 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:01.199790 27216 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.117465 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
W20260709 12:10:01.198513 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 83368.1us
W20260709 12:10:01.215821 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 137249us
W20260709 12:10:01.216500 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.217434 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.103830 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 809) took 1351 ms. Trace:
I20260709 12:10:01.111080 27159 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:01.224685 25768 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:01.226441 25583 connection.cc:256] RPC call timeout handler was delayed by -1.60758748499984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:10:01.228163 25583 connection.cc:256] RPC call timeout handler was delayed by -1.0662163980000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 12:10:01.201311 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.228313 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1191) took 1067 ms. Trace:
I20260709 12:10:01.228921 25768 rpcz_store.cc:276] 0709 12:10:00.161303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.218912 (+1057609us) service_pool.cc:224] Handling call
0709 12:10:01.219404 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.227928 (+  8524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.228245 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:01.222483 25763 rpcz_store.cc:276] 0709 12:09:59.751804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.009211 (+1257407us) service_pool.cc:224] Handling call
0709 12:10:01.061844 (+ 52633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.070198 (+  8354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.102394 (+ 32196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:01.227535 25764 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.232448 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1185) took 1467 ms. Trace:
I20260709 12:10:01.170243 26859 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.199801 26896 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.234634 26859 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.235781 26859 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.235828 26896 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.237210 26859 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.111651 27204 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.232954 25764 rpcz_store.cc:276] 0709 12:09:59.765051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.091528 (+1326477us) service_pool.cc:224] Handling call
0709 12:10:01.098453 (+  6925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.231907 (+133454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.232279 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:01.227505 27159 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.220135 27244 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:01.266716 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47339.2us
I20260709 12:10:01.227741 27156 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.271628 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.255206 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.272038 27159 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.218626 26988 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.264438 27244 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.270383 27207 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:01.286520 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 114548us
I20260709 12:10:01.270720 27270 raft_consensus.cc:3055] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.288537 25657 leader_election.cc:400] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:10:01.289666 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.275277 27156 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.294888 27204 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.296275 27156 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:01.296941 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1186) took 1531 ms. Trace:
I20260709 12:10:01.297343 25761 rpcz_store.cc:276] 0709 12:09:59.765316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.094518 (+1329202us) service_pool.cc:224] Handling call
0709 12:10:01.094900 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.095537 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.095568 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.096118 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.226335 (+130217us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.226403 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.226516 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:01.296659 (+ 70143us) raft_consensus.cc:1685] finished
0709 12:10:01.296685 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.296874 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":112,"thread_start_us":129665,"threads_started":1,"wal-append.queue_time_us":197056}
I20260709 12:10:01.301586 25690 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:01.304811 27207 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.299501 27244 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:01.316581 25687 raft_consensus.cc:1240] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:01.319085 25690 raft_consensus.cc:3055] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.322006 25690 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.292761 27270 raft_consensus.cc:740] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:01.335625 25690 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:01.337109 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48831us
I20260709 12:10:01.341104 25690 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.306131 27207 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.317997 26918 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.348325 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59058.4us
I20260709 12:10:01.344372 27280 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:01.352849 26918 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.344372 27213 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.364207 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.369334 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.338950 27196 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:01.356964 26918 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:01.376355 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:01.376874 25583 leader_election.cc:336] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.645s (SENT)
I20260709 12:10:01.349738 27279 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:01.380157 27285 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:01.386832 27285 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.387044 26988 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:01.388118 27285 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.389631 27285 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:01.380476 27244 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:01.399031 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.395289 26918 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:01.400883 26918 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.401959 26918 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.396524 27095 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 12:10:01.384531 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.404989 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.408077 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.384979 27280 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:01.408809 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.409250 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.370836 27270 consensus_queue.cc:260] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:01.409935 27270 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.416492 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 750) took 2088 ms. Trace:
I20260709 12:10:01.408824 27280 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.417490 27280 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:01.419654 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:01.424750 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:01.425771 25611 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:01.426731 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.427284 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.416951 25691 rpcz_store.cc:276] 0709 12:09:59.327855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.266464 (+938609us) service_pool.cc:224] Handling call
0709 12:10:00.266986 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.549622 (+282636us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:00.638884 (+ 89262us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.809591 (+170707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.809652 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:00.809709 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.416183 (+606474us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400327154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:01.416234 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.416392 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2821,"prepare.queue_time_us":121045,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":7921,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":11791,"spinlock_wait_cycles":649149312,"thread_start_us":139883,"threads_started":2,"wal-append.queue_time_us":182733}
I20260709 12:10:01.382902 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.440608 25582 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.443149 27247 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:01.443372 27169 consensus_queue.cc:1059] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:01.444311 27277 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.281s	user 0.000s	sys 0.006s
I20260709 12:10:01.444640 27169 raft_consensus.cc:3055] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.445117 27169 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.450331 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 795) took 1727 ms. Trace:
I20260709 12:10:01.445946 27169 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:01.450798 25765 rpcz_store.cc:276] 0709 12:09:59.722991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.589009 (+866018us) service_pool.cc:224] Handling call
0709 12:10:00.633250 (+ 44241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.910991 (+277741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.450042 (+539051us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540030b6d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:01.450240 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636134784}
I20260709 12:10:01.452173 27169 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.450397 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.458099 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.460219 27156 raft_consensus.cc:2764] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:01.459084 27247 consensus_queue.cc:1059] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.435139 27244 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:01.463029 27247 raft_consensus.cc:3055] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.462771 27244 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.463446 27247 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:01.464187 27275 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.300s	user 0.003s	sys 0.000s
I20260709 12:10:01.462085 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:01.467232 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 100331us
I20260709 12:10:01.471067 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:01.474691 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.478518 25611 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:10:01.482666 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 99907.8us
I20260709 12:10:01.487205 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.489315 25617 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.491103 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 873) took 2037 ms. Trace:
I20260709 12:10:01.491710 25689 rpcz_store.cc:276] 0709 12:09:59.454152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.228222 (+774070us) service_pool.cc:224] Handling call
0709 12:10:01.484283 (+1256061us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400344ed4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:01.491030 (+  6747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948570368}
I20260709 12:10:01.398198 27279 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.464583 27247 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:01.483832 25657 leader_election.cc:400] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5.
I20260709 12:10:01.512310 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:01.513734 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.513734 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.515156 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:01.524570 25582 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.520769 25657 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:01.525134 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 145939us
I20260709 12:10:01.481657 27156 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:01.529094 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.488305 27260 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.488569 26896 raft_consensus.cc:2764] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:01.533847 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:01.537688 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.499568 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 132953us
W20260709 12:10:01.539852 25583 leader_election.cc:336] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.090s (SENT)
I20260709 12:10:01.541591 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.537395 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.507612 27244 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:01.515280 27095 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.508833 27279 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.519840 27290 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.536689 27221 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:01.551302 25583 leader_election.cc:336] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.105s (SENT)
I20260709 12:10:01.521170 26795 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:01.531915 27058 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:01.541098 27293 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.537132 27213 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:01.530936 27156 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:01.531580 27230 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.545567 27247 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.541939 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:01.548951 27158 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.540921 26859 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:10:01.592355 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50638.4us
I20260709 12:10:01.567190 26795 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:01.595224 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:01.564013 27244 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:01.564761 27267 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.590937 27293 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.599970 27202 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:01.596760 27158 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.600632 25610 raft_consensus.cc:606] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:01.601100 25610 raft_consensus.cc:614] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:01.601622 27158 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.602887 25689 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:01.567772 27290 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.545809 27260 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:01.566960 27058 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.573926 27156 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:01.614920 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.616433 25582 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:01.574970 27095 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.570693 27212 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:01.598614 27205 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:01.605762 26795 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:01.625561 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89184us
I20260709 12:10:01.569419 27221 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.609681 27204 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.628690 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.614220 27058 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:01.630184 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 88731.3us
I20260709 12:10:01.604317 27280 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.640345 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:01.639129 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.577172 27230 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:01.612088 27209 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:01.611833 26896 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:01.600198 27293 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.643857 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.636776 26988 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.644788 26826 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:01.668972 25691 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:01.647250 27244 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:01.645742 27213 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:01.643214 27230 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.607547 27267 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.689961 25762 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:10:01.692755 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48982us
I20260709 12:10:01.693704 25765 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:01.658694 27251 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.694162 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:01.658403 27212 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.698056 25767 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:10:01.613061 27279 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.665917 27204 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.698741 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.670792 26826 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:01.711032 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 64094.4us
I20260709 12:10:01.711983 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:01.685423 27244 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.715689 25765 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:01.720835 27300 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
W20260709 12:10:01.727242 27295 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 12:10:01.680609 26988 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.698022 27304 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:01.700974 27213 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:01.688906 27095 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.716578 27216 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.716710 26826 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.716425 27207 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.717876 27244 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.717080 27205 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:01.782361 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.728957 27308 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:01.712932 27251 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.711699 26896 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:01.738145 27279 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:01.776577 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.713344 27221 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:01.795311 27301 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:01.797043 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 882) took 1706 ms. Trace:
I20260709 12:10:01.788769 27290 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:01.800671 27212 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.808344 27267 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:01.731120 26859 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:01.781010 27216 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.797469 25615 rpcz_store.cc:276] 0709 12:10:00.090835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.762227 (+671392us) service_pool.cc:224] Handling call
0709 12:10:00.782418 (+ 20191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.110237 (+327819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.110307 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.110960 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.461015 (+350055us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18004148e0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9
0709 12:10:01.540865 (+ 79850us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.540906 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.541800 (+   894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:01.796697 (+254897us) raft_consensus.cc:1685] finished
0709 12:10:01.796715 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.796977 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":328695,"raft.queue_time_us":323090,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"spinlock_wait_cycles":3275648,"thread_start_us":79623,"threads_started":1,"wal-append.queue_time_us":512616}
I20260709 12:10:01.800969 27204 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:01.811306 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.831056 27251 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.828377 27216 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.787544 27308 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.846936 27308 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.847554 27202 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:01.848049 27202 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.848372 27308 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.850435 27260 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:01.852795 27299 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:10:01.800745 27280 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:01.857014 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.846925 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.864494 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:01.865566 25690 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
I20260709 12:10:01.852249 27205 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:01.881546 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.869406 27058 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:01.864012 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.891415 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.800778 26795 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.879312 27280 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.913532 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.893596 26896 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:01.923444 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:01.927028 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 210765us
I20260709 12:10:01.927961 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:01.418040 27203 consensus_queue.cc:1175] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c781e437472a42e2a6162b67b1c7bbbd" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:01.882440 27169 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 12:10:01.936329 25732 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.841s (SENT)
I20260709 12:10:01.939107 26918 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.939520 27303 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.940433 27290 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.939968 27156 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.926767 27280 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.927023 26896 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:01.949682 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.951748 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:01.958213 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 242647us
I20260709 12:10:01.963775 27285 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.964771 27267 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.964982 27212 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:01.977946 27244 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:01.930796 26304 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:01.965353 27304 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:01.979212 27207 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.979738 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:01.995004 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81591.2us
I20260709 12:10:01.995316 27321 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:01.995971 27321 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.996467 27321 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:01.971415 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 161066us
I20260709 12:10:01.999166 27221 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:01.999482 26303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.999799 27221 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:02.001031 27247 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.003108 27247 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.004429 27257 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:02.004904 27257 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:01.980140 27293 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.006553 26988 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:01.938575 27297 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:02.007637 27314 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.940557 27306 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:10:02.009554 26896 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.010541 27285 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:02.010973 27285 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:02.011089 26896 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.939028 27307 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
W20260709 12:10:02.013975 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44556.8us
I20260709 12:10:02.014981 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.017417 25767 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.015172 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:02.015422 27324 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.016040 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.028625 25760 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.986162 27212 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:02.021255 25764 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.018713 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:02.034458 25766 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.034549 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:01.907006 27213 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.024161 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.036028 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.036540 25617 raft_consensus.cc:1813] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:02.000836 27221 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.025007 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.026033 25765 raft_consensus.cc:2410] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:02.042022 25611 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:02.042747 25617 raft_consensus.cc:2410] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:10:02.026930 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.027609 25768 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.045837 27280 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.048797 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.028029 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:02.063800 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.016193 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 79909.6us
I20260709 12:10:02.026938 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.032582 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.022529 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:02.048211 25502 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet fa0600a571a0457f804bf9bf88fd9fd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:02.025617 27210 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.196s
I20260709 12:10:02.039494 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.035102 25761 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.026633 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.036821 25616 raft_consensus.cc:2410] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:02.070842 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.082373 25732 leader_election.cc:336] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.872s (SENT)
W20260709 12:10:02.067226 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49973.2us
I20260709 12:10:02.083351 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.085376 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.087409 25687 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.086076 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.081657 25613 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:02.089478 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.092775 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.094213 25687 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:02.047745 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.053179 27293 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:02.099887 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.100658 25688 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:01.969139 27303 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.101820 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.104420 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.109956 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.110800 25685 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:10:02.111035 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.111917 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.112460 25685 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.006103 27257 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.114419 27293 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.118288 25692 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.119671 25614 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:02.114430 27204 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.120976 25760 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.128857 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.130025 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.095355 25763 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:02.139942 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57621.5us
W20260709 12:10:02.140733 25732 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.910s (SENT)
I20260709 12:10:02.141158 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.134812 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.142650 27156 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.135694 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:02.147055 27315 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:10:02.147102 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.147665 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.133074 25767 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.141584 25694 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:02.152789 25688 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:02.100888 27324 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.154390 25610 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:10:02.163631 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.165185 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.116888 27293 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.166414 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.118911 27058 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.169761 25688 raft_consensus.cc:2393] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:02.169507 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:02.129566 26795 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.151324 27257 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.080708 27202 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.176456 27202 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:02.181108 27319 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:10:02.182375 27324 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.148788 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.171142 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.082713 27285 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.161296 27196 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:02.213523 27058 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.214830 25686 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.141979 27204 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:02.226213 27058 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.228911 27058 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.219146 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.220628 27285 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.234488 25610 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:02.243702 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.234130 27230 consensus_meta.cc:287] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.005s
I20260709 12:10:02.264873 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.266331 25612 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:02.270985 27304 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.271641 27304 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.273476 25688 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.230057 27204 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:02.248073 25615 raft_consensus.cc:606] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:02.249150 25685 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:10:02.249830 27296 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.692s	user 0.000s	sys 0.006s
W20260709 12:10:02.252967 27313 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.241s	user 0.003s	sys 0.002s
I20260709 12:10:02.234690 27303 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:02.283231 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.295842 25614 raft_consensus.cc:2410] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:02.283493 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.285852 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.286940 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:02.272981 27329 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:02.292430 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.303681 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.304448 25610 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.296523 25618 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:02.309689 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.312804 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.313922 25618 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:10:02.310669 25691 raft_consensus.cc:2376] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
W20260709 12:10:02.318781 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.319399 26918 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.273813 27230 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.338956 25612 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:10:02.350085 25619 raft_consensus.cc:2410] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:02.354085 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.355182 25614 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:10:02.365551 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:02.382169 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.385159 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.386848 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:02.386955 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 246240us
I20260709 12:10:02.387391 25761 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:02.387919 25732 leader_election.cc:336] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.911s (SENT)
I20260709 12:10:02.388659 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.371204 27290 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:02.391737 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:02.392760 25760 raft_consensus.cc:2410] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:02.392606 27290 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:02.393319 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.324640 27216 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.336774 26859 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:02.364480 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:02.396852 27325 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:10:02.396198 26826 consensus_meta.cc:287] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.608s	user 0.013s	sys 0.000s
I20260709 12:10:02.371003 27257 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.405902 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.409916 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.408394 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:02.410816 25689 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:02.413682 27204 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.409931 26826 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:02.414005 27336 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:10:02.414167 25686 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.414096 27204 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:02.415061 27204 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.416059 25686 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.416520 27304 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.417158 27323 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.417580 27323 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.417649 25686 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:02.423094 25689 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:02.444942 25689 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.420609 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:02.451542 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 63669.1us
W20260709 12:10:02.452711 25732 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.913s (SENT)
I20260709 12:10:02.453351 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.404626 27324 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:02.420403 25686 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:02.459899 25761 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:02.458528 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:02.464389 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:02.462922 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.404874 25685 raft_consensus.cc:2376] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5. Re-sending same reply.
I20260709 12:10:02.409438 26859 consensus_queue.cc:1243] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:02.402804 27212 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:10:02.418195 27323 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.492215 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:02.492754 25732 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.915s (SENT)
I20260709 12:10:02.422362 27196 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:10:02.409739 27257 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.462826 27202 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.474973 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:02.501806 27320 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:02.502556 27332 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:02.419680 27221 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:02.445106 26896 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:10:02.508729 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.503265 25686 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:02.496462 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.493382 27303 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.460821 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:02.508316 27202 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:02.539387 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46685.9us
W20260709 12:10:02.540436 25732 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.946s (SENT)
I20260709 12:10:02.540966 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:02.546582 25732 leader_election.cc:336] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.023s (SENT)
I20260709 12:10:02.547266 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.529462 27320 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:02.546382 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.531356 27332 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:02.539340 27159 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.552965 25761 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.542551 27202 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.536689 26826 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.556860 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.560676 25766 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:02.540503 27230 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.561160 25766 pending_rounds.cc:85] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 1
I20260709 12:10:02.561555 25766 pending_rounds.cc:107] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:02.561874 25766 raft_consensus.cc:2889] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:02.548852 27324 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.547941 27270 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.543987 27344 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.546425 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 98674.3us
I20260709 12:10:02.567637 25761 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:02.572152 25732 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.026s (SENT)
I20260709 12:10:02.575976 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.563624 27303 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.578696 27209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.031s	sys 0.015s
I20260709 12:10:02.562817 27342 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.574651 27270 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:02.590507 25732 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.055s (SENT)
I20260709 12:10:02.591404 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.596019 25692 raft_consensus.cc:2410] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:02.596316 26304 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.579859 27216 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.593178 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:02.591338 27209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.031s	sys 0.016s
I20260709 12:10:02.588804 27324 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:02.599334 27348 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:10:02.603222 27345 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:02.595327 27270 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.602456 27196 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.591859 27303 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.631165 27342 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.635327 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44848.5us
W20260709 12:10:02.637713 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.134s (SENT) [suppressed 78 similar messages]
I20260709 12:10:02.630810 27257 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:02.638901 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.639792 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:02.640470 25762 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:02.614917 27332 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.594694 27320 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.671181 27303 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:02.674633 27213 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:02.675392 27213 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:02.676093 27202 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.679459 27213 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:02.681211 27321 consensus_meta.cc:287] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.004s
I20260709 12:10:02.684000 27321 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:02.685817 27331 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.435s	user 0.000s	sys 0.002s
I20260709 12:10:02.683122 27203 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.687067 27202 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.686697 27203 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:02.690412 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:02.694515 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:02.682156 27330 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.468s	user 0.002s	sys 0.000s
I20260709 12:10:02.689231 27244 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:02.699710 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:02.735188 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.736151 25692 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:10:02.703636 27203 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.701613 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.745947 25763 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.707881 27332 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:02.755122 27323 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.756718 25516 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 2, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 2 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.740218 27159 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.759047 27159 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.759510 27159 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.758862 25516 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 3 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 4 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.761413 27321 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:02.707396 27350 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:10:02.764365 27323 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:02.765362 26304 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:02.765990 27158 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:02.766537 27158 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:02.767460 27158 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.768344 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:02.769259 25690 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:02.768690 27158 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:02.770639 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.770555 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.772322 25617 raft_consensus.cc:3060] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:02.767472 27210 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.785151 27210 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.785560 27210 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.786602 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:02.761458 25516 catalog_manager.cc:5697] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 2, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 2 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.792630 25763 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:02.796859 25690 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
W20260709 12:10:02.799103 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.803030 26304 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:02.801921 25583 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 3.349s (SENT)
I20260709 12:10:02.698698 27213 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:02.809840 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 172166us
W20260709 12:10:02.810930 25732 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.198s (SENT)
I20260709 12:10:02.811362 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.811172 27321 raft_consensus.cc:2804] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:02.699363 27257 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:02.822561 25617 raft_consensus.cc:2468] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:10:02.806476 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:02.785269 27159 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.695077 27204 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.824623 27321 raft_consensus.cc:697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:02.825649 27306 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:02.834450 26896 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:02.818699 27244 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:02.839854 27244 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.842981 25763 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:02.701511 27209 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 12:10:02.845696 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.828083 27257 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:02.811885 27270 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:02.853233 27270 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:02.854457 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.854992 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.856485 27257 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:02.862917 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.865829 25611 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.817577 27324 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:02.882736 27361 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.139s	user 0.004s	sys 0.000s
W20260709 12:10:02.864229 25732 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.230s (SENT)
I20260709 12:10:02.891794 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.883178 26896 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:02.900257 25732 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.351s (SENT)
I20260709 12:10:02.903285 25694 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:02.904767 25611 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:10:02.887769 27202 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:02.899077 27303 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.917793 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:02.919616 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.922817 25611 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.920063 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.920755 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:02.923919 25619 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:02.920903 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0579393600000913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31000000000000005s for a response
W20260709 12:10:02.915438 27305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.004s	sys 0.012s
I20260709 12:10:02.903469 27210 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:02.939323 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0239043130000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3105s for a response
W20260709 12:10:02.939924 25732 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.429s (SENT)
I20260709 12:10:02.941860 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:02.931701 27305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.004s	sys 0.013s
I20260709 12:10:02.931280 27244 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:02.951519 25732 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.726s (SENT)
I20260709 12:10:02.912067 27321 consensus_queue.cc:237] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:02.922076 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:02.959487 25611 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:02.962116 27369 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:10:02.960630 26896 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:02.976334 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.965382 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 3.172s (SENT)
I20260709 12:10:02.943557 27367 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.951910 27303 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:02.951107 27095 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.991750 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:02.992482 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:02.993285 25764 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.994093 27244 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.001149 27244 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.003969 27244 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:03.005486 25764 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:10:03.006699 25732 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:03.007925 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.986910 27297 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:03.002018 27368 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 12:10:03.016913 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:02.959935 27270 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:02.991009 27367 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.010404 27095 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.036693 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:03.023142 27297 raft_consensus.cc:697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:03.028927 27244 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.048717 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 78) took 1002 ms. Trace:
I20260709 12:10:03.049491 25693 rpcz_store.cc:276] 0709 12:10:02.048696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.050230 (+  1534us) service_pool.cc:224] Handling call
0709 12:10:02.081298 (+ 31068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.081716 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.081743 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.647745 (+566002us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b2c00000448. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:02.648613 (+   868us) log.cc:844] Serialized 508 byte log entry
0709 12:10:02.813758 (+165145us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:02.813861 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.813972 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.001052 (+187080us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:03.048481 (+ 47429us) raft_consensus.cc:1685] finished
0709 12:10:03.048505 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.048638 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62307968,"thread_start_us":164252,"threads_started":1,"wal-append.queue_time_us":205474}
W20260709 12:10:03.053349 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.057775 25759 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:03.058516 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 824) took 1035 ms. Trace:
I20260709 12:10:03.058920 25759 rpcz_store.cc:276] 0709 12:10:02.023066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.023198 (+   132us) service_pool.cc:224] Handling call
0709 12:10:03.057245 (+1034047us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:03.057437 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.058232 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.058462 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4329728}
I20260709 12:10:03.044967 27342 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:03.042481 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 131979us
I20260709 12:10:03.067781 27095 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:03.069114 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:03.070703 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.071419 25694 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.081894 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:03.085282 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.088424 25694 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
I20260709 12:10:03.085326 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:03.071974 27244 raft_consensus.cc:2764] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:10:03.123850 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:03.126865 25618 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:03.130159 25732 leader_election.cc:336] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.612s (SENT)
I20260709 12:10:03.131698 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:03.130898 27158 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.140875 27244 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.128294 27359 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:03.141335 25732 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.699s (SENT)
I20260709 12:10:03.128679 26896 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.144646 27357 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.145012 27373 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:03.144011 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:03.134781 27204 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:03.161324 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.183374 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:03.151613 27158 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:03.142055 27297 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:03.182433 27257 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.204810 27367 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:03.158690 27244 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.154716 26896 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.182989 27357 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.157933 27373 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.223984 25615 raft_consensus.cc:606] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:03.266011 25611 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:03.266863 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:03.258066 27371 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.415s	user 0.000s	sys 0.004s
W20260709 12:10:03.255295 27374 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.354s	user 0.003s	sys 0.000s
W20260709 12:10:03.256623 27364 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.417s	user 0.004s	sys 0.000s
I20260709 12:10:03.267776 25613 raft_consensus.cc:2410] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:03.252061 27158 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:03.243654 27257 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.299237 25617 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:03.322022 27359 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:03.328274 27359 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.330674 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:03.331527 26334 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
W20260709 12:10:03.342360 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.343271 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.343690 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.344175 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.267614 27357 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:03.351207 25583 leader_election.cc:336] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.704s (SENT)
I20260709 12:10:03.389860 25583 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:03.377267 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.379766 26988 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:03.386111 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.427431 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 286118us
W20260709 12:10:03.456600 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.470515 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.475574 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.504774 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:03.843497 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.857026 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.712s (SENT)
I20260709 12:10:03.857648 25688 raft_consensus.cc:2376] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
I20260709 12:10:03.858037 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:03.505617 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.856731 25613 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:03.858844 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:03.859527 25611 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:03.505707 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.857267 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:03.505072 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.865446 25618 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.856731 25619 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:03.869889 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.544520 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 837) took 1134 ms. Trace:
I20260709 12:10:03.876183 25765 rpcz_store.cc:276] 0709 12:10:02.410414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.410561 (+   147us) service_pool.cc:224] Handling call
0709 12:10:02.410852 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.484213 (+ 73361us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:02.576036 (+ 91823us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.778433 (+202397us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b4800120258. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:10:02.895144 (+116711us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.895404 (+   260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.895454 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:02.895604 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.544092 (+648488us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b5400150254. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:03.544175 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.544425 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77988,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":109,"raft.queue_time_us":20342,"raft.run_cpu_time_us":2113,"raft.run_wall_time_us":151487,"spinlock_wait_cycles":173525632,"thread_start_us":375107,"threads_started":3,"wal-append.queue_time_us":90575}
I20260709 12:10:03.508365 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:03.512138 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 48) took 1154 ms. Trace:
I20260709 12:10:03.903332 25614 rpcz_store.cc:276] 0709 12:10:02.358012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.358331 (+   319us) service_pool.cc:224] Handling call
0709 12:10:02.385855 (+ 27524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.446632 (+ 60777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.446665 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.447171 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.667529 (+220358us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:02.667570 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.833762 (+166192us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:03.511609 (+677847us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5400278654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:03.511708 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.511789 (+    81us) raft_consensus.cc:1685] finished
0709 12:10:03.511809 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.512048 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25115,"raft.queue_time_us":25527,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9880,"spinlock_wait_cycles":86960256,"thread_start_us":220017,"threads_started":1,"wal-append.queue_time_us":253164}
I20260709 12:10:03.507937 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.908185 25689 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.507378 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.909531 25694 raft_consensus.cc:2376] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3. Re-sending same reply.
I20260709 12:10:03.910977 25690 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.868969 25687 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:03.428674 26988 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:03.569394 27365 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.722s	user 0.000s	sys 0.004s
W20260709 12:10:03.832907 27366 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.987s	user 0.002s	sys 0.004s
W20260709 12:10:03.922490 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 65487.8us
W20260709 12:10:03.928928 25732 leader_election.cc:336] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.733s (SENT)
W20260709 12:10:03.930186 25732 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.775s (SENT)
I20260709 12:10:03.930769 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:03.927157 25694 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:03.943400 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:03.944411 25768 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.614113 27324 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.613554 27323 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.947208 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:03.611382 27213 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.965463 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.737457 27342 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.967118 25767 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:03.566883 27210 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:03.949005 27351 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.940758 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:03.978610 27342 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.980947 27342 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:03.981525 27342 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.991317 27373 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:03.993459 27357 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:03.994513 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:03.996937 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:03.994814 27357 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:03.997852 27303 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.998418 27303 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.999150 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.000631 27303 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:04.002122 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 843) took 1410 ms. Trace:
I20260709 12:10:04.002533 25766 rpcz_store.cc:276] 0709 12:10:02.591295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.591870 (+   575us) service_pool.cc:224] Handling call
0709 12:10:02.592241 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.598157 (+  5916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.598189 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.603916 (+  5727us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.746878 (+142962us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.746919 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.746997 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.568654 (+821657us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:04.001812 (+433158us) raft_consensus.cc:1685] finished
0709 12:10:04.001836 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.002057 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12445,"raft.queue_time_us":120,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":12181,"spinlock_wait_cycles":14543232,"thread_start_us":128760,"threads_started":1,"wal-append.queue_time_us":201726}
I20260709 12:10:03.969324 27324 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:03.977860 27351 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:03.971028 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 619850us
I20260709 12:10:03.926664 26304 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:03.976449 27323 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.009567 25618 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:04.053525 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:04.112469 25766 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:04.044612 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.115080 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.115852 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.090941 25693 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:04.093528 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.117839 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.075145 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 148597us
I20260709 12:10:04.008710 25692 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:04.116516 25691 raft_consensus.cc:2376] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6. Re-sending same reply.
W20260709 12:10:04.133644 25691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 802) took 1870 ms (client timeout 1882 ms). Trace:
W20260709 12:10:04.134166 25691 rpcz_store.cc:269] 0709 12:10:02.263363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.383624 (+1120261us) service_pool.cc:224] Handling call
0709 12:10:04.115695 (+732071us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:04.133559 (+ 17864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54335744}
W20260709 12:10:04.142351 25764 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.001s	sys 0.009s
W20260709 12:10:04.143035 25764 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.002s	sys 0.009s
I20260709 12:10:04.151106 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:04.092528 27210 raft_consensus.cc:2804] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:04.152933 27339 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.153450 27210 raft_consensus.cc:697] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:04.103413 27351 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.154450 27210 consensus_queue.cc:237] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:04.156337 27323 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.162844 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.167897 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.169132 25692 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:04.152136 25766 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:10:04.172087 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.172780 25692 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:04.173683 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.175349 25768 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:04.100790 27212 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.113183 27350 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.982241 27342 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:04.130471 27344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.005s	sys 0.006s
I20260709 12:10:04.006227 27324 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:04.000468 25686 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:04.009155 27213 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:04.195122 27344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.006s	sys 0.006s
I20260709 12:10:04.182844 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.226806 25692 raft_consensus.cc:2410] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:04.130618 27332 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:03.548749 27196 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:04.240218 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.215687 27394 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:04.222527 27159 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.238029 27260 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:04.196067 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:10:04.242995 25516 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.054s	sys 0.109s
I20260709 12:10:04.112622 26988 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.251362 25693 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:04.251739 25516 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.054s	sys 0.109s
W20260709 12:10:04.252231 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 56284.7us
I20260709 12:10:04.204674 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.255286 25688 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:04.199594 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.184451 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 857) took 1130 ms. Trace:
I20260709 12:10:04.258630 25764 rpcz_store.cc:276] 0709 12:10:03.054563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.054763 (+   200us) service_pool.cc:224] Handling call
0709 12:10:03.055103 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.055346 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:03.064067 (+  8721us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.549643 (+485576us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b18002d5140. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:03.573414 (+ 23771us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18002d5140. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb67533c7 00007fbdb2d659a7 00007fbdb2d750bf 00007fbdb2d75038
0709 12:10:03.822187 (+248773us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18002d5140. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:04.143522 (+321335us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.184078 (+ 40556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.184137 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:04.184183 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.184248 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.184383 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32837,"prepare.queue_time_us":163765,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":40377,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":32675,"spinlock_wait_cycles":12829056,"thread_start_us":641727,"threads_started":2,"wal-append.queue_time_us":72215}
I20260709 12:10:04.266378 25618 raft_consensus.cc:1275] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:04.195070 27308 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:04.270112 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:04.274680 25766 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:04.276501 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.280174 27392 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:04.310091 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.216869 27342 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:04.281173 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.282749 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:04.311962 25767 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.283620 25762 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.285431 25760 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.285537 25763 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:04.287231 25759 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.317178 25688 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:04.298516 25768 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:04.303228 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.320574 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.324249 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:04.325129 25764 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:04.272015 27306 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.332980 27306 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.335233 25766 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:04.198186 27212 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.348256 27342 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:04.320272 27323 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.349331 27323 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.350613 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.351364 25693 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.351524 27323 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.319819 25686 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:04.356254 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.309342 26988 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:04.359489 25691 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:04.239265 27332 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:04.268765 27394 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.321595 27156 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:04.467222 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.492316 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.360116 27297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.014s	sys 0.020s
I20260709 12:10:04.546036 25693 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:04.542872 26896 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.377246 25767 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:04.366386 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.340263 27324 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.341245 27306 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.388257 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.305136 25689 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:04.557538 25694 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:04.558676 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 810) took 1053 ms. Trace:
I20260709 12:10:04.559348 25689 rpcz_store.cc:276] 0709 12:10:03.505568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.507659 (+  2091us) service_pool.cc:224] Handling call
0709 12:10:04.558585 (+1050926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:04.385918 27212 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:04.538905 27297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.015s	sys 0.021s
I20260709 12:10:04.334210 27392 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.541154 27257 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.592290 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.593134 25688 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:04.598663 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.543231 27342 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:04.619825 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.622144 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:04.623839 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:04.541450 27156 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.631733 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:04.633920 25585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.019s
W20260709 12:10:04.634500 25585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.004s	sys 0.019s
W20260709 12:10:04.635738 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.636490 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.636951 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.637372 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.656927 25761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.006s	sys 0.018s
W20260709 12:10:04.657626 25761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.018s
I20260709 12:10:04.591157 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.659555 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.594099 27359 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:04.678054 25732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.007s	sys 0.018s
W20260709 12:10:04.678515 25732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.007s	sys 0.018s
W20260709 12:10:04.679509 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 749296us
I20260709 12:10:04.561028 27324 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:04.684679 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.628545 25685 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.696738 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.656927 27202 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:04.703384 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:04.660856 27308 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.671722 27159 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:04.688190 27365 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:04.661933 27358 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.741685 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:04.676988 27213 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:04.627300 27342 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.749614 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.756253 25691 raft_consensus.cc:2376] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5. Re-sending same reply.
I20260709 12:10:04.760425 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:04.709791 27202 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.748054 25686 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:04.739655 27308 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:04.756824 27320 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.041s
I20260709 12:10:04.748418 27251 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:04.793066 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.693863 27351 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:10:04.752544 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 813) took 1208 ms. Trace:
W20260709 12:10:04.817227 25584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.032s	sys 0.010s
I20260709 12:10:04.822746 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.737421 27205 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:10:04.851982 25584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.033s	sys 0.011s
I20260709 12:10:04.813114 27251 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.737077 27339 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:04.737555 27373 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:04.685491 27359 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:04.769140 27202 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:04.879629 25691 raft_consensus.cc:2368] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5.
I20260709 12:10:04.765957 27257 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:04.885914 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.886775 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.888888 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:04.776237 27308 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.765693 26896 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:10:04.899008 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.900004 25691 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:04.909183 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.910463 25693 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:04.916069 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.887888 27251 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:04.850194 27320 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.000s	sys 0.042s
W20260709 12:10:04.963692 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.964804 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:04.965994 25690 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:04.945194 27305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.019s	sys 0.016s
I20260709 12:10:04.977844 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:04.889952 27257 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:04.967934 27305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.020s	sys 0.017s
I20260709 12:10:04.936549 27394 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:04.989892 25687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.012s	sys 0.028s
W20260709 12:10:05.009721 25687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.012s	sys 0.028s
I20260709 12:10:04.850958 25685 rpcz_store.cc:276] 0709 12:10:03.541104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.577248 (+ 36144us) service_pool.cc:224] Handling call
0709 12:10:04.541089 (+963841us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:04.561490 (+ 20401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.695448 (+133958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.748874 (+ 53426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52500224}
I20260709 12:10:05.014768 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 86) took 1220 ms. Trace:
I20260709 12:10:05.015537 25687 rpcz_store.cc:276] 0709 12:10:03.795004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.861576 (+ 66572us) service_pool.cc:224] Handling call
0709 12:10:03.868624 (+  7048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.868847 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:04.145068 (+276221us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.014287 (+869219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.014373 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:05.014438 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.014536 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.014690 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":864762,"threads_started":1}
W20260709 12:10:05.021468 25692 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.013s	sys 0.030s
W20260709 12:10:05.024080 25692 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.013s	sys 0.030s
I20260709 12:10:05.009162 27205 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:05.024825 25583 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.020s	sys 0.020s
W20260709 12:10:05.027719 25583 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.020s	sys 0.020s
I20260709 12:10:05.027801 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 921) took 1052 ms. Trace:
W20260709 12:10:05.023058 26304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.014s	sys 0.026s
W20260709 12:10:05.017145 27204 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.016s	sys 0.024s
I20260709 12:10:05.028270 25694 rpcz_store.cc:276] 0709 12:10:03.975587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.975766 (+   179us) service_pool.cc:224] Handling call
0709 12:10:04.557179 (+581413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:04.558116 (+   937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.027559 (+469443us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003fe650. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:05.027727 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335719808}
W20260709 12:10:05.028232 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 766260us
W20260709 12:10:05.032280 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.010761 27247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.020s	sys 0.021s
W20260709 12:10:05.026098 27344 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.020s	sys 0.039s
W20260709 12:10:05.058122 26304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.030s
W20260709 12:10:05.070806 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 749906us
I20260709 12:10:05.020556 27156 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:05.076498 25583 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.767s (SENT)
I20260709 12:10:05.077414 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:05.058180 25765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.014s	sys 0.029s
I20260709 12:10:05.019804 27392 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:05.061344 27293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.009s	sys 0.032s
W20260709 12:10:05.058868 27382 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.018s	sys 0.024s
I20260709 12:10:05.022897 27351 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 12:10:05.108392 25583 leader_election.cc:336] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.882s (SENT)
W20260709 12:10:05.117972 25583 leader_election.cc:336] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.962s (SENT)
W20260709 12:10:05.119017 25583 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.105s (SENT)
W20260709 12:10:05.079900 25765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.015s	sys 0.029s
W20260709 12:10:05.058693 27204 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.017s	sys 0.025s
W20260709 12:10:05.070714 27344 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.021s	sys 0.039s
I20260709 12:10:05.054955 26896 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.072455 27373 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:05.109417 27293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.010s	sys 0.032s
W20260709 12:10:05.122941 27407 log.cc:927] Time spent T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:10:05.124285 27270 consensus_queue.cc:1048] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:05.107227 27156 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.126133 27342 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:05.128548 27196 consensus_meta.cc:287] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.000s
I20260709 12:10:05.056355 27404 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:05.058058 27205 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.130141 27359 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:05.081882 27400 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 12:10:05.080597 27247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.021s	sys 0.021s
I20260709 12:10:05.133237 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 858) took 1204 ms. Trace:
I20260709 12:10:05.132162 27392 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.140784 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 842) took 2553 ms. Trace:
I20260709 12:10:05.158202 25761 rpcz_store.cc:276] 0709 12:10:02.582308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.582459 (+   151us) service_pool.cc:224] Handling call
0709 12:10:02.597684 (+ 15225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.870621 (+1272937us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b1800254080. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb2d53060 00007fbdb2d53bfb 00007fbdb2d5e64b
0709 12:10:03.870796 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.870837 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.871545 (+   708us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.658059 (+786514us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.658105 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.658183 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.130411 (+472228us) raft_consensus.cc:1685] finished
0709 12:10:05.130434 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.135903 (+  5469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3188,"raft.queue_time_us":30173,"raft.run_cpu_time_us":462,"raft.run_wall_time_us":4902,"spinlock_wait_cycles":2312064,"thread_start_us":729262,"threads_started":2,"wal-append.queue_time_us":1083801}
I20260709 12:10:05.078961 27324 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:05.131407 27394 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.137773 27339 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:05.109855 27203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.020s	sys 0.028s
I20260709 12:10:05.156226 25765 rpcz_store.cc:276] 0709 12:10:03.929037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.128337 (+199300us) service_pool.cc:224] Handling call
0709 12:10:04.128802 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.129115 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:04.184866 (+ 55751us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.132608 (+947742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.132669 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:05.132730 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.132811 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.133090 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10532,"prepare.queue_time_us":268511,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":30638,"thread_start_us":936767,"threads_started":1}
W20260709 12:10:05.131681 27382 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.018s	sys 0.024s
I20260709 12:10:05.169543 26334 raft_consensus.cc:1240] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:05.152273 27156 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.172036 27158 raft_consensus.cc:993] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:05.173863 27156 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:05.181690 25766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.011s	sys 0.034s
W20260709 12:10:05.182210 25766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.034s
W20260709 12:10:05.155053 25764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.010s	sys 0.009s
I20260709 12:10:05.152328 27205 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:05.183972 25764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.011s	sys 0.010s
I20260709 12:10:05.137967 26896 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:05.133291 27210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.039s	sys 0.040s
I20260709 12:10:05.141641 27350 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:05.143458 27332 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:05.163118 27392 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:05.168200 25658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.004s	sys 0.017s
I20260709 12:10:05.143159 27373 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:05.188097 27210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.040s	sys 0.040s
W20260709 12:10:05.191552 25658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.004s	sys 0.018s
W20260709 12:10:05.192782 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 855933us
W20260709 12:10:05.192015 25768 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.004s
W20260709 12:10:05.193881 25768 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.017s	sys 0.004s
W20260709 12:10:05.200083 25767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.019s	sys 0.029s
W20260709 12:10:05.200919 25767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.020s	sys 0.029s
W20260709 12:10:05.169353 27203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.021s	sys 0.028s
W20260709 12:10:05.209424 25732 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.015s	sys 0.016s
W20260709 12:10:05.210098 25732 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.015s	sys 0.016s
W20260709 12:10:05.214389 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 534013us
W20260709 12:10:05.217456 25732 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.913s (SENT)
I20260709 12:10:05.174926 27339 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.175995 27394 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.224395 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:05.190009 27351 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:10:05.242126 27430 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.244812 27196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37142 (request call id 0) took 4903 ms. Trace:
W20260709 12:10:05.244421 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 172106us
I20260709 12:10:05.214095 27257 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.191592 27156 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:05.212566 27159 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:05.243705 27430 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.237744 27324 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.293994 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:05.303299 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 58573.3us
W20260709 12:10:05.333914 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.336982 25760 raft_consensus.cc:3060] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.265578 27403 raft_consensus.cc:1081] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:10:05.347221 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86641.8us
I20260709 12:10:05.265368 27404 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:05.311383 27257 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.332218 27320 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.335505 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 89) took 1202 ms. Trace:
W20260709 12:10:05.342847 25583 leader_election.cc:336] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.200s (SENT)
I20260709 12:10:05.303911 27342 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.308712 27344 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.366281 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:05.362813 25692 rpcz_store.cc:276] 0709 12:10:04.132957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.243756 (+110799us) service_pool.cc:224] Handling call
0709 12:10:04.244671 (+   915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.245011 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:05.024567 (+779556us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.335007 (+310440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.335115 (+   108us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:05.335183 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.335265 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.335431 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1096604,"thread_start_us":1088927,"threads_started":2}
W20260709 12:10:05.367708 25732 leader_election.cc:336] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 3.100s (SENT)
I20260709 12:10:05.368979 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:10:05.369442 27408 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:05.370379 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:05.371256 27392 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:05.265362 27196 rpcz_store.cc:276] 0709 12:10:00.341196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.341400 (+   204us) service_pool.cc:224] Handling call
0709 12:10:00.662180 (+320780us) log.cc:844] Serialized 508 byte log entry
0709 12:10:01.391900 (+729720us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b18000ab4c0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cdbb26 00007fbdb2cd549a 00007fbdb2cd4714
0709 12:10:01.392687 (+   787us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b5400521320. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cdbb26 00007fbdb2cd549a 00007fbdb2cd4714 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634
0709 12:10:01.463470 (+ 70783us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:01.576123 (+112653us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5400521320. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd4142 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634 0000000000388479 00007fbdafc6e475
0709 12:10:05.244684 (+3668561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2785,"raft.queue_time_us":23509,"raft.run_cpu_time_us":28853,"raft.run_wall_time_us":950192,"spinlock_wait_cycles":29274240,"thread_start_us":250846,"threads_started":1,"wal-append.queue_time_us":466153,"wal-append.run_cpu_time_us":4884,"wal-append.run_wall_time_us":1304247}
I20260709 12:10:05.339983 27350 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.373450 27350 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.375367 27394 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:05.375931 27350 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.377076 27403 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:05.377620 27403 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:05.379640 27203 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.380474 27203 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:05.381220 27403 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:05.382481 27257 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.382716 27404 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.388096 27430 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.389602 27373 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.390174 27320 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.391152 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7b82e0d41f14cc2baa1e889ed4c7312 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:05.393112 27320 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.395265 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 878) took 1108 ms. Trace:
I20260709 12:10:05.395704 25766 rpcz_store.cc:276] 0709 12:10:04.371492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.380303 (+  8811us) service_pool.cc:224] Handling call
0709 12:10:04.530826 (+150523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.531381 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.531424 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.550610 (+ 19186us) log.cc:844] Serialized 26 byte log entry
0709 12:10:05.182812 (+632202us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.182874 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.182983 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.394997 (+212014us) raft_consensus.cc:1685] finished
0709 12:10:05.395021 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.395195 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10759,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3901,"thread_start_us":557713,"threads_started":1,"wal-append.queue_time_us":812393}
I20260709 12:10:05.396875 27308 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.398430 27339 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.368822 27159 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:05.400110 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.390982 27202 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:05.383364 27424 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:05.410198 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:05.288966 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.368194 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:05.382754 27414 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 12:10:05.380486 26988 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.006s
W20260709 12:10:05.430595 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62195.9us
W20260709 12:10:05.424515 27306 consensus_meta.cc:287] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.845s	user 0.010s	sys 0.006s
I20260709 12:10:05.386023 27257 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:05.440416 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72741.5us
W20260709 12:10:05.440151 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 197515us
I20260709 12:10:05.399675 26896 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.447705 25692 raft_consensus.cc:1275] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:05.529357 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 77056.7us
W20260709 12:10:05.458199 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.486402 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:05.457100 25732 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 3.105s (SENT)
I20260709 12:10:05.534245 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:05.541893 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.458438 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.550683 25611 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:05.487703 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.552681 25612 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:05.457897 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.554930 25619 raft_consensus.cc:2410] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:05.486769 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.488186 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.557622 25610 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:05.487250 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.564635 25617 raft_consensus.cc:2410] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:05.566527 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.568186 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:05.526304 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.576802 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.579756 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 131242us
I20260709 12:10:05.582533 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:05.584486 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 95238.2us
W20260709 12:10:05.588997 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 58150.5us
I20260709 12:10:05.426918 27446 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:05.444561 27358 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:05.407135 27342 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.428870 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:05.616281 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:05.613085 25732 connection.cc:256] RPC call timeout handler was delayed by -1.7571891780000897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260709 12:10:05.617811 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:05.618161 25732 connection.cc:256] RPC call timeout handler was delayed by -1.6833891780001977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 12:10:05.618243 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:05.618816 25732 connection.cc:256] RPC call timeout handler was delayed by -1.6437891780001337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 12:10:05.618743 25764 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:05.619225 25760 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:05.619347 25732 connection.cc:256] RPC call timeout handler was delayed by -1.5879891780000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 12:10:05.410851 27344 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.622676 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.579648 27392 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.562095 26988 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:05.626336 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.627096 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.625123 25761 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:10:05.633698 25733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.009s
W20260709 12:10:05.634218 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:05.635274 25733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.007s	sys 0.010s
I20260709 12:10:05.634356 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:05.636157 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.637194 25766 raft_consensus.cc:2410] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:05.639673 25760 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:05.645735 25768 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:05.647993 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.648797 25768 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:05.593432 27247 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:05.621310 27324 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.579417 27293 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:10:05.629187 27359 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:05.665848 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.661214 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:05.690968 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.561265 27306 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:05.637101 27394 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:05.704097 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89189.4us
I20260709 12:10:05.624475 27158 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:10:05.691931 25762 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 2.
I20260709 12:10:05.715750 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:05.719314 25502 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet fa0600a571a0457f804bf9bf88fd9fd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:10:05.722450 25657 connection.cc:256] RPC call timeout handler was delayed by -3.7978201750001972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 12:10:05.723038 25657 connection.cc:256] RPC call timeout handler was delayed by -3.5818201750000753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 12:10:05.726711 25657 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:05.629894 27436 consensus_queue.cc:1048] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:10:05.733305 25692 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.738626 25688 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.740084 25692 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.740219 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.735291 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.744767 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.750679 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.751323 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.751928 25691 raft_consensus.cc:2376] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5. Re-sending same reply.
I20260709 12:10:05.752914 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.764019 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:05.645916 26988 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.769634 25612 raft_consensus.cc:2393] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:05.797662 25690 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.851979 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.853440 25689 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:10:05.853973 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:05.855623 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 234545us
I20260709 12:10:05.860347 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.861245 25763 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:05.646318 27392 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:05.862200 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.876299 25763 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:05.877530 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.866051 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.870502 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.880549 25693 raft_consensus.cc:2376] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
I20260709 12:10:05.872802 25689 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:05.881495 25689 pending_rounds.cc:85] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 3
I20260709 12:10:05.881816 25689 pending_rounds.cc:107] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:05.882126 25689 raft_consensus.cc:2889] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:05.718031 27448 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.724613 27213 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:05.676060 27324 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.907799 25689 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:05.893826 25763 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:05.702184 27359 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.735265 27332 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:05.725366 27394 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.911914 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.930346 25763 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:05.931478 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.932816 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.853040 27453 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:05.903326 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 149536us
I20260709 12:10:05.927431 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:05.932124 25763 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:05.898516 27448 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.903684 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.951431 25762 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:05.946061 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:05.945016 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.952715 25689 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:05.959149 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.960111 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.960579 25763 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:05.961225 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.922345 27202 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:05.946223 27205 consensus_meta.cc:287] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.004s
I20260709 12:10:05.965670 27203 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.968160 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:05.968531 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.961663 25763 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:05.973521 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.974298 25763 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:05.975181 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:05.975785 25763 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:05.976568 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:05.944739 27454 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.910938 27213 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:05.966665 27442 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:05.954299 27448 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.951221 27459 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:06.025995 27459 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:06.029227 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.029276 27459 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:06.031050 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.987154 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:05.990046 25686 raft_consensus.cc:2410] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:06.032531 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:06.033794 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.035202 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:06.035692 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:05.992589 27306 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:05.994947 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:05.996280 27440 log.cc:927] Time spent T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:10:05.999034 27342 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:05.999459 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.039129 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:06.040001 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.040604 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.042433 27450 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:06.000234 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.043519 25692 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:06.044572 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.000002 27213 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:05.980535 27205 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:06.000967 27441 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:10:06.002434 27392 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:06.002862 27344 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:06.003612 27433 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:10:05.945365 27156 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 12:10:05.983013 27434 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:10:05.952109 27453 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:05.936805 27332 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.050664 27332 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.050778 27453 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.007411 27359 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.051329 27332 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:06.014201 27438 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:10:06.051769 27332 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:06.015767 27324 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.023756 26988 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:05.991604 27251 consensus_meta.cc:287] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.034s	user 0.011s	sys 0.003s
I20260709 12:10:06.052695 27332 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.053452 27251 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.011376 27394 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.046016 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.055745 27251 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:05.986908 27293 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:06.054098 27450 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.056612 27293 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:06.057384 27450 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:06.057723 27456 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:10:06.042016 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:06.040622 25693 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:10:06.059646 27465 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.094s	user 0.000s	sys 0.003s
I20260709 12:10:06.059823 27293 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:06.038154 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:06.060454 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.060814 26337 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
W20260709 12:10:06.042023 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73953.8us
I20260709 12:10:06.061743 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.062628 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:06.062985 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.048208 27205 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.064103 27306 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:06.064416 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.064883 27306 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:06.065377 27306 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:06.065845 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.075552 25760 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.068626 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.077759 27448 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.079241 25688 raft_consensus.cc:2368] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5.
I20260709 12:10:06.079355 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.080008 25687 raft_consensus.cc:1813] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Handling vote request from an unknown peer 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:06.080304 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.080562 25687 raft_consensus.cc:2410] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 12:10:06.081483 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.083884 27464 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:06.084452 27464 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.087204 27464 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.088402 25691 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:06.094895 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:06.095999 25691 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:06.096247 25689 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:06.096649 25689 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:06.063839 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:06.097472 25691 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:06.059060 25690 raft_consensus.cc:2376] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5. Re-sending same reply.
I20260709 12:10:06.072506 27308 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:06.073772 27460 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.360s	user 0.003s	sys 0.000s
W20260709 12:10:06.089242 27451 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.375s	user 0.002s	sys 0.003s
W20260709 12:10:06.091243 27452 log.cc:927] Time spent T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.377s	user 0.005s	sys 0.000s
W20260709 12:10:06.162348 25658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.006s	sys 0.004s
W20260709 12:10:06.186825 25658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.006s	sys 0.004s
I20260709 12:10:06.186975 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.163550 27306 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.188023 25767 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:06.166168 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.190580 27306 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.162120 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 883) took 1551 ms. Trace:
I20260709 12:10:06.191146 25766 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:06.192444 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.193783 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.070950 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:06.097844 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:06.194901 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 97153.6us
I20260709 12:10:06.166189 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.195720 25761 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:06.195761 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:06.196818 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:06.196861 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.036543 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.197803 25761 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:06.097476 27351 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:06.169469 27449 raft_consensus.cc:2764] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:06.199380 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:06.200637 27156 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.059679 25692 raft_consensus.cc:2410] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:10:06.101516 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 440353us
I20260709 12:10:06.104360 25762 raft_consensus.cc:2410] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:06.202360 27470 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.202984 27470 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.203354 27470 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.203564 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.204250 25762 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.114583 25760 raft_consensus.cc:2410] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:06.097446 25689 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.172192 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.206723 25689 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.129331 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 178) took 9610 ms. Trace:
I20260709 12:10:06.144279 27450 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.155438 27332 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:06.157512 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 452185us
W20260709 12:10:06.187173 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 653012us
I20260709 12:10:06.198642 27308 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:06.201042 27156 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:06.094365 25763 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.094477 27448 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.306790 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.206898 25694 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:10:06.315436 25761 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:06.175892 25685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.011s
W20260709 12:10:06.316057 25685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.001s	sys 0.027s
W20260709 12:10:06.252892 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46381.9us
W20260709 12:10:06.167258 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.191634 25759 rpcz_store.cc:276] 0709 12:10:04.610764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.611302 (+   538us) service_pool.cc:224] Handling call
0709 12:10:04.611842 (+   540us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:05.448221 (+836379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.448259 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:05.720145 (+271886us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b2c00003bf8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:05.731276 (+ 11131us) log.cc:844] Serialized 52 byte log entry
0709 12:10:06.158296 (+427020us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:06.158352 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.161516 (+  3164us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001b9c54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:06.161588 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.161720 (+   132us) raft_consensus.cc:1685] finished
0709 12:10:06.161757 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.162027 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336263,"raft.queue_time_us":387610,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":14967,"spinlock_wait_cycles":571173632,"thread_start_us":625102,"threads_started":2,"wal-append.queue_time_us":288633}
I20260709 12:10:06.318800 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.316911 25582 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:06.319469 25689 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:06.240439 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:06.247718 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.202121 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.185755 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.264938 25762 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:06.207901 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.322865 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:06.323581 25767 raft_consensus.cc:2410] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:06.186041 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.325629 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 91) took 1075 ms. Trace:
I20260709 12:10:06.320806 25760 raft_consensus.cc:2410] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:06.329684 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.333024 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.336658 25689 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:06.338392 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.341030 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.326162 25685 rpcz_store.cc:276] 0709 12:10:05.250465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.270388 (+ 19923us) service_pool.cc:224] Handling call
0709 12:10:05.336587 (+ 66199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.336801 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:05.639593 (+302792us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.325280 (+685687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.325336 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:06.325379 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.325466 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.325575 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19458,"prepare.queue_time_us":55379,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":9786,"thread_start_us":929636,"threads_started":2,"wal-append.queue_time_us":513619}
W20260709 12:10:06.342144 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 140116us
I20260709 12:10:06.342281 25688 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:06.343086 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.328286 25765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:06.341414 25767 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.344358 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:06.376080 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.383402 25763 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:06.317803 27156 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.317971 27308 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:06.408936 25765 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.411603 25762 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.455029 25765 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.285876 27159 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.414382 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.344316 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:06.384876 27469 log.cc:927] Time spent T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:06.320999 25515 rpcz_store.cc:276] 0709 12:09:56.502839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.506658 (+  3819us) service_pool.cc:224] Handling call
0709 12:10:06.112980 (+9606322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:59.890053 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:00.138732 (+248679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:00.144839 (+  6107us) write_op.cc:435] Acquired schema lock
0709 12:10:00.152742 (+  7903us) tablet.cc:662] Decoding operations
0709 12:10:00.332199 (+179457us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:00.332276 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:00.332309 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:10:00.333803 (+  1494us) tablet.cc:701] Row locks acquired
0709 12:10:00.333820 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:01.166656 (+832836us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b2c000fb138. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1663a0a 00007fbdb1663693 00007fbdb1663631 00007fbdb2d96902 00007fbdb2d966dd 00007fbdb6791243 00007fbdb6790d58 00007fbdb67959f1 00007fbdb67959a9 00007fbdb6795939
0709 12:10:01.166768 (+   112us) write_op.cc:270] Start()
0709 12:10:01.167035 (+   267us) write_op.cc:276] Timestamp: P: 1783599000372461 usec, L: 0
0709 12:10:01.167073 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:10:01.167882 (+   809us) log.cc:844] Serialized 5236 byte log entry
0709 12:10:01.623475 (+455593us) op_driver.cc:464] REPLICATION: finished
0709 12:10:01.830977 (+207502us) write_op.cc:301] APPLY: starting
0709 12:10:01.831093 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:01.831448 (+   355us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:01.831472 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:01.948137 (+116665us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:01.948591 (+   454us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:10:01.948671 (+    80us) write_op.cc:312] APPLY: finished
0709 12:10:01.949226 (+   555us) log.cc:844] Serialized 94 byte log entry
0709 12:10:01.949495 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:01.949670 (+   175us) write_op.cc:454] Released schema lock
0709 12:10:01.949726 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:01.950187 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:01.950216 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35100,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":204757,"apply.run_cpu_time_us":5941,"apply.run_wall_time_us":119189,"num_ops":13,"prepare.queue_time_us":424307,"prepare.run_cpu_time_us":38873,"prepare.run_wall_time_us":1406606,"raft.queue_time_us":340143,"raft.run_cpu_time_us":13231,"raft.run_wall_time_us":157454,"replication_time_us":441007,"spinlock_wait_cycles":88514816,"thread_start_us":561739,"threads_started":4,"wal-append.queue_time_us":61777,"wal-append.run_cpu_time_us":56038,"wal-append.run_wall_time_us":1726122}]]}
I20260709 12:10:06.341813 27257 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.198414 27351 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:06.416807 25760 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.436331 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.436522 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.436944 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.324954 27448 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:10:06.438971 25619 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:06.473315 25619 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:06.439656 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.440402 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:06.450807 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:06.334542 27464 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.445349 25616 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.479406 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:06.447894 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:06.329717 27446 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:10:06.452576 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:06.330127 27453 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 12:10:06.413028 27468 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.444554 27323 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:06.458171 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:06.613974 25615 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
W20260709 12:10:06.462535 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 118310us
I20260709 12:10:06.462669 25610 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.470230 25690 raft_consensus.cc:2410] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:06.615861 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.470234 25689 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:06.474615 25692 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:06.442111 25611 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.458792 27308 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:06.478567 25619 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.480980 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:06.459611 27159 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:06.485719 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 158854us
I20260709 12:10:06.471043 27392 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.467320 27257 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:06.471127 27351 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:06.608054 25765 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.494019 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:06.650898 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:06.633963 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.652725 25617 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.641347 27464 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.642307 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:06.643795 27485 log.cc:927] Time spent T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.013s
I20260709 12:10:06.640522 27358 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.653229 25763 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.655462 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.666251 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:06.632905 25613 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:06.673982 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.682217 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.675832 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:06.691672 25613 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.693531 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:06.695231 25765 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.697156 25617 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:06.689815 25763 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
W20260709 12:10:06.698166 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.645428 27159 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.722407 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.660663 27257 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.727859 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:06.691390 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:06.616142 27202 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:10:06.650069 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:06.703212 27471 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.655566 27392 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:06.699025 27394 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.677737 27403 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:06.735855 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54034 (request call id 897) took 1038 ms. Trace:
I20260709 12:10:06.656327 26988 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.679448 27358 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.738679 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:06.679083 27359 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.698343 27247 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:10:06.688370 27423 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.720772 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.701673 27405 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.720877 27293 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.649686 27323 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:06.739079 27448 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.764285 25765 rpcz_store.cc:276] 0709 12:10:05.657327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.328150 (+670823us) service_pool.cc:224] Handling call
0709 12:10:06.695676 (+367526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.781224 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.782339 25765 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:06.782474 27448 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:06.692456 27251 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:10:06.785037 27359 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:06.785303 27488 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:10:06.787704 27358 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.764038 27324 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.789117 27324 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.679275 27468 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:06.700958 27213 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:06.701148 27459 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:10:06.746464 26334 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.754519 27449 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:06.749380 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:06.749770 27471 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:06.758535 27392 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.782974 27448 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:06.785105 27470 consensus_meta.cc:287] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260709 12:10:06.793764 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 893) took 1138 ms. Trace:
I20260709 12:10:06.811656 25759 rpcz_store.cc:276] 0709 12:10:05.655194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.318872 (+663678us) service_pool.cc:224] Handling call
0709 12:10:06.319228 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.319960 (+   732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.319991 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.320509 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.416979 (+ 96470us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.417079 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.417438 (+   359us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.793448 (+376010us) raft_consensus.cc:1685] finished
0709 12:10:06.793483 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.793680 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4728,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":2263,"thread_start_us":96000,"threads_started":1,"wal-append.queue_time_us":161933}
I20260709 12:10:06.774024 25763 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:06.764381 27453 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:06.778880 27394 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.773450 26988 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.828333 27324 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:06.830425 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1207) took 1124 ms. Trace:
I20260709 12:10:06.830941 26988 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.832464 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1213) took 1124 ms. Trace:
I20260709 12:10:06.832933 25762 rpcz_store.cc:276] 0709 12:10:05.707953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.455622 (+747669us) service_pool.cc:224] Handling call
0709 12:10:06.456938 (+  1316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.457391 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.457435 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.457988 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.611376 (+153388us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.611425 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.611510 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.832211 (+220701us) raft_consensus.cc:1685] finished
0709 12:10:06.832239 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.832397 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3416,"raft.queue_time_us":466,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10153,"thread_start_us":150133,"threads_started":1,"wal-append.queue_time_us":259928}
I20260709 12:10:06.830981 25764 rpcz_store.cc:276] 0709 12:10:05.705764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.414350 (+708586us) service_pool.cc:224] Handling call
0709 12:10:06.416631 (+  2281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.439038 (+ 22407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.439089 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.458241 (+ 19152us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.724512 (+266271us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.724559 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.724640 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.830044 (+105404us) raft_consensus.cc:1685] finished
0709 12:10:06.830064 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.830336 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3333,"raft.queue_time_us":26988,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":7847,"thread_start_us":265914,"threads_started":1,"wal-append.queue_time_us":320929}
I20260709 12:10:06.835976 25762 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:06.836885 27450 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.837060 25764 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:06.837682 25762 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:06.817034 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.799463 27449 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.808365 27213 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:06.827431 27394 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.804638 27471 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.838074 27459 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:06.850230 27449 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:06.845484 26988 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:06.822325 27470 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.873854 27459 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:06.850688 27323 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:06.807860 27293 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:07.006312 27293 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:06.978653 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 220096us
I20260709 12:10:07.008778 27293 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.011471 27293 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:07.015013 25502 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet fa0600a571a0457f804bf9bf88fd9fd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:06.982610 25759 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:06.985378 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 246595us
I20260709 12:10:07.021596 25732 leader_election.cc:400] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5.
I20260709 12:10:07.022030 25732 leader_election.cc:403] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:06.988435 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1218) took 1133 ms. Trace:
I20260709 12:10:07.022570 25760 rpcz_store.cc:276] 0709 12:10:05.854513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.469021 (+614508us) service_pool.cc:224] Handling call
0709 12:10:06.469277 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.469448 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:06.479251 (+  9803us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.987214 (+507963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.987382 (+   168us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.987577 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.987762 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.988104 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16082,"prepare.queue_time_us":13753,"prepare.run_cpu_time_us":3309,"prepare.run_wall_time_us":46134,"raft.queue_time_us":41274,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":491187,"threads_started":2,"wal-append.queue_time_us":343834}
W20260709 12:10:06.986040 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 292478us
I20260709 12:10:06.991283 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1224) took 1021 ms. Trace:
I20260709 12:10:07.026607 25762 rpcz_store.cc:276] 0709 12:10:05.969903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.838891 (+868988us) service_pool.cc:224] Handling call
0709 12:10:06.990079 (+151188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.990655 (+   576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.990685 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.990769 (+    84us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.990801 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.990886 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.991048 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.848731 25764 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.030069 25582 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:07.031880 26896 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.035307 25764 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.993654 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1217) took 1246 ms. Trace:
I20260709 12:10:06.891948 26988 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:07.038561 25768 rpcz_store.cc:276] 0709 12:10:05.746959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.461184 (+714225us) service_pool.cc:224] Handling call
0709 12:10:06.461514 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.461864 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.461892 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.470913 (+  9021us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.723223 (+252310us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.992589 (+269366us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.993099 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.993213 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.993273 (+    60us) raft_consensus.cc:1685] finished
0709 12:10:06.993284 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.993488 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28172,"prepare.queue_time_us":54747,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":118,"spinlock_wait_cycles":5152640,"thread_start_us":464733,"threads_started":2,"wal-append.queue_time_us":301047}
I20260709 12:10:07.040649 27324 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 4. Current term is 5.
I20260709 12:10:07.043079 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.044539 27324 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.045045 27324 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:07.045570 27324 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.042003 25768 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.056164 27394 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:07.029176 25762 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:07.025741 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.799356 27423 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:06.873771 27308 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.116441 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:06.993180 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1210) took 1286 ms. Trace:
I20260709 12:10:07.122953 25766 rpcz_store.cc:276] 0709 12:10:05.706723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.442963 (+736240us) service_pool.cc:224] Handling call
0709 12:10:06.444445 (+  1482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.444852 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.444881 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.445331 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.695648 (+250317us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.758995 (+ 63347us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.992485 (+233490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.992623 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.992708 (+    85us) raft_consensus.cc:1685] finished
0709 12:10:06.992723 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.992956 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73749,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":22124,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":10611,"thread_start_us":411010,"threads_started":2,"wal-append.queue_time_us":337570}
I20260709 12:10:07.125543 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:06.991601 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1211) took 1284 ms. Trace:
I20260709 12:10:06.937240 27470 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:06.937434 27498 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.127660 27498 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.129133 27498 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.005049 27205 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.019568 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.130985 25759 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.130857 27205 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.132243 27506 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:07.133364 27506 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.133749 27205 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.095526 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.134866 25760 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.093968 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 84235.9us
I20260709 12:10:07.135038 25766 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.109385 25615 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:07.032061 27332 consensus_meta.cc:287] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.003s
W20260709 12:10:07.137519 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 111247us
I20260709 12:10:07.117738 27308 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.117813 25612 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:07.126596 27464 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:07.130004 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.145339 25764 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:07.147707 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 403251us
I20260709 12:10:07.164330 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:07.172005 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.173326 27159 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.175907 27472 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.150496 26988 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:07.176503 27293 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.176570 27472 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.178390 27159 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.179385 25616 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.140345 27324 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.165248 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:07.189085 27324 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:07.189469 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.126420 25767 rpcz_store.cc:276] 0709 12:10:05.707097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.446470 (+739373us) service_pool.cc:224] Handling call
0709 12:10:06.452050 (+  5580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.452566 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.452602 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.455699 (+  3097us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.848364 (+392665us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.990341 (+141977us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.990936 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.991071 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.991170 (+    99us) raft_consensus.cc:1685] finished
0709 12:10:06.991188 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.991390 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9640,"prepare.queue_time_us":234700,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":3567,"raft.queue_time_us":48911,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":9142,"thread_start_us":251752,"threads_started":1,"wal-append.queue_time_us":422064}
W20260709 12:10:07.195284 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 152470us
I20260709 12:10:06.922678 27459 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.191280 27498 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.206526 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58457.9us
I20260709 12:10:07.214133 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:07.220323 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1209) took 1513 ms. Trace:
I20260709 12:10:07.226197 25761 rpcz_store.cc:276] 0709 12:10:05.706444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.442796 (+736352us) service_pool.cc:224] Handling call
0709 12:10:06.451031 (+  8235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.468166 (+ 17135us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:06.691080 (+222914us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.166608 (+475528us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:07.167494 (+   886us) log.cc:844] Serialized 26 byte log entry
0709 12:10:07.167708 (+   214us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:07.168342 (+   634us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.168580 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.168699 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.219826 (+ 51127us) raft_consensus.cc:1685] finished
0709 12:10:07.219858 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.220107 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40676,"prepare.queue_time_us":180371,"prepare.run_cpu_time_us":140,"prepare.run_wall_time_us":3805,"raft.queue_time_us":4457,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":5986,"thread_start_us":531847,"threads_started":2,"wal-append.queue_time_us":463578}
I20260709 12:10:07.215255 27293 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:07.230329 27293 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:07.230862 27293 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.198887 25759 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:07.219676 27324 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:07.235595 27324 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:07.216463 26334 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:07.239614 27324 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:07.247459 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:10:07.248679 27156 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.008s
W20260709 12:10:07.249131 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 85076us
I20260709 12:10:07.251224 27156 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.108501 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:07.255108 25618 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.258414 27156 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.253885 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.212265 27459 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.199682 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:07.241861 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:07.271466 25766 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:07.290627 25760 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:07.290133 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 76230.7us
I20260709 12:10:07.207579 27471 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.199196 27472 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.331688 27472 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.332643 27471 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:07.300194 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46560.8us
I20260709 12:10:07.301591 27323 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.306201 27156 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:07.306574 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64934.8us
I20260709 12:10:07.323868 27324 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.232329 27293 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.352564 27156 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.376543 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1219) took 1483 ms. Trace:
W20260709 12:10:07.380040 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 180621us
I20260709 12:10:07.372944 27213 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:07.377120 25763 rpcz_store.cc:276] 0709 12:10:05.893046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.814838 (+921792us) service_pool.cc:224] Handling call
0709 12:10:06.815312 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.984945 (+169633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.985044 (+    99us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.986477 (+  1433us) log.cc:844] Serialized 26 byte log entry
0709 12:10:07.032758 (+ 46281us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:07.033217 (+   459us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.033485 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.375868 (+342383us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540030c5d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:07.375938 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.375998 (+    60us) raft_consensus.cc:1685] finished
0709 12:10:07.376125 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.376316 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35352,"prepare.queue_time_us":58660,"prepare.run_cpu_time_us":179,"prepare.run_wall_time_us":2095,"raft.queue_time_us":61447,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":259,"spinlock_wait_cycles":387113216,"thread_start_us":45622,"threads_started":1,"wal-append.queue_time_us":47452}
W20260709 12:10:07.433640 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.388320 27308 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.450225 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 78016.5us
I20260709 12:10:07.392390 27522 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:07.449889 27392 consensus_meta.cc:287] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.011s
W20260709 12:10:07.462373 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69432.2us
I20260709 12:10:07.451233 27293 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:07.393455 27159 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:10:07.448560 27213 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.394809 27323 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
W20260709 12:10:07.471947 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84470.8us
I20260709 12:10:07.471630 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:07.489897 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 43) took 5916 ms. Trace:
I20260709 12:10:07.467869 27159 consensus_queue.cc:1243] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:07.496088 27508 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.496325 27507 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.482007 27308 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.467694 27470 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:07.492630 27471 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:10:07.500250 27308 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:07.500681 27449 consensus_meta.cc:287] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.609s	user 0.016s	sys 0.003s
I20260709 12:10:07.500994 27445 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:07.501242 27449 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.502394 27445 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.502804 27445 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.503870 27449 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.504907 27156 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.506438 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.492122 25516 rpcz_store.cc:276] 0709 12:10:01.446492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.448475 (+  1983us) service_pool.cc:224] Handling call
0709 12:10:01.458886 (+ 10411us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b5400002438. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b19e43 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:07.357164 (+5898278us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:04.744684 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:04.968910 (+224226us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:04.984945 (+ 16035us) write_op.cc:435] Acquired schema lock
0709 12:10:04.987634 (+  2689us) tablet.cc:662] Decoding operations
0709 12:10:05.114432 (+126798us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.114536 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.122954 (+  8418us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:05.123351 (+   397us) tablet.cc:701] Row locks acquired
0709 12:10:05.123374 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:10:05.123597 (+   223us) write_op.cc:270] Start()
0709 12:10:05.123769 (+   172us) write_op.cc:276] Timestamp: P: 1783599005123528 usec, L: 0
0709 12:10:05.123797 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.124819 (+  1022us) log.cc:844] Serialized 1434 byte log entry
0709 12:10:06.192229 (+1067410us) op_driver.cc:464] REPLICATION: finished
0709 12:10:06.438402 (+246173us) write_op.cc:301] APPLY: starting
0709 12:10:06.444248 (+  5846us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.468494 (+ 24246us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.541648 (+ 73154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.735923 (+194275us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.763458 (+ 27535us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:06.769638 (+  6180us) write_op.cc:312] APPLY: finished
0709 12:10:06.786703 (+ 17065us) log.cc:844] Serialized 34 byte log entry
0709 12:10:06.786963 (+   260us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.787109 (+   146us) write_op.cc:454] Released schema lock
0709 12:10:06.787173 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:06.787686 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.787711 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1168695,"reported_tablets":3,"spinlock_wait_cycles":17081600,"child_traces":[["op",{"apply.queue_time_us":217525,"apply.run_cpu_time_us":7103,"apply.run_wall_time_us":372447,"num_ops":3,"prepare.queue_time_us":1290974,"prepare.run_cpu_time_us":21752,"prepare.run_wall_time_us":663520,"raft.queue_time_us":139213,"raft.run_cpu_time_us":9126,"raft.run_wall_time_us":133193,"replication_time_us":1068273,"thread_start_us":1332406,"threads_started":4,"wal-append.queue_time_us":474446}]]}
W20260709 12:10:07.507094 27525 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 12:10:07.468197 27392 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.521924 27507 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.524955 27507 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:07.525866 27423 consensus_queue.cc:1059] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:07.528652 27308 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.503790 27445 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.543748 25612 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:07.530164 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:07.541742 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 70317.2us
I20260709 12:10:07.543987 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:07.547354 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61596.1us
I20260709 12:10:07.533699 27423 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:07.532671 27471 consensus_queue.cc:1243] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:07.531641 27453 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:07.554200 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.547267 27449 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.532279 27392 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:07.513438 27213 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.533609 27520 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.551167 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:07.556035 27524 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:10:07.547233 27257 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.762s	user 0.013s	sys 0.005s
I20260709 12:10:07.583714 25616 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
W20260709 12:10:07.589372 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 142757us
I20260709 12:10:07.548278 27324 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.588567 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:07.550945 27247 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:07.549691 27423 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.593538 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:07.591873 27471 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:07.579170 27453 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.610152 25615 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:07.620687 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 66771.8us
I20260709 12:10:07.587447 27449 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:07.625330 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45734.7us
I20260709 12:10:07.627523 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:07.629280 27526 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:10:07.631532 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1366) took 1221 ms. Trace:
W20260709 12:10:07.633517 27527 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:10:07.631968 25614 rpcz_store.cc:276] 0709 12:10:06.409760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.410013 (+   253us) service_pool.cc:224] Handling call
0709 12:10:06.410437 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.613184 (+202747us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:06.677855 (+ 64671us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b18003feaa0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:07.217344 (+539489us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.382131 (+164787us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:07.489940 (+107809us) log.cc:844] Serialized 26 byte log entry
0709 12:10:07.493162 (+  3222us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:07.493203 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.514532 (+ 21329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.630970 (+116438us) raft_consensus.cc:1685] finished
0709 12:10:07.631117 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.631293 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285944,"prepare.queue_time_us":20358,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":228982,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":21211,"spinlock_wait_cycles":14653696,"thread_start_us":654336,"threads_started":2,"wal-append.queue_time_us":299307}
I20260709 12:10:07.611667 27445 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.610976 27247 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.634702 27470 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:07.641515 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:07.635294 27351 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.009s
I20260709 12:10:07.593729 27257 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.641351 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:07.643880 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.637105 27470 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.657260 27423 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.668565 27423 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.652572 27324 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.680055 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.674744 27392 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.681386 27392 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:07.681864 27521 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.383s	user 0.007s	sys 0.000s
I20260709 12:10:07.682439 25611 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:07.676606 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.682996 27498 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.637080 27453 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.683459 27498 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.684190 27453 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:07.684592 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1386) took 1059 ms. Trace:
I20260709 12:10:07.684530 27498 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.685122 25611 rpcz_store.cc:276] 0709 12:10:06.625431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.625689 (+   258us) service_pool.cc:224] Handling call
0709 12:10:06.626025 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.682907 (+1056882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.684261 (+  1354us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540003a2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:07.684516 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2387395328}
I20260709 12:10:07.678229 27323 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.681810 27392 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:07.677230 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 50137.2us
I20260709 12:10:07.676517 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:07.686022 27498 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.694857 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.656358 27351 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.704282 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1375) took 1252 ms. Trace:
I20260709 12:10:07.688402 27323 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:07.704653 25618 rpcz_store.cc:276] 0709 12:10:06.448930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.449059 (+   129us) service_pool.cc:224] Handling call
0709 12:10:06.449343 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.255710 (+806367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.690978 (+435268us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400418a54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:07.700900 (+  9922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852164352}
I20260709 12:10:07.699568 27159 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:07.703810 27522 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:07.727736 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47809.7us
I20260709 12:10:07.711308 27323 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.725044 27324 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.726171 27471 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.744246 27520 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.733085 27159 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.743234 27449 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.706599 27247 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.735450 27459 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:07.753091 27470 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.715695 27392 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.757807 25619 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:07.766604 27529 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:10:07.763123 27520 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.779752 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:07.747112 27324 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:07.778442 27448 consensus_meta.cc:287] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.865s	user 0.017s	sys 0.000s
I20260709 12:10:07.757900 26988 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.768311 27293 consensus_queue.cc:1059] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:07.788942 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.766547 27506 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.783658 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:07.793823 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 82581.5us
I20260709 12:10:07.757458 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:07.748027 27518 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.798235 27529 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:07.798837 25611 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.784778 27324 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.798979 27213 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.793649 25762 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.820415 27508 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.841013 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.843894 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.799032 27293 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.830816 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1388) took 1180 ms. Trace:
I20260709 12:10:07.844626 27293 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:07.845259 27472 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.009s
I20260709 12:10:07.779446 27471 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.844647 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:07.840195 27498 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.845883 27293 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.846868 27498 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.847342 27293 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.803273 27529 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.807166 25615 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.807732 27156 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:07.808717 27159 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.851326 27520 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.789981 26988 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.855815 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:07.789903 27423 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:10:07.811393 27257 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.815526 27392 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.816072 26896 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:07.843854 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:07.826112 25767 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:07.801680 25618 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:07.835122 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 91101.5us
I20260709 12:10:07.823134 25765 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:07.850921 27529 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.794356 27506 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.847534 27471 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.844856 25619 rpcz_store.cc:276] 0709 12:10:06.650720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.652575 (+  1855us) service_pool.cc:224] Handling call
0709 12:10:06.652932 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.778598 (+1125666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.830485 (+ 51887us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400302854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:07.830724 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2435903232}
I20260709 12:10:07.801013 27518 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.827772 27351 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.870546 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:07.871429 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.871114 26988 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.797768 27448 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.876613 27308 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.877719 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:07.874954 27323 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.854157 27445 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.936305 25762 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:07.888321 27213 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:07.889202 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.947141 25760 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.930236 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.932353 25764 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:07.888163 27423 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:07.952656 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 75030.5us
I20260709 12:10:07.958060 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.959203 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:07.964316 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:07.965138 25764 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:07.966701 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.967672 27448 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:07.972322 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:07.974704 26303 leader_election.cc:336] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.877s (SENT)
I20260709 12:10:07.976092 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:07.977627 27518 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.979673 27518 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.998857 27445 raft_consensus.cc:697] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:07.956599 27453 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.981810 27529 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.000558 27445 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:08.003759 25768 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.004916 25767 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.982867 27506 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:07.983884 27257 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:07.951140 27423 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:07.987257 25517 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:07.997817 26988 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:08.027961 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51995.7us
I20260709 12:10:08.030115 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:08.034391 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 70675us
I20260709 12:10:08.037837 25760 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:08.067307 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:08.073223 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.030507 27308 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.074505 27459 consensus_queue.cc:1243] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:08.083031 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52998us
I20260709 12:10:08.083640 27156 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.090052 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:08.076717 27506 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:08.090278 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 343432us
I20260709 12:10:08.081679 27453 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:08.087693 25517 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:08.122824 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 184112us
I20260709 12:10:08.091251 27498 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.122495 27507 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.103227 27508 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:08.159459 27507 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:08.160409 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.160894 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.127992 27511 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 12:10:08.130867 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.161916 27507 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:08.140161 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:08.140806 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63490.3us
I20260709 12:10:08.166847 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:08.146906 27257 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:08.105486 27453 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.147708 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:08.149025 25517 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.152911 27449 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.153402 27423 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.157090 27324 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.158550 27323 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.136885 25583 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:08.176429 25767 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:08.182487 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:08.197118 25517 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 3, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.200042 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.184355 27449 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:08.203486 25615 raft_consensus.cc:606] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:08.184569 27453 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:08.208181 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60635.1us
W20260709 12:10:08.202142 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.223366 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.224004 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.215445 25766 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.216617 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:08.193665 27308 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:08.195348 27257 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:08.194859 27464 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:08.232314 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 92241.8us
I20260709 12:10:08.226398 27351 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.228960 27308 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.237769 25517 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.213431 26896 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:10:08.237066 27423 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.238605 27351 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:08.251844 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 115066us
I20260709 12:10:08.257043 25517 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:08.280530 27449 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.250748 27308 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.303145 27449 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.260373 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:08.306735 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50832.3us
I20260709 12:10:08.306978 26896 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:08.307772 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:08.307821 26896 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:08.308733 27159 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:08.309240 27159 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:08.282666 27537 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.310429 27558 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:08.310519 27159 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.311784 27558 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.312305 27558 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:08.258247 27257 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.257078 27351 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.325999 25765 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:08.257704 27498 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:08.332718 27498 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:08.333284 25765 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:08.333231 27498 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:08.286466 27247 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:08.331622 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.335618 27247 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:08.338063 27247 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.298858 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:08.300364 27324 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:08.320990 25767 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.323815 25583 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:08.309273 26896 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.313570 27558 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.297015 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:08.346210 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59533.9us
I20260709 12:10:08.334908 27498 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.355898 27470 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:08.361052 27453 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.362563 25517 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.370715 27511 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:08.385975 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.387266 25764 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:08.395119 25690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:08.382972 27351 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.397487 27466 raft_consensus.cc:993] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:10:08.403874 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.410737 25690 raft_consensus.cc:606] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:08.418823 25690 raft_consensus.cc:614] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:08.411590 25517 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.416616 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:08.403254 27392 raft_consensus.cc:2764] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:08.429359 27561 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:08.435431 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 136655us
I20260709 12:10:08.410034 27247 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.446954 25517 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.418373 27511 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:08.411259 27159 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:08.443126 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 119364us
I20260709 12:10:08.443341 27506 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:08.491675 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75217.7us
I20260709 12:10:08.486742 27213 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:08.488009 27466 raft_consensus.cc:1081] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:10:08.498905 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89947.4us
I20260709 12:10:08.503221 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:08.511006 27213 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.513691 27213 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.491181 27308 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.519577 27308 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:08.539709 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.550096 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.552520 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.589068 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:08.589069 25517 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.517951 27498 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.601899 25613 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:08.607551 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.496129 27561 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:08.614154 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:08.614509 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81246.8us
I20260709 12:10:08.614300 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:08.533476 27351 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.615259 25759 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.590700 27537 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.615893 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.599710 25766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:08.623062 25766 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.623628 25766 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:08.611073 27324 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:08.626019 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:08.624423 25517 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.647785 25762 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:08.652678 27257 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:08.655413 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 150246us
I20260709 12:10:08.661360 25658 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:08.662705 27506 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.663020 27520 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.663249 27506 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:08.663538 27520 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.664234 27506 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.665165 27324 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.665925 27520 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.648559 25517 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 5, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.678577 25615 raft_consensus.cc:606] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:08.681262 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.618036 27558 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.701154 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.703047 25763 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:08.625273 27213 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:08.720340 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.709596 25517 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 3, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.728529 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:08.629505 27537 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.679870 27392 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:08.736641 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55721.5us
W20260709 12:10:08.741182 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.742478 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.735750 25517 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:08.746536 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 126484us
I20260709 12:10:08.749538 25613 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:08.754119 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:08.764890 25759 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:08.766351 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:08.768538 27567 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:08.769253 27567 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:08.770546 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.770458 27567 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.717509 26896 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:10:08.774331 25583 leader_election.cc:400] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5.
I20260709 12:10:08.795595 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:08.772442 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.843567 25583 leader_election.cc:403] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.747527 27423 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.774631 25517 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.854663 25517 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.856496 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.766700 25766 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.858282 25761 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:08.860261 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86131.9us
I20260709 12:10:08.811194 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:08.865340 25517 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.807106 27324 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:08.749145 27392 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.842072 27508 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:08.809638 27561 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:08.871156 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.775141 27557 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.875924 27449 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.881342 25517 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.877895 27508 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.877379 27392 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:08.865957 27213 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.886780 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.866510 27566 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5.
I20260709 12:10:08.869522 27520 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.895695 27508 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:08.873728 27423 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.893466 25517 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.903260 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.906899 25766 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:08.907686 25517 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.910158 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:08.910578 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.904006 25612 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:08.911501 25613 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:08.891261 27453 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.888073 27449 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.916074 25517 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:08.919256 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.906416 27423 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.920384 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:08.924219 25732 connection.cc:256] RPC call timeout handler was delayed by -1.7996211990000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 12:10:08.924762 27508 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:08.936416 25612 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:08.926924 27445 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:08.937714 27508 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:08.924468 27449 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:08.935971 25732 connection.cc:256] RPC call timeout handler was delayed by -1.5701211989999138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:10:08.936496 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.892658 27213 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.946578 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:08.947400 25618 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:08.948534 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:08.949160 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.949747 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:08.950417 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:08.950625 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.951746 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.951896 27213 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:08.952950 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.953239 27445 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:08.953724 25611 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:08.955152 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.954665 27445 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.955739 25612 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:08.946048 27449 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:08.941778 25732 connection.cc:256] RPC call timeout handler was delayed by -1.4765211989999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 12:10:08.959376 25732 connection.cc:256] RPC call timeout handler was delayed by -1.4720211989999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 12:10:08.959753 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1822211989999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 12:10:08.960427 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:08.961402 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:08.958771 27508 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:08.941468 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.963398 25613 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:08.975085 25610 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:08.980178 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:08.913537 27520 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:08.983692 25764 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
W20260709 12:10:08.985684 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.987758 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:08.988670 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.989727 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:08.992236 25761 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.992347 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:08.993680 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.034883 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.026118 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:08.994038 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:08.999835 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.036739 25617 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:09.030366 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 234908us
I20260709 12:10:09.003361 27213 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:09.022069 27498 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:09.061193 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 83897.5us
I20260709 12:10:09.005666 27537 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:09.058563 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.530s (SENT) [suppressed 29 similar messages]
I20260709 12:10:09.070073 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.071707 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.067606 26303 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:09.084543 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:09.085489 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.086279 25612 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:09.091218 27423 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.091708 27156 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:09.026305 26896 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:10:09.003082 27557 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:10:09.107499 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.054715 27566 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.094435 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.060482 27213 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.103358 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:09.056089 27578 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.108404 25614 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:09.079464 27498 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.114641 25765 raft_consensus.cc:2468] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
W20260709 12:10:09.144873 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.132552 27213 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:09.146983 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.119907 27577 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.136595 27308 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:09.170228 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 70132us
W20260709 12:10:09.170567 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 112347us
I20260709 12:10:09.138616 27580 raft_consensus.cc:2764] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:09.142809 27537 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.168574 27308 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:09.186476 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.191687 27308 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.193329 27308 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.194980 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:09.196485 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:09.197796 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:09.199182 27498 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.199846 27498 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.200578 27498 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:09.188225 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 129683us
W20260709 12:10:09.206563 27582 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:09.211730 27520 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.174602 27577 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.214798 27159 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:09.215466 27159 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:09.216499 27159 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.217831 27159 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:09.226572 27565 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.559s	user 0.004s	sys 0.001s
I20260709 12:10:09.141732 27578 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.227733 25761 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
W20260709 12:10:09.268342 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51995.6us
I20260709 12:10:09.227751 27520 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:09.285491 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.286231 25618 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:09.289278 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.290320 25618 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.290709 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.291499 25614 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:09.293869 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.294571 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.295253 25618 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
W20260709 12:10:09.300977 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.301168 27423 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:09.308751 27423 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.309192 27423 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.311364 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:09.311977 27578 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.312631 27578 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.313030 27578 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:09.302603 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.313375 27578 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.319340 27506 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:09.320061 27506 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.320672 27506 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:09.319512 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.332326 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:09.337306 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.338508 27392 raft_consensus.cc:2764] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:10:09.342072 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.305495 27449 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:09.340793 27577 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.348330 25610 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:09.305197 27508 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:09.353418 25610 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:09.348456 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff1240c7107404994c96234274c5e64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:09.356238 25612 raft_consensus.cc:606] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:09.327754 27520 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:10:09.361614 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:09.362317 25612 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:09.362694 25612 raft_consensus.cc:614] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.363277 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:09.365434 25610 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.366730 25610 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.375049 25610 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:09.375379 25767 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:09.380322 27392 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:09.381008 27392 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.381400 27392 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.384191 26334 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:09.377545 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:09.386610 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:09.360224 27577 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.361723 27449 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.389245 27470 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:09.393435 27470 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:09.395328 25762 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:10:09.391508 27453 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:09.406436 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:09.422555 27537 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.423759 26340 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.423429 27537 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.427812 27566 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.428676 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.429391 25612 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:09.432193 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.426157 27537 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.433423 27498 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.434191 27498 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.434718 27498 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.394444 27470 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.440127 27537 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.442149 27537 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.404888 27324 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:09.445688 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 68208.6us
I20260709 12:10:09.455646 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:09.389478 27213 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.462493 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:09.399290 27449 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.409192 27577 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.478420 27601 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.479775 27449 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.482084 25612 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.483497 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.484290 25612 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:09.485927 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.463243 27324 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:09.483421 27561 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.505906 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:09.507139 27601 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.508255 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:09.509328 27601 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:09.492961 25686 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.512684 25610 raft_consensus.cc:606] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:09.513123 25610 raft_consensus.cc:614] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.495879 27449 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:09.519124 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.519866 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.524341 27537 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.524997 27537 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.525099 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.525803 25612 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:09.525542 27537 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.527254 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.527637 27577 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.528220 27577 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:09.528599 27577 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.528944 27577 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.529207 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.529510 27392 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.531817 27392 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:09.492887 27589 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:09.542802 25762 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:09.521790 27449 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.555120 25768 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:09.557134 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:09.557824 25618 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.551446 27449 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.550205 27520 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.563812 25759 raft_consensus.cc:2955] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:09.555146 27600 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:09.577010 27213 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.577622 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:09.596668 25610 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:09.578035 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:09.586659 25762 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:09.555836 27601 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:09.600039 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:09.596289 27602 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:09.609685 27308 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.606638 27213 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.612232 27213 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.614121 27392 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.614403 27508 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:09.616047 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.615213 27392 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.561177 27324 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.618505 27607 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.619493 27537 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.615902 27508 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.619047 27607 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.624887 27607 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:09.627171 27508 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:09.628681 27566 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.632105 27566 raft_consensus.cc:993] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:09.596834 27520 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.632773 27566 raft_consensus.cc:1081] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:09.625141 27392 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:09.634579 27520 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.640480 25610 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:09.648847 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.649075 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.649626 25610 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:09.655714 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.659514 27213 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.660727 25618 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:09.666610 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.598652 27423 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:09.679747 27604 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:09.681605 27308 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.683795 27506 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.684266 27498 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.667739 27537 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:09.659562 27520 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.698081 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:09.698822 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.702654 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.724726 27601 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.725662 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ff1240c7107404994c96234274c5e64"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:09.726414 25764 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:09.726801 25764 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.727674 27423 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.701030 27520 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.728802 27520 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.729692 27537 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:09.730826 27537 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.732437 27610 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.732795 27498 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.732941 27610 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.733480 27498 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.733270 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.727689 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.737321 25615 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:09.737623 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:09.738125 25614 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.753957 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.756654 25765 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:09.757536 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.737270 27508 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:09.737155 27609 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:09.692627 27566 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:10:09.780323 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:09.708038 27466 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:10:09.791188 25614 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:09.757229 27506 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:09.753599 27561 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:09.734001 27498 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.769569 27578 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.819733 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:09.832582 27577 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.835420 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.835738 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.837424 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:09.837790 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:09.837667 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:09.838943 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.839838 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.840322 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.841396 25768 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:09.846686 27561 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.798723 27508 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:09.896080 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 76414.5us
W20260709 12:10:09.897356 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.898980 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:09.899346 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.899628 25610 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.786563 27609 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:09.919945 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81347.9us
I20260709 12:10:09.925799 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:09.926424 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:09.926996 25614 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.927100 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.930675 25610 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:09.932204 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:09.988158 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53503us
I20260709 12:10:09.987485 25764 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:09.994897 25759 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:09.997514 25732 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.508s (SENT)
I20260709 12:10:10.003835 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:09.998059 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:10.007406 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:10.028400 25614 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:10.032058 25767 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:09.923070 27618 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:09.986366 27576 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:10:10.045120 25764 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:10.048162 27612 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:10:10.002800 27423 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.043799 27606 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:10.057711 27537 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.055106 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:10:10.119633 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 102939us
W20260709 12:10:10.121701 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 124223us
I20260709 12:10:10.107486 25767 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:10.076357 26896 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.057358 27610 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:10.110659 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 178554us
I20260709 12:10:10.059089 27618 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:10.114341 27392 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.138088 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.141013 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:10.077605 27520 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:10.149207 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 154681us
I20260709 12:10:10.150053 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:10.153859 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:10.154340 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:10.154742 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.155133 25614 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.121224 27423 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.155550 25767 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
W20260709 12:10:10.169466 25657 connection.cc:256] RPC call timeout handler was delayed by -1.511625788000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:10:10.170542 25657 connection.cc:256] RPC call timeout handler was delayed by -1.2632257879999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 12:10:10.053934 27508 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.149235 27498 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.189060 25614 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:10.145314 27610 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:10.191731 27610 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.189888 27578 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:10.193598 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69818.4us
I20260709 12:10:10.195449 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.196063 25767 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:10.141342 26896 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.142501 27537 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.203088 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.203868 25767 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:10.210175 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:10.195264 27617 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.196379 27606 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:10.242697 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.208720 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.257607 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:10.226794 27159 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:10.240661 27619 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:10.262215 25614 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:10.264134 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.248329 27634 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:10.196784 27618 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.271766 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:10.272396 27620 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 12:10:10.275851 26896 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.278100 25686 raft_consensus.cc:2410] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:10.249079 27617 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:10.280679 27449 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.684s	user 0.002s	sys 0.010s
I20260709 12:10:10.281915 27159 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:10.282380 25610 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:10.283396 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.283330 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.250717 27610 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.284118 27634 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:10.284584 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.286862 25692 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:10.286036 27625 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:10:10.289710 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:10.289832 27601 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.292152 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.265450 27609 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:10.294724 27626 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:10:10.295863 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.295763 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.300985 25762 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:10.302239 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:10.304162 25732 leader_election.cc:336] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.809s (SENT)
I20260709 12:10:10.314409 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:10.315002 25610 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.306581 25694 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:10.309924 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.315989 25766 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:10.317687 25685 raft_consensus.cc:2410] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:10.320189 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.320700 25762 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:10.324003 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.327877 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:10.329936 27423 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.319268 27520 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.336412 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.321399 27601 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.337702 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.338482 25765 raft_consensus.cc:1217] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:10:10.338860 27601 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:10.339033 25765 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:10.305246 27449 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.341002 27449 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.343761 27449 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.344519 27634 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.344666 27449 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.352451 25692 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:10.353365 27159 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:10.343814 25610 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:10.358590 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.358039 27449 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.360018 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:10.360752 25764 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:10.361313 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.361984 25759 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:10.362891 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.364382 25759 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.367376 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:10.374357 25764 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:10.381199 27537 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.384639 27577 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.386587 27617 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.313792 27578 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.390699 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:10.392077 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:10.321209 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.399896 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:10.401454 25610 raft_consensus.cc:2410] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:10.405521 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:10.406632 25614 raft_consensus.cc:2410] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:10.409866 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:10.410806 25617 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.412753 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.413977 25767 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:10.431945 25694 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:10.297122 27606 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.393666 27578 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:10.330901 27610 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:10:10.428318 27601 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.430536 27577 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.444408 27578 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.465621 25617 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:10.456212 25686 raft_consensus.cc:2410] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:10.468418 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.469779 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.457329 27577 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:10.471020 27636 log.cc:927] Time spent T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:10:10.471663 27577 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.454349 27520 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.480794 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.386977 27572 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:10:10.488296 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 184201us
I20260709 12:10:10.499837 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.495436 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.515540 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.520308 25686 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:10.527630 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:10.546221 27622 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.373s	user 0.000s	sys 0.003s
I20260709 12:10:10.491991 27520 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.551776 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.554970 25690 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:10.560998 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.565665 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.567194 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.563127 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.599872 25691 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.600585 25690 raft_consensus.cc:2368] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6.
I20260709 12:10:10.601838 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.602746 25690 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:10.603627 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.604225 25690 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:10.605295 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.606325 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.606770 25690 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.609272 25686 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:10.610116 25691 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:10.612288 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.611014 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.613528 25686 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:10.653908 25686 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:10.654731 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.656303 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:10.672082 25691 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:10.683678 25690 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:10.662212 27506 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:10.693095 27506 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:10.694072 27506 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.696457 25688 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:10.684687 25689 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:10.692377 27520 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.702404 25692 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:10.703799 25692 pending_rounds.cc:85] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 1
I20260709 12:10:10.704126 25692 pending_rounds.cc:107] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:10.712191 27578 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.715992 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.716907 25685 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:10.717581 27445 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:10.704420 25692 raft_consensus.cc:2889] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:10.719621 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.717927 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.720386 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.738328 25686 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:10.738940 25691 raft_consensus.cc:2410] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:10.740015 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.740161 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.741201 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.741269 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.742015 25685 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:10.743140 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.744529 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.746316 25693 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:10.747061 25685 raft_consensus.cc:2393] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:10.748168 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.746023 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.749603 25691 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:10.750218 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.753526 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.760653 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:10.761229 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 109011us
I20260709 12:10:10.720506 27593 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.761654 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:10.769369 25732 leader_election.cc:336] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.897s (SENT)
I20260709 12:10:10.770005 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:10.774765 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.776525 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.778887 25691 raft_consensus.cc:2410] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:10.781513 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.781383 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.794231 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.795342 25686 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:10.766933 27593 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:10.791843 27159 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.821818 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:10.804565 27392 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.804497 27578 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:10.807545 27572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53278 (request call id 63) took 12129 ms. Trace:
W20260709 12:10:10.830672 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 61338.2us
I20260709 12:10:10.822434 27445 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.858431 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.822726 27159 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.896116 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.897234 25686 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:10.866400 27392 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.910732 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:10.912418 27665 log.cc:927] Time spent T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:10.903702 27508 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:10.914695 27308 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:10.915902 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.935645 25686 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:10.934474 25688 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:10.947580 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.948325 25759 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:10.956794 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:10.958573 27308 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:10.966672 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:10.958571 27508 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.862777 27445 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:10.995154 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:11.025038 25686 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.029371 27561 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.030068 27561 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.030571 27308 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:11.049177 25732 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.530s (SENT)
I20260709 12:10:11.049860 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.050886 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 126) took 1123 ms. Trace:
I20260709 12:10:11.051367 25687 rpcz_store.cc:276] 0709 12:10:09.924428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.924865 (+   437us) service_pool.cc:224] Handling call
0709 12:10:09.995767 (+ 70902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.039061 (+ 43294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.039113 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.684597 (+645484us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b2c00000448. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:10.685822 (+  1225us) log.cc:844] Serialized 508 byte log entry
0709 12:10:10.804673 (+118851us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:10.804710 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.804780 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.028504 (+223724us) raft_consensus.cc:1685] finished
0709 12:10:11.028533 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.047368 (+ 18835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9047936,"thread_start_us":118364,"threads_started":1,"wal-append.queue_time_us":174404}
I20260709 12:10:11.052217 27534 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:10.957624 27629 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.026299 26896 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.946918 27392 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.023176 27616 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.088081 25686 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
W20260709 12:10:11.095323 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.067593 27308 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:11.119836 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.120991 25688 raft_consensus.cc:2393] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:11.122313 25763 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:11.058698 27629 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:11.068768 26896 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.132647 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.070039 27616 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.142510 27159 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:11.147513 27668 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:10:11.149451 27392 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.151118 27392 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.151469 27629 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.152143 27392 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:11.152902 27392 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:11.154809 26340 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:11.157119 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.158499 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.159708 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.160750 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.161573 25688 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:11.162652 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.164816 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.167265 25688 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:11.168404 27616 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.169251 25688 raft_consensus.cc:1240] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:10.830402 27572 rpcz_store.cc:276] 0709 12:09:58.675802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.677780 (+  1978us) service_pool.cc:224] Handling call
0709 12:09:58.803814 (+126034us) log.cc:844] Serialized 508 byte log entry
0709 12:09:59.337866 (+534052us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b54004973a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cdbb26 00007fbdb2cd549a 00007fbdb2cd4714 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634
0709 12:10:10.778059 (+11440193us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1848,"mutex_wait_us":26442,"raft.queue_time_us":12071,"raft.run_cpu_time_us":10791,"raft.run_wall_time_us":352994,"spinlock_wait_cycles":3506560,"thread_start_us":51244,"threads_started":1,"wal-append.queue_time_us":123653,"wal-append.run_cpu_time_us":2535,"wal-append.run_wall_time_us":1047099}
I20260709 12:10:11.124385 27308 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.174088 25688 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:10:11.174847 25688 pending_rounds.cc:85] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 3
I20260709 12:10:11.175055 27308 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.175168 25688 pending_rounds.cc:107] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 12:10:11.183506 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 134370us
I20260709 12:10:11.139120 27508 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.176258 25688 raft_consensus.cc:2889] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:11.194708 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.196651 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.200552 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.204304 25688 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:11.205062 25688 pending_rounds.cc:85] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 3
I20260709 12:10:11.205296 25688 pending_rounds.cc:107] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:11.205547 25688 raft_consensus.cc:2889] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:11.203472 27470 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.212571 25688 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:11.213299 27572 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.214866 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.215940 25614 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:11.222877 25688 pending_rounds.cc:85] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 3
I20260709 12:10:11.226514 27392 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:11.227243 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:11.228590 25691 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:11.231276 27511 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.213830 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:11.242743 25688 pending_rounds.cc:107] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:11.264022 25688 raft_consensus.cc:2889] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:11.252177 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.254020 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.261662 25691 pending_rounds.cc:85] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 3
I20260709 12:10:11.237690 27593 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.264941 25617 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:11.265177 25618 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:11.264858 25691 pending_rounds.cc:107] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:11.266139 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.267170 25691 raft_consensus.cc:2889] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:11.267369 25688 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:10:11.268713 25688 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.270001 26304 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:11.271811 25688 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:11.273033 25611 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.273301 25688 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:11.275403 25688 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:11.276767 25688 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.264798 27685 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.245690 27470 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.296396 25612 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.272076 27593 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:11.287410 27679 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:10:11.260766 27572 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.311344 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.296118 27684 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.269256 27511 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.313614 27684 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.328001 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.329035 25610 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.309823 27520 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:11.305831 27685 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.332288 27520 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:11.341490 27470 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.342515 26896 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.344110 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.346858 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:11.348598 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.349728 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.350404 25764 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:11.352681 25613 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:11.367636 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.383047 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:11.383852 25732 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.785s (SENT)
I20260709 12:10:11.383888 25614 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:11.384475 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.393955 25763 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.369570 26896 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.396598 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:11.406741 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.407859 25611 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:10:11.419585 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.401067 27392 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.414990 27616 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.423365 27561 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.409238 27680 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:11.459345 25732 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.889s (SENT)
W20260709 12:10:11.459474 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 67725.1us
I20260709 12:10:11.459872 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:11.462723 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49531.5us
W20260709 12:10:11.461599 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48863.4us
I20260709 12:10:11.401932 26896 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.422658 27674 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:11.435348 27520 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:11.477928 25732 leader_election.cc:336] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.894s (SENT)
I20260709 12:10:11.478668 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.482304 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.483961 25688 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:11.457307 27392 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.482412 27561 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.472203 27674 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.458508 27616 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.494119 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.496234 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:11.501735 25688 raft_consensus.cc:2955] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:11.485898 27688 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.495481 27674 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.509786 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.511340 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.512430 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.512997 25686 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:11.509805 26896 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.513983 27561 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.514611 27561 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.515249 25657 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:11.516167 27537 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.516763 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:11.517112 27561 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.517658 27537 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.519016 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:11.519256 27392 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.506494 27508 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:11.504230 27678 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 12:10:11.523743 27667 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.627s	user 0.003s	sys 0.000s
I20260709 12:10:11.524999 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 883) took 1091 ms. Trace:
I20260709 12:10:11.525380 25694 rpcz_store.cc:276] 0709 12:10:10.433233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.680553 (+247320us) service_pool.cc:224] Handling call
0709 12:10:10.680985 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:10.682371 (+  1386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.682402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:10.719520 (+ 37118us) log.cc:844] Serialized 52 byte log entry
0709 12:10:10.822545 (+103025us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:10.822709 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.824193 (+  1484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.523207 (+699014us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:11.524636 (+  1429us) raft_consensus.cc:1685] finished
0709 12:10:11.524665 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.524932 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":783,"raft.queue_time_us":1417,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":14234,"spinlock_wait_cycles":4655872,"thread_start_us":102193,"threads_started":1,"wal-append.queue_time_us":176215}
I20260709 12:10:11.526697 27537 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.527516 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.528002 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b28e719d6586469e8c186ce7b5af6bc7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:10:11.528398 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.528738 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.532207 27616 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.547595 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.548524 25761 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.534117 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:11.535869 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.557312 25765 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.556871 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.558600 25760 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.559540 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.536247 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.562654 25759 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:11.537030 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.566627 25763 raft_consensus.cc:2410] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:11.499853 27638 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:11.537760 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.572855 25768 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.499027 27685 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.538151 27684 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:11.540458 25582 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:11.545789 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.533393 25694 raft_consensus.cc:2376] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:11.583537 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:11.578234 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.579620 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.584419 25694 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:11.580358 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.584437 25763 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.570971 25686 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:11.587535 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.590929 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:11.592450 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52073.5us
I20260709 12:10:11.593708 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.595184 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.594223 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.601235 25686 raft_consensus.cc:2393] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:11.590683 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 889) took 1121 ms. Trace:
I20260709 12:10:11.598043 25761 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:11.590587 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.607522 25583 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.607775 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.591153 25691 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.591437 25766 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:11.601614 25759 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:11.589637 25765 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:11.590927 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.608608 25761 raft_consensus.cc:2410] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:11.609614 25694 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.610111 25686 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.610004 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.611233 25764 raft_consensus.cc:2410] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:11.606580 25690 rpcz_store.cc:276] 0709 12:10:10.468781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.685201 (+216420us) service_pool.cc:224] Handling call
0709 12:10:10.703453 (+ 18252us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:10.705475 (+  2022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.705506 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:10.706482 (+   976us) log.cc:844] Serialized 52 byte log entry
0709 12:10:10.865213 (+158731us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:11.540297 (+675084us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b18003cbbc0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb67533c7 00007fbdb2d659a7 00007fbdb2d750bf
0709 12:10:11.540463 (+   166us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.540936 (+   473us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.544526 (+  3590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.544638 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.590436 (+ 45798us) raft_consensus.cc:1685] finished
0709 12:10:11.590457 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.590623 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30121,"prepare.queue_time_us":67510,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":16544,"raft.queue_time_us":15977,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":21054,"spinlock_wait_cycles":53340672,"thread_start_us":159254,"threads_started":2,"wal-append.queue_time_us":210239}
I20260709 12:10:11.613735 25766 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.616361 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.594480 27685 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.591212 27682 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:10:11.619938 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.630751 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:11.630905 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.632066 25760 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:11.632185 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.609124 27537 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.611086 27684 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.638370 25761 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.629685 27682 consensus_queue.cc:1243] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:11.642282 25767 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:11.642737 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 907) took 1136 ms. Trace:
I20260709 12:10:11.643097 25692 rpcz_store.cc:276] 0709 12:10:10.505931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.221404 (+715473us) service_pool.cc:224] Handling call
0709 12:10:11.221761 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.253644 (+ 31883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.253677 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.262478 (+  8801us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.498521 (+236043us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:11.503237 (+  4716us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.507338 (+  4101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.507413 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.642413 (+135000us) raft_consensus.cc:1685] finished
0709 12:10:11.642521 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.642675 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4336,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":13618,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":22731,"thread_start_us":216759,"threads_started":1,"wal-append.queue_time_us":357772}
I20260709 12:10:11.645370 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 893) took 1175 ms. Trace:
I20260709 12:10:11.645241 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:11.606745 27568 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:11.658037 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.645924 25689 rpcz_store.cc:276] 0709 12:10:10.469924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.702646 (+232722us) service_pool.cc:224] Handling call
0709 12:10:10.703080 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:10.704555 (+  1475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.704583 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:10.738235 (+ 33652us) log.cc:844] Serialized 52 byte log entry
0709 12:10:10.822290 (+ 84055us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:10.830021 (+  7731us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.832391 (+  2370us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.833197 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.833293 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:10.875727 (+ 42434us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b1800358900. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e522 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:11.218249 (+342522us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b1800358900. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafbe8c0a 00007fbdb9328219 00007fbdb6c2f58f 00007fbdafc6e571 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd
0709 12:10:11.641554 (+423305us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b1800358900. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:11.645136 (+  3582us) raft_consensus.cc:1685] finished
0709 12:10:11.645160 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.645309 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28194,"prepare.queue_time_us":147963,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":5537,"raft.queue_time_us":581,"raft.run_cpu_time_us":513,"raft.run_wall_time_us":29670,"spinlock_wait_cycles":56866176,"thread_start_us":39545,"threads_started":1,"wal-append.queue_time_us":137753}
I20260709 12:10:11.654690 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:11.630111 27470 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.672756 25617 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:11.670513 25691 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.670986 27534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37142 (request call id 1) took 2316 ms. Trace:
I20260709 12:10:11.654743 27568 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.675371 27589 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.646142 27688 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.683262 25611 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.672474 27578 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.682993 27568 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.680931 27534 rpcz_store.cc:276] 0709 12:10:09.310659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.310826 (+   167us) service_pool.cc:224] Handling call
0709 12:10:09.381979 (+ 71153us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54005dffa0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd8520 00007fbdb2d61b42 00007fbdb2d60800 00007fbdb2d599fa 00007fbdb7d214c9 00007fbdb129dc54 00007fbdb129dbe2 00007fbdb129db11 00007fbdb129da8c 00007fbdb129cd42
0709 12:10:09.398536 (+ 16557us) log.cc:844] Serialized 508 byte log entry
0709 12:10:09.531867 (+133331us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18000ab5e0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e522 00007fbdafc707c1
0709 12:10:11.625128 (+2093261us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3950,"mutex_wait_us":11,"raft.queue_time_us":254,"raft.run_cpu_time_us":1454,"raft.run_wall_time_us":1454,"spinlock_wait_cycles":44035456,"thread_start_us":50588,"threads_started":1,"wal-append.queue_time_us":142522,"wal-append.run_cpu_time_us":3123,"wal-append.run_wall_time_us":1137934}
I20260709 12:10:11.690831 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa0600a571a0457f804bf9bf88fd9fd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
W20260709 12:10:11.691707 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 78910.6us
I20260709 12:10:11.680194 27638 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:11.692488 27634 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.692951 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.694432 27616 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.695104 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.695600 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.695786 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:11.697194 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.680821 27466 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:11.700981 27634 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.702893 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.704263 25611 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:11.709321 27678 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.709539 25611 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:11.710544 27445 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:11.706290 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 107530us
I20260709 12:10:11.707096 25617 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:11.707245 27680 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.712387 27634 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:11.707892 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.716863 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.706337 25612 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.721192 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.723237 25768 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:11.726152 25611 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.726303 25765 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:11.720893 25614 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:11.724120 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.725432 27684 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.646485 27537 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.749275 27537 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.750882 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.667891 27674 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.755932 27674 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.760574 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.762102 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.768622 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.793429 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.189221 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:11.795413 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73068.7us
W20260709 12:10:11.733500 27663 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:11.803367 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.820837 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:11.788563 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 67517us
I20260709 12:10:11.824457 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.767513 27680 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:11.759003 27578 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.762722 27520 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.826364 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.844468 25768 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:11.827406 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.825472 25762 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:11.768774 27684 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.791460 27508 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.808800 25694 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.836767 25615 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:11.737586 27634 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:10:11.841795 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.757378 27568 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:11.848822 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.805526 27392 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:11.854205 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:11.771030 27616 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.797502 27537 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:11.849736 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:11.834465 27577 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.835062 27561 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.876435 25687 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:11.880275 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59553.7us
I20260709 12:10:11.883390 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1003) took 1010 ms. Trace:
I20260709 12:10:11.883750 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.883785 25687 rpcz_store.cc:276] 0709 12:10:10.872765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.818845 (+946080us) service_pool.cc:224] Handling call
0709 12:10:11.883323 (+ 64478us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:11.881095 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.891163 25763 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:11.892567 25766 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:11.913816 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:11.914536 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 91464.6us
I20260709 12:10:11.915795 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.876231 27578 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:11.919303 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 181312us
I20260709 12:10:11.919845 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.879501 27680 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:11.882872 27561 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:11.895700 27678 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.932478 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.908208 27616 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.946162 27703 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.946496 27681 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.946322 27704 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:10:11.947372 27704 consensus_queue.cc:1243] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:11.946990 27703 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.947929 27704 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:11.948297 27704 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:11.948323 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.949431 27520 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:11.949743 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.951889 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:11.918839 27508 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:11.958011 27634 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.958863 27634 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:11.960486 27634 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:11.925611 27308 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:11.961822 27634 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:11.961853 27308 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.962496 27634 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.965402 27634 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:11.965726 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:11.938511 27561 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.967550 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:11.978546 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 293000us
W20260709 12:10:11.982908 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 97955.5us
I20260709 12:10:11.986505 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:12.058113 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71669.2us
I20260709 12:10:12.059954 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:12.061458 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:11.930423 27578 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:11.972384 27308 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.067250 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:12.071563 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 87471.1us
I20260709 12:10:12.067721 27616 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.081768 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:11.982431 27508 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.064987 27681 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.093531 27711 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.094236 27632 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.094357 27711 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.095351 27708 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:12.069746 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 117936us
I20260709 12:10:12.067960 27709 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:11.935818 27680 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.083840 27684 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:12.085314 27308 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:12.124388 27466 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.125941 27308 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:12.126241 27707 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:12.127532 27711 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.127925 27705 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:10:12.075995 27674 consensus_queue.cc:1059] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:12.100126 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.092813 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:12.132243 25767 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:12.134456 27308 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.128916 27566 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:12.134596 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:12.141619 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.120929 27684 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.142692 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:12.097609 27453 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:12.144469 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:12.144896 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.145576 25760 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.143478 27616 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:12.146410 27713 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.142064 27709 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:12.147219 27709 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.143086 27708 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:12.147521 27711 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.147814 27712 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:12.147562 27709 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.149835 27718 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:12.150285 25657 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.151222 27718 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:12.153074 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.153264 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1006) took 1279 ms. Trace:
I20260709 12:10:12.153848 27718 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.154418 25760 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.155807 27700 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.155879 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.156140 27700 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:12.156706 27718 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.157111 27700 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.158231 27718 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:12.160125 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.162513 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.153681 25691 rpcz_store.cc:276] 0709 12:10:10.873695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.291748 (+418053us) service_pool.cc:224] Handling call
0709 12:10:11.591018 (+299270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.676394 (+ 85376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.153072 (+476678us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400266450. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:12.153204 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687591296}
I20260709 12:10:12.139161 27681 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.140237 27707 raft_consensus.cc:3055] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:12.171092 27685 consensus_meta.cc:287] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.003s
I20260709 12:10:12.162714 27684 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:12.174350 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.144678 27568 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.177268 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.166332 27718 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.178911 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.169390 27617 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.180619 27634 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.177428 27685 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.145843 27701 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:12.185302 27709 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.186139 27680 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.186561 27706 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:12.187390 27578 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.177914 27711 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:12.188856 27508 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.188320 27709 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.193120 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.173309 27700 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.198439 27711 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.174942 27707 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:12.206785 27707 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.208524 27684 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.210148 27707 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.221185 27684 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.222586 27561 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.223722 25764 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.232620 25764 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.235996 27561 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.240747 27511 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.286669 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.290181 27572 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.295493 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.296288 25618 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:12.305074 27589 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.305763 27589 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.312247 27704 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.313743 27704 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.319660 27589 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:12.328150 27589 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.331847 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:12.332619 25618 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.384238 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 967) took 1170 ms. Trace:
I20260709 12:10:12.384891 25615 rpcz_store.cc:276] 0709 12:10:11.213446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.213559 (+   113us) service_pool.cc:224] Handling call
0709 12:10:12.350204 (+1136645us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540021cd54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:12.384134 (+ 33930us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075763072}
I20260709 12:10:12.386934 27577 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.387562 27577 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.393975 27703 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.421342 27682 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.421957 27682 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:12.422959 27682 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.431442 27682 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.439375 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 898) took 1968 ms. Trace:
I20260709 12:10:12.439570 27577 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.449297 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.450663 25685 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:12.452663 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:12.453301 25617 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:12.439971 25693 rpcz_store.cc:276] 0709 12:10:10.471322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.782638 (+311316us) service_pool.cc:224] Handling call
0709 12:10:10.803783 (+ 21145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.807156 (+  3373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.807190 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.821602 (+ 14412us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.124860 (+303258us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:11.140012 (+ 15152us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.236486 (+ 96474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.236604 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.293876 (+1057272us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18000f8ec0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:12.438929 (+145053us) raft_consensus.cc:1685] finished
0709 12:10:12.439071 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.439288 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100251,"prepare.queue_time_us":52029,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":1325,"raft.queue_time_us":96710,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":6502,"spinlock_wait_cycles":7980928,"thread_start_us":259506,"threads_started":1,"wal-append.queue_time_us":355240}
I20260709 12:10:12.461748 25685 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:12.464359 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1008) took 1590 ms. Trace:
I20260709 12:10:12.464861 25685 rpcz_store.cc:276] 0709 12:10:10.874252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.336164 (+461912us) service_pool.cc:224] Handling call
0709 12:10:12.450518 (+1114354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.462360 (+ 11842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.464123 (+  1763us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400267350. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:12.464289 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562043776}
W20260709 12:10:12.469492 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.470173 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:12.472810 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:12.502074 25615 raft_consensus.cc:2368] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:12.502213 25619 raft_consensus.cc:2376] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5. Re-sending same reply.
I20260709 12:10:12.476207 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.517648 25618 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
W20260709 12:10:12.502517 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.509968 25617 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:12.527536 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.528311 25693 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.532666 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:12.533735 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 339128us
I20260709 12:10:12.535147 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.536514 27718 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:12.537530 27718 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:12.538451 27718 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:12.539112 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.540002 27718 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:12.540686 27718 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:12.540963 27711 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:12.544829 27711 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:12.548303 25693 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
I20260709 12:10:12.550001 27711 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:12.551079 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.552525 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.556206 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.558434 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.560050 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.563396 25582 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:12.565153 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:12.565291 25583 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.533s (SENT)
I20260709 12:10:12.565755 27682 raft_consensus.cc:2764] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:12.566859 27682 raft_consensus.cc:2764] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:12.569017 25691 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.571110 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.572379 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.573036 25688 raft_consensus.cc:2376] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6. Re-sending same reply.
I20260709 12:10:12.575194 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.575819 25688 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:12.576222 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.576882 25691 raft_consensus.cc:2376] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4. Re-sending same reply.
I20260709 12:10:12.577275 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.577344 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.579207 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.579704 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.579958 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.580315 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.580329 25687 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:12.581719 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.582218 25687 raft_consensus.cc:2376] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5. Re-sending same reply.
I20260709 12:10:12.582325 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.583142 25582 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:12.584558 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.584811 27511 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:12.585263 25688 raft_consensus.cc:2368] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5.
I20260709 12:10:12.585331 27511 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:12.586668 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.586470 27511 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.589484 25691 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.589561 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.590772 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.591437 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.593242 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.593884 25694 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.595896 25694 pending_rounds.cc:85] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 1
I20260709 12:10:12.596258 25694 pending_rounds.cc:107] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:10:12.596582 25694 raft_consensus.cc:2889] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:12.600685 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:12.603067 25687 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.604404 27159 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.604807 27159 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:12.605423 27159 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.605687 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:12.607267 27721 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:12.608009 27721 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:12.608513 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.609254 27721 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.612385 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:12.603695 25693 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:12.616855 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.626690 25687 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.635809 25687 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.636858 26340 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.639590 27561 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.640321 27561 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.644918 27561 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.645655 27561 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.646237 27561 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.647370 27713 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.648213 27684 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:12.648520 27561 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.648779 27684 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.651131 27684 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.647969 27713 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.651177 27159 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.659476 27713 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:12.663430 27721 consensus_queue.cc:1059] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:12.664671 27721 raft_consensus.cc:3055] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.665350 27721 raft_consensus.cc:740] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:12.666577 27721 consensus_queue.cc:260] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:12.667870 27721 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.675846 27159 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.677037 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:12.684808 25764 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.694298 25764 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:12.678056 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.683207 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.695652 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:12.696456 26896 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.696907 26896 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:12.699405 27453 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.698654 26896 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:12.712598 25583 leader_election.cc:336] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.573s (SENT)
I20260709 12:10:12.713157 25583 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:12.713418 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.714053 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:12.716681 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.717379 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.724414 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:12.725234 25693 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.722837 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:12.729038 25692 raft_consensus.cc:1240] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:10:12.730284 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.731223 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:12.699900 27453 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:12.697788 27506 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:12.733029 27537 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:12.748725 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:12.769271 25583 leader_election.cc:336] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.624s (SENT)
I20260709 12:10:12.770296 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:12.771380 27445 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:12.771600 25583 leader_election.cc:336] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.629s (SENT)
I20260709 12:10:12.772135 27453 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:12.773264 25583 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.630s (SENT)
I20260709 12:10:12.773820 25583 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:12.775161 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:12.789104 25583 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.648s (SENT)
I20260709 12:10:12.789695 25583 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:12.742699 27703 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.760031 27572 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:12.807341 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:12.737833 27577 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:10:12.808296 25692 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:12.812033 26304 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:12.819849 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.830297 25685 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:12.830790 25685 pending_rounds.cc:85] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 2
I20260709 12:10:12.831019 25685 pending_rounds.cc:107] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:12.831243 25685 raft_consensus.cc:2889] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:12.832743 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.833330 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.833509 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.833989 25761 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:12.834628 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.838126 25759 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:12.831385 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:12.802390 27702 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.843112 25767 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:10:12.844902 25763 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:10:12.845043 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 56001.5us
W20260709 12:10:12.845927 25583 leader_election.cc:336] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.659s (SENT)
I20260709 12:10:12.817752 25693 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:12.847563 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:12.849716 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 126983us
I20260709 12:10:12.809638 27703 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:12.844350 27704 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:12.906121 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54823.1us
I20260709 12:10:12.914942 25761 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.902555 27704 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:12.945837 27730 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:10:12.989513 27728 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:10:12.996559 27737 log.cc:927] Time spent T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:10:13.004984 27704 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:12.978461 27382 raft_consensus.cc:2804] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.007222 27382 raft_consensus.cc:697] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:13.008239 27382 consensus_queue.cc:237] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:12.954444 27703 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.047159 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.049134 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.050158 27561 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.050724 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.055178 27453 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.053714 25732 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.061224 27684 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:13.074149 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 164957us
I20260709 12:10:13.069609 25657 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:13.078845 27709 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:13.078939 27561 raft_consensus.cc:3060] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.080900 27684 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:13.082590 27709 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:13.083691 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:13.084501 27709 raft_consensus.cc:2764] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:13.084766 27749 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.078248 27685 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:13.086799 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.087467 25689 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:13.088819 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.089457 25689 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:13.090943 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.092605 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.093232 25689 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:13.093221 25732 leader_election.cc:400] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:13.093930 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.094483 25732 leader_election.cc:403] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:13.096131 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.097262 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.100194 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:13.100564 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.099438 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.102463 25615 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.102813 25618 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:13.105305 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.105698 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.106561 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:13.107488 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.108593 25685 raft_consensus.cc:2410] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:13.110152 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:13.111989 25610 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:10:13.109607 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:13.113278 25686 raft_consensus.cc:2376] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:13.119656 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.121584 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:13.122234 25690 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:13.122992 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.124748 27704 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:13.126157 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:13.127771 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.127395 27762 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:13.142704 27762 consensus_queue.cc:1243] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:13.142940 27709 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:13.147298 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:13.148468 25685 raft_consensus.cc:2368] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:13.152598 25692 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:13.156474 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.134325 27392 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.160725 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:13.161964 25694 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:13.162621 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.164697 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.165776 25685 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:13.172780 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51145.9us
I20260709 12:10:13.185756 25759 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:13.186132 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:13.187681 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.189182 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.189299 25690 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:13.190605 27768 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.191111 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.192749 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.194561 27561 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.189229 27506 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.197208 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:13.198168 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 105633us
I20260709 12:10:13.198939 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.200345 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:13.201053 27759 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:13.201246 27561 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.201531 27759 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:13.201992 27759 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:13.205657 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.212218 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:13.214381 27506 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.215876 27762 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:13.216610 27762 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:13.217466 27762 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:13.217808 27762 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:13.218521 27709 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:13.218824 27688 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:13.219129 27709 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:13.198727 27749 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.218513 27561 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:13.219931 27768 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:13.222290 27711 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:13.246654 27445 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:13.277130 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58069.5us
I20260709 12:10:13.278029 27445 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.295478 27445 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:13.319404 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.291172 27688 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:13.329633 27704 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:13.330152 27704 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:13.331072 27704 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:13.335374 27776 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:13.339368 27704 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.239117 27762 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.363950 27688 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:13.360677 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 74621.9us
I20260709 12:10:13.366076 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.366791 27678 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:13.367553 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.367411 27678 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.323305 27561 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.317641 27709 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.388828 27466 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.390110 27466 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:13.393034 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 171795us
I20260709 12:10:13.375545 27678 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:13.370577 27756 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:13.392416 27466 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:13.394922 27759 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.429003 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:13.414111 27392 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:13.431936 27392 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.407001 27678 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:13.468549 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:13.471771 25767 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:13.481182 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:13.481086 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.440160 27678 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.472836 27715 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:13.492003 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:13.492728 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.509853 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:13.509994 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:13.528249 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:13.511315 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:13.532240 25618 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:13.492012 27688 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.510990 27700 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.616264 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 248775us
I20260709 12:10:13.542317 27392 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:13.620957 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:13.537106 27709 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.511081 27783 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.542491 27688 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:13.705346 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:13.708158 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.513491 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08001654e0 after lost signal to thread 24445
I20260709 12:10:13.528936 27715 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:13.625294 27506 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
W20260709 12:10:13.794332 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 173474us
I20260709 12:10:13.717805 27688 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.696934 27700 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.803459 25763 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:13.804157 25583 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.005s	sys 0.006s
W20260709 12:10:13.806565 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45492.4us
I20260709 12:10:13.798815 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:13.810628 27744 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:10:13.714555 27709 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:13.790616 27777 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:13.837153 25583 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.005s	sys 0.006s
W20260709 12:10:13.837568 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 989701us
W20260709 12:10:13.818801 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800169b80 after lost signal to thread 25551
W20260709 12:10:13.835717 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73948.9us
I20260709 12:10:13.818353 27759 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:13.878082 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:13.893759 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45855.8us
W20260709 12:10:13.871659 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72308.3us
I20260709 12:10:13.833485 27793 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:13.897822 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.901640 27470 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:13.887223 27684 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:13.914043 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:13.896299 27537 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.845224 27777 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:13.918105 25715 debug-util.cc:398] Leaking SignalData structure 0x7b080034fda0 after lost signal to thread 25643
I20260709 12:10:13.899900 27793 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:14.004622 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800397660 after lost signal to thread 25644
W20260709 12:10:14.025060 27796 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 12:10:13.916616 27678 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.015727 27713 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.006533 27715 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:14.063221 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 185250us
I20260709 12:10:14.074913 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.016343 27793 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.006510 27684 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.009547 27537 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:14.080641 27797 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 12:10:14.056993 27678 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:14.089733 27794 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:10:14.102713 27713 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.142589 27751 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.143319 27751 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.145910 27751 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.147568 27777 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.149430 27700 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.151428 27684 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:14.153579 27704 consensus_meta.cc:287] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.790s	user 0.015s	sys 0.000s
I20260709 12:10:14.164605 27749 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.170542 27709 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.110646 27759 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:14.120277 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab540 after lost signal to thread 25718
I20260709 12:10:14.122561 27537 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:14.198029 27795 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.403s	user 0.000s	sys 0.004s
W20260709 12:10:14.209295 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800336f20 after lost signal to thread 25719
I20260709 12:10:14.211028 27466 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.185906 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 111102us
I20260709 12:10:14.195394 27715 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.249717 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.253583 25611 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:14.217424 27537 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.258935 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.259670 25611 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:14.240338 27704 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.211362 27759 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:14.271353 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.247339 27785 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.247946 27751 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.252995 27520 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.274523 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.277995 27520 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.279338 27718 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.279911 27718 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.280347 27718 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.280575 27520 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.263202 27537 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.285132 27537 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.276265 27759 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:14.277336 27818 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.288312 27818 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.288691 27818 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.257264 27466 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:14.289043 27785 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.290999 27466 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:14.291406 27785 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:14.286162 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800123280 after lost signal to thread 25792
W20260709 12:10:14.294723 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa840 after lost signal to thread 25793
I20260709 12:10:14.209883 27749 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.275638 27704 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.299574 27749 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.285912 27751 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:14.296202 25715 debug-util.cc:398] Leaking SignalData structure 0x7b080033fc60 after lost signal to thread 26364
W20260709 12:10:14.302832 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08003810c0 after lost signal to thread 26365
I20260709 12:10:14.250535 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.310709 27793 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:14.313913 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.315316 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.316094 25611 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:14.317672 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.319245 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.319386 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.320591 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.323578 25658 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.324877 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.335843 27762 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.330191 27704 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:14.341509 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 91085.6us
W20260709 12:10:14.345430 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 431469us
I20260709 12:10:14.346755 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:14.348495 26303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.016s
W20260709 12:10:14.349069 26303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.016s
I20260709 12:10:14.332244 27812 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.357324 27812 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.359475 27812 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.329906 27751 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.357918 27821 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.355376 27445 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.373154 27821 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:14.376610 25657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.011s
W20260709 12:10:14.377060 25657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.006s	sys 0.011s
I20260709 12:10:14.400197 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:14.361706 27718 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.441270 27709 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.449517 27709 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.450896 27718 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.451810 27709 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.378803 27821 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.456307 27821 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:14.456954 26305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.040s	sys 0.075s
W20260709 12:10:14.457335 26305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.040s	sys 0.075s
W20260709 12:10:14.458520 25731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.024s	sys 0.048s
W20260709 12:10:14.458846 25731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.024s	sys 0.048s
I20260709 12:10:14.462365 27804 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.462857 27709 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.463507 27709 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.463255 27804 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.415699 27793 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.465880 27709 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.466758 27804 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.466571 27793 raft_consensus.cc:476] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:14.469223 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.471107 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:14.471949 25619 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.395192 27787 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.385017 27392 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.376291 27802 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:14.374694 27688 consensus_meta.cc:287] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.006s
I20260709 12:10:14.473496 27787 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:14.490741 25582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.018s	sys 0.044s
W20260709 12:10:14.491144 25582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.018s	sys 0.044s
W20260709 12:10:14.491521 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 579933us
W20260709 12:10:14.473052 25610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.004s	sys 0.013s
W20260709 12:10:14.483059 25659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.034s	sys 0.087s
W20260709 12:10:14.496052 25659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.034s	sys 0.087s
W20260709 12:10:14.497640 25610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.005s	sys 0.013s
W20260709 12:10:14.484539 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 137805us
I20260709 12:10:14.503798 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.506712 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.507452 25765 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:14.507746 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.508657 25764 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:10:14.474797 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 131052us
I20260709 12:10:14.514626 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.517096 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.486011 27392 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.519490 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.523744 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.523031 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1094) took 1090 ms. Trace:
I20260709 12:10:14.525910 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.527763 25765 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:14.527913 25761 rpcz_store.cc:276] 0709 12:10:13.427851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.428018 (+   167us) service_pool.cc:224] Handling call
0709 12:10:13.428487 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.537504 (+109017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.537538 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.537588 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:13.537620 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.517933 (+980313us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400165654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:14.517984 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.518111 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249878272}
I20260709 12:10:14.533150 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.533703 25732 leader_election.cc:400] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:14.533864 25765 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:14.537195 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 957) took 1826 ms. Trace:
I20260709 12:10:14.539628 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.488185 27802 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.537703 25691 rpcz_store.cc:276] 0709 12:10:12.710549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.996423 (+285874us) service_pool.cc:224] Handling call
0709 12:10:12.996815 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.997172 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.997203 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.501121 (+503918us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b2c00000448. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:13.501685 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:10:13.844570 (+342885us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:13.876273 (+ 31703us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.888490 (+ 12217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.888570 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.525426 (+636856us) raft_consensus.cc:1685] finished
0709 12:10:14.536932 (+ 11506us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.537117 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52631,"prepare.queue_time_us":31290,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":160139,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":14369,"spinlock_wait_cycles":51791104,"thread_start_us":224990,"threads_started":1,"wal-append.queue_time_us":945719}
I20260709 12:10:14.546147 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.518328 27593 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:10:14.530294 27678 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.550390 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.550064 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:14.553960 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.556967 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.551306 25761 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:14.526868 27828 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.517535 27688 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.544704 27778 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:14.541522 27821 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:14.590867 27821 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:14.580698 27791 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:10:14.581255 27790 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.598582 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.536554 27818 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.585601 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1053) took 1016 ms. Trace:
I20260709 12:10:14.580323 27802 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.588280 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1322) took 1040 ms. Trace:
I20260709 12:10:14.580296 27829 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.594494 25760 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.624073 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:14.596333 25691 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:14.562582 27804 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.573216 27718 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.582477 27445 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:14.575716 27751 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.603780 25516 catalog_manager.cc:5697] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:14.592670 27787 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.599352 25762 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:14.616328 25619 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:14.607997 25688 rpcz_store.cc:276] 0709 12:10:13.568914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.706484 (+137570us) service_pool.cc:224] Handling call
0709 12:10:13.755334 (+ 48850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.036217 (+280883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.036271 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.036889 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.487792 (+450903us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:14.487849 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.487966 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.585361 (+ 97395us) raft_consensus.cc:1685] finished
0709 12:10:14.585386 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.585536 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83691,"raft.queue_time_us":151292,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2661,"thread_start_us":667566,"threads_started":2,"wal-append.queue_time_us":525639}
I20260709 12:10:14.621838 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:14.600863 27752 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:14.627506 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 70640.3us
I20260709 12:10:14.638743 25583 leader_election.cc:400] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5.
I20260709 12:10:14.633244 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:14.639878 27800 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.639808 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:14.640571 27800 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.640856 27750 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:14.640945 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:14.641423 27750 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.641847 27750 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.642313 25657 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:14.631068 27829 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.643586 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:14.639755 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.633909 27718 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.645463 27593 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.645896 25583 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.646360 27704 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.647156 25583 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.647959 27682 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.648022 27821 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:14.648527 27688 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.648821 27682 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.648229 27831 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:14.650198 25583 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:14.639786 27732 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.631690 27820 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.595371 27778 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:14.651660 27732 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.652943 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:14.653487 27703 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.654357 27703 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:14.654716 27703 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.654932 27778 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:14.655107 27703 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.624188 27466 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:14.633909 27804 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.656353 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:14.662420 27803 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.662613 27783 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.663094 27803 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.663689 27812 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.664687 27520 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.665169 27520 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.664019 27537 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.667622 27537 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.666736 27752 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.663183 27783 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.671095 27392 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:14.619344 25759 rpcz_store.cc:276] 0709 12:10:13.548010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.619469 (+ 71459us) service_pool.cc:224] Handling call
0709 12:10:13.698102 (+ 78633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.901990 (+203888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.902031 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.902580 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.236353 (+333773us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:14.236737 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.236959 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.359685 (+122726us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b1800361fc0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:14.587971 (+228286us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540031a1d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:14.588029 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.588075 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:14.588087 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.588220 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24040,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":145703,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":33687,"spinlock_wait_cycles":428427392,"thread_start_us":333421,"threads_started":1,"wal-append.queue_time_us":557366}
I20260709 12:10:14.637876 27751 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.673859 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:14.675418 25516 catalog_manager.cc:5697] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:14.676756 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.681993 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.677917 25516 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 1 to 3, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 3 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:14.688412 27749 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.698798 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.698930 27749 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.699368 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.699621 25690 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:14.701200 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.702028 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.708998 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:14.781127 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.781764 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.706107 25765 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:14.707075 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.783802 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.784137 25693 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:14.680687 27682 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:14.713403 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.727756 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.747202 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:14.778656 25690 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:14.790083 27815 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.790302 27392 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:14.790721 27759 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.790812 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.707214 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:14.733296 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.791754 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:14.712062 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.792212 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.792820 25685 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:14.793483 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.793694 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:14.794328 25685 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:14.791142 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 88398.5us
I20260709 12:10:14.788296 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:14.796933 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 49840.8us
I20260709 12:10:14.797536 25766 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.702095 25614 raft_consensus.cc:2410] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:14.706933 25613 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:14.741894 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:14.802047 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1107) took 1041 ms. Trace:
I20260709 12:10:14.707280 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.703038 27802 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.730635 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.787088 25687 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:14.796595 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.798784 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:14.782578 25691 raft_consensus.cc:2368] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:14.706681 27707 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:14.807478 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.810993 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.802685 25760 rpcz_store.cc:276] 0709 12:10:13.760845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.761008 (+   163us) service_pool.cc:224] Handling call
0709 12:10:13.805162 (+ 44154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.623879 (+818717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.801805 (+177926us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54003fe154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:14.801987 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814799232}
I20260709 12:10:14.803936 25619 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.806875 27820 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.807973 27815 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:14.818497 27808 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:14.819183 27808 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:14.819530 27815 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.818485 27793 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:14.827731 25613 raft_consensus.cc:1275] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:14.805411 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:14.803090 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 61322.5us
I20260709 12:10:14.786388 27762 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.829962 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.833494 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.702536 27827 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.714501 27832 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:14.716502 27751 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.834666 27805 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.835124 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:14.835660 27801 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.834151 27808 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:14.838827 27445 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.689456 27790 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:14.795948 27704 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.794526 27682 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:14.810783 27466 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.847856 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:14.823251 27392 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.791254 27759 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.822535 27800 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.810113 27750 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.832695 27820 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:14.886574 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.906692 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.907011 25694 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.884028 27682 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.908151 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.898026 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.859947 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.845186 27762 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.909272 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.888852 27709 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:14.888275 27466 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:14.856680 27805 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.893055 27392 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.917384 27688 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:14.921029 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:14.884658 27704 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.891052 27751 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.945178 25690 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:14.926352 27802 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.942898 27688 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.918061 27808 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.925562 27466 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.951185 27800 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.955421 27688 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:14.890707 27790 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:14.926295 27561 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.954030 27802 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.941095 27392 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.954324 27709 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.960214 27808 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.983999 27828 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.992923 27802 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.014307 27804 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:14.919903 27820 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:14.857424 27832 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:15.003765 27803 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.015967 27678 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.029336 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:14.990029 27800 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.005882 27793 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:14.991312 27561 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.017638 27808 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.977602 27751 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.002882 27709 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.057010 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:15.014387 27828 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:15.060784 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 246522us
W20260709 12:10:15.069242 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 232341us
I20260709 12:10:15.043733 27561 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.040911 27778 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.012279 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.091501 25614 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.044157 27752 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.101159 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.035262 27678 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.068813 27709 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:15.106976 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50108.9us
I20260709 12:10:15.043973 27793 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.115305 25694 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:15.069734 27783 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.109499 25688 raft_consensus.cc:2955] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:15.095846 27718 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.093410 27819 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:15.109253 27759 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:15.130438 27839 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:10:15.132745 27750 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.133914 27787 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:15.171177 27678 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.172241 27762 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.161788 27520 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.173260 27790 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:15.174134 27829 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.175706 27793 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.176015 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:15.174147 27805 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.178326 27820 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.177253 27800 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.181190 27832 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:15.183609 27828 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.184991 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:15.189422 25516 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 3 to 5, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 3 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:15.193202 27749 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.193924 27688 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:15.194883 27838 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:15.196357 27688 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.125466 25619 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:15.103641 27778 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.210847 27787 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.220073 27537 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.211766 27823 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:15.223906 27818 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.221151 27787 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.143173 27783 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:10:15.229719 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 284766us
I20260709 12:10:15.245505 25766 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
W20260709 12:10:15.248680 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 178664us
W20260709 12:10:15.276247 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 180626us
W20260709 12:10:15.276978 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 186069us
I20260709 12:10:15.279528 27732 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:15.291494 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 173913us
W20260709 12:10:15.305260 27703 consensus_meta.cc:287] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.001s
W20260709 12:10:15.306629 25517 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 177) took 11678 ms (client timeout 15000 ms). Trace:
I20260709 12:10:15.286044 27842 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:15.310067 27751 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.314543 27709 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.318562 27709 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.308955 25614 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
W20260709 12:10:15.322871 25517 rpcz_store.cc:269] 0709 12:10:03.726222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.726692 (+   470us) service_pool.cc:224] Handling call
0709 12:10:15.289306 (+11562614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.318670 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.319434 (+   764us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.319494 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:10:09.319520 (+    26us) tablet.cc:662] Decoding operations
0709 12:10:09.399589 (+ 80069us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.421598 (+ 22009us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.443732 (+ 22134us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:10:09.474090 (+ 30358us) tablet.cc:701] Row locks acquired
0709 12:10:09.474144 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:10:09.474357 (+   213us) write_op.cc:270] Start()
0709 12:10:09.474536 (+   179us) write_op.cc:276] Timestamp: P: 1783599009474280 usec, L: 0
0709 12:10:09.474576 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.492540 (+ 17964us) log.cc:844] Serialized 8364 byte log entry
0709 12:10:10.138694 (+646154us) op_driver.cc:464] REPLICATION: finished
0709 12:10:10.311543 (+172849us) write_op.cc:301] APPLY: starting
0709 12:10:10.322817 (+ 11274us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:10.382363 (+ 59546us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:10.382539 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.385146 (+  2607us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.385593 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:10:10.385664 (+    71us) write_op.cc:312] APPLY: finished
0709 12:10:10.386246 (+   582us) log.cc:844] Serialized 144 byte log entry
0709 12:10:10.428111 (+ 41865us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.443330 (+ 15219us) write_op.cc:454] Released schema lock
0709 12:10:10.455612 (+ 12282us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.490218 (+ 34606us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.492670 (+  2452us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1005309,"reported_tablets":44,"spinlock_wait_cycles":46208,"child_traces":[["op",{"apply.queue_time_us":151676,"apply.run_cpu_time_us":6381,"apply.run_wall_time_us":173391,"num_ops":21,"prepare.queue_time_us":153055,"prepare.run_cpu_time_us":66259,"prepare.run_wall_time_us":353553,"raft.queue_time_us":53694,"raft.run_cpu_time_us":40652,"raft.run_wall_time_us":105679,"replication_time_us":663944,"thread_start_us":409435,"threads_started":4,"wal-append.queue_time_us":273212,"wal-append.run_cpu_time_us":12688,"wal-append.run_wall_time_us":1694635}]]}
I20260709 12:10:15.368227 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.370035 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.371615 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.374572 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.375241 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.375569 25610 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:15.378005 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.384267 27803 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:15.385079 27803 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.384312 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.353333 27561 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.392318 27561 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:15.355249 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67729.4us
I20260709 12:10:15.399418 25732 leader_election.cc:400] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:15.399943 25732 leader_election.cc:403] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.405918 27803 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:15.407266 27849 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:10:15.409647 27841 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 12:10:15.409721 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.410905 25613 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:15.326193 27703 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.413784 27709 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.413920 25689 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:15.418226 27703 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.423125 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.427711 25613 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:15.420899 25689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:15.429003 25689 raft_consensus.cc:606] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:15.429364 27704 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.422796 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.363373 27749 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.434242 27749 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.437250 27749 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.373265 27682 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.444279 27682 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.455214 27808 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.456849 27812 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.473673 27812 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.477583 27808 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.465579 27470 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:15.471359 27818 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:15.406131 27778 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:15.464249 27848 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:10:15.419624 27561 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
W20260709 12:10:15.485778 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 207935us
I20260709 12:10:15.508496 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:15.508886 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.492614 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.509115 25765 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:15.493891 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.510704 25687 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:15.511026 25693 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:15.509142 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:15.494030 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.494648 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.512501 25762 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:15.495405 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.513437 25767 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:15.501381 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.504249 25689 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:15.505676 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.491080 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:15.515043 25763 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:15.516619 25658 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.512748 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.506412 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.507781 25690 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:15.519132 25689 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:15.513840 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.520771 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.500451 27812 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.521467 25767 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:15.522593 27718 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.524266 27778 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.524762 27778 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.525194 27778 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:15.528342 27392 consensus_meta.cc:287] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 12:10:15.528795 27392 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.502362 27470 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:15.531840 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:15.532405 27466 consensus_meta.cc:287] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 12:10:15.532863 27749 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:15.533528 27749 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:15.532965 27466 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.534430 27749 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:15.536305 27802 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 12:10:15.536940 27802 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.537683 27752 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.538388 27593 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:15.540226 27593 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.540712 27593 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:15.543677 27809 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:15.544251 27809 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.545055 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.546000 25768 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:15.546535 27809 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.546851 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:15.547487 25760 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.547555 27808 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:15.548137 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.548302 27808 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:15.546545 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.549705 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.506785 27818 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.552968 27818 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.538493 27752 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:15.553857 27854 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.554694 27854 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.555445 27854 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.555544 27752 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.556306 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.556964 25761 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:15.557881 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.554872 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.538875 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.565537 25658 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.565989 25686 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:15.568750 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.569839 25610 raft_consensus.cc:2368] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:15.572423 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.583357 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.585152 25658 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.585368 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.586490 25762 raft_consensus.cc:2410] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:15.588922 27392 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.587131 27718 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.589959 27718 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:15.590588 27718 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.591532 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.592233 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.593650 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.595861 25765 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:15.595690 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.596765 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.599427 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.600590 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.601279 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.602803 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.603645 25618 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:15.591375 27818 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.605893 27818 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:15.606278 27802 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.606781 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.533098 27470 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:15.609489 25610 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:15.609200 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.617271 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.612092 25760 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:15.619454 25615 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:15.606465 27818 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.616201 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.635340 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.636255 25617 raft_consensus.cc:2410] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:15.646589 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.646970 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.647398 25761 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:15.647920 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.648170 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.648722 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.649283 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.650974 25610 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:15.651096 27589 consensus_queue.cc:1048] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:15.652647 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.653736 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.654477 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.654742 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.655586 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.655762 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.655843 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.656453 25618 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:15.656677 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.656957 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.657341 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.657763 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.657918 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.658450 25610 raft_consensus.cc:1813] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:15.659044 25610 raft_consensus.cc:2410] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:15.661065 25760 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:15.591216 27785 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:15.649909 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:15.549588 27808 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.541934 27593 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.669814 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:15.602769 27812 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.606673 27709 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:15.672619 27537 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:15.672758 27593 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.682154 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:15.677760 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:15.683468 25686 raft_consensus.cc:606] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:15.683864 25686 raft_consensus.cc:614] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:15.667816 27785 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.686960 25732 leader_election.cc:400] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6.
I20260709 12:10:15.689774 25759 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:15.690980 25763 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:15.691828 25610 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.701050 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:15.704996 25616 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:15.713608 25691 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:15.716419 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:15.705919 25612 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:15.718786 27561 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.714890 27823 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.720104 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:15.720394 27823 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.720615 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.693387 27861 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:15.682499 27537 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:15.722671 27823 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.722653 27861 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:15.723148 27537 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:15.724898 27861 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:15.731609 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.736673 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:15.699277 27785 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:15.746709 25694 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:15.713042 27802 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:15.770756 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:15.773079 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:15.773589 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:15.736934 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:15.784950 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:15.729319 27709 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:15.788552 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:15.789711 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60795798854e400987349043af926b8a"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:15.793663 25694 raft_consensus.cc:606] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:15.794045 25694 raft_consensus.cc:614] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:15.728389 27392 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:15.775525 27561 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.792488 27802 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:15.856343 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.854126 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.779945 27688 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:15.853053 27392 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:15.871708 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:15.873504 25694 raft_consensus.cc:606] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:15.874238 25694 raft_consensus.cc:614] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:15.873252 27392 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:15.893319 27392 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.894757 27392 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.895604 27778 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.896939 25764 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:15.879841 27466 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:15.920588 25768 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.931021 25690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:15.931855 25690 raft_consensus.cc:606] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:15.932753 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.898168 27778 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:15.912518 27751 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:15.977526 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.981798 25693 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.985432 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.986719 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:15.988404 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:15.989012 25685 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.996443 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:15.997491 25687 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:16.002143 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:16.001006 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:16.004791 25693 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:16.007952 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:16.008595 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.010739 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:16.009354 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:16.013562 25614 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:15.980734 27854 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.065718 27854 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:16.016896 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.016925 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:16.018762 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:16.067256 25693 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.032267 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:16.068486 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:16.069397 27778 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.071096 27865 log.cc:927] Time spent T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 12:10:16.070598 27778 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:16.073926 25619 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:16.074828 27688 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:16.075435 27688 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.075878 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.076710 27778 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:16.077155 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:16.077642 27688 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:16.078652 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:16.079447 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.088508 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:16.048604 25685 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:16.050964 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:16.001142 27751 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:15.993775 27537 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.101490 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.102707 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.108144 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.110127 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.111624 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.113727 27842 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.115231 25689 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:16.116947 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.081004 27703 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:16.121644 25614 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:16.113190 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.127069 25768 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.112080 27704 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.133937 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.134421 25766 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:16.142623 27842 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:16.127260 27718 consensus_meta.cc:287] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 12:10:16.143178 27842 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:16.143643 27842 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.143419 27718 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.112088 27785 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.145896 27718 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.149212 27718 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:16.149631 27718 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:16.150157 27718 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.152426 27816 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.153008 27816 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:16.146637 27858 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:16.154759 27858 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:16.155133 27858 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:16.155946 27858 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.157202 27858 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.157344 27818 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.147248 27785 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.147760 27703 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:16.147784 25691 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:16.160104 25694 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:16.163518 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 390487us
I20260709 12:10:16.165419 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:16.165551 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:16.129837 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 349367us
I20260709 12:10:16.171188 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:16.172129 25693 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:16.173321 27392 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.163684 25763 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:16.175573 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:16.177723 25688 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.174069 27392 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:16.182861 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:16.193048 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:16.163393 27844 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:16.174381 27862 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:16.180521 27445 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:16.203819 27818 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.180421 27392 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.154184 27816 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.180634 27861 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.212843 27751 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.214601 27882 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:16.182797 27846 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:16.220209 27878 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:16.174819 27860 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:16.224773 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:16.206465 27778 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.232010 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.228466 27882 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.210326 27561 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:16.268573 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.269518 25619 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.269974 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.270478 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.272184 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.274360 25612 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.276301 25610 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.279003 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:16.245075 27816 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.230486 27688 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:16.320794 25619 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:16.241873 27709 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:16.231419 27445 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:16.232447 27862 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:16.263856 27882 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:16.369948 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44470.3us
I20260709 12:10:16.383975 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:16.374380 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 240509us
W20260709 12:10:16.371596 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 129474us
I20260709 12:10:16.376262 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:16.379143 25763 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.380682 25761 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.386412 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.386595 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.388226 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.391834 25763 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.370170 27749 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.410158 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 166154us
I20260709 12:10:16.415249 25762 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:16.266906 27718 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.369891 27703 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 12:10:16.444898 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58599.7us
I20260709 12:10:16.463518 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.465545 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.467365 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.394132 27704 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:10:16.489302 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 313789us
I20260709 12:10:16.426473 27778 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:16.491720 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.426020 27878 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:16.430578 27537 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:16.495535 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 107363us
I20260709 12:10:16.500666 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.469310 27853 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.463094 27890 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.472100 27709 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:16.522006 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.523767 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.524112 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.434198 27749 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.495761 27889 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.546504 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.503551 27785 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:16.550794 27707 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.505875 27752 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.506134 27878 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:16.558918 27874 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:16.530890 27870 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 12:10:16.561062 27889 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.524183 27812 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.528013 27802 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.529357 27537 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.500609 27778 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.576570 27862 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:16.580780 27872 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:10:16.581533 27873 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:16.582098 27896 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:16.583276 27883 log.cc:927] Time spent T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:10:16.584226 27886 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:10:16.585505 27876 log.cc:927] Time spent T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:10:16.586984 27778 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:16.572014 27785 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.588289 27878 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:16.591046 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67035.1us
I20260709 12:10:16.582998 27896 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.582832 27709 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.578814 27537 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:16.617753 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 225325us
I20260709 12:10:16.599781 27718 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.622062 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:16.599824 27896 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:16.619508 27537 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.627588 27812 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:16.634929 27896 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.636091 27812 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:16.637086 27812 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.642007 25619 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:16.644361 27392 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:16.654928 25763 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.645259 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:16.648727 27892 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
W20260709 12:10:16.650233 27885 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:16.650753 27749 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.651628 27785 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.653447 27826 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:16.598084 27842 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:16.633718 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 166598us
I20260709 12:10:16.664812 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.662365 27826 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:16.667577 27785 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.676784 27882 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.677719 27688 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:16.681478 27844 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.686439 27466 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:16.686888 27466 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:16.687696 27466 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.688223 27392 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:16.688498 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:16.688704 27466 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.681931 27844 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:16.691283 27844 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.692554 27844 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.681473 27688 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:16.695336 27688 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.696887 27688 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:16.665083 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.703910 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:16.726924 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.679337 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.661010 25583 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:16.662292 27593 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:16.680831 27842 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:16.736379 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 75471.1us
I20260709 12:10:16.739559 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.741315 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:16.741782 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75564us
I20260709 12:10:16.742745 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.744396 25760 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:16.747107 27858 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.747267 27891 consensus_queue.cc:1059] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.760339 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.760783 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.761533 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:16.761950 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1138) took 1074 ms. Trace:
I20260709 12:10:16.762344 25760 rpcz_store.cc:276] 0709 12:10:15.687783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.689642 (+  1859us) service_pool.cc:224] Handling call
0709 12:10:15.690027 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.744269 (+1054242us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b54001ed5a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd2dc0 00007fbdb2d5d1c0 00007fbdb2d5e231 00007fbdb2d5ad8f 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c
0709 12:10:16.744795 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.761703 (+ 16908us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400317ed4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:16.761881 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1324390784}
I20260709 12:10:16.768414 25615 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:16.769776 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.748538 27897 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.778455 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.757393 27854 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:16.771315 27749 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.794998 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.798179 27812 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.798732 27812 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:16.799151 27882 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.779058 27823 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:16.781750 27751 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.800120 27823 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:16.803357 27890 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.805908 27537 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.815201 27593 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:16.815738 27593 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:16.815955 27785 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.816550 27593 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.817878 27593 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.794744 27703 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:16.819500 27703 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:16.785811 27861 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.820814 27861 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:16.820432 27703 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.821683 27861 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.823123 27861 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.799165 27812 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.827783 27881 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 12:10:16.780467 27905 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:16.828670 27905 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.829144 27905 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.833220 27823 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:16.834543 27857 raft_consensus.cc:3055] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.835006 27857 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:16.835857 27857 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:16.836112 26334 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:16.836995 27857 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.837203 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:16.842028 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 55349.3us
I20260709 12:10:16.841928 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:16.848949 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.850103 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:16.850826 25613 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:16.851315 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.851739 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:16.841367 25612 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
W20260709 12:10:16.859117 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.840147 27537 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.869658 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 44) took 8538 ms. Trace:
I20260709 12:10:16.870944 27826 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.872526 27826 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.876436 27749 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.884960 25614 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:16.875056 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:16.905134 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.674s (SENT) [suppressed 45 similar messages]
I20260709 12:10:16.887506 25763 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:16.906435 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.870222 25516 rpcz_store.cc:276] 0709 12:10:08.331875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.332089 (+   214us) service_pool.cc:224] Handling call
0709 12:10:16.869572 (+8537483us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:15.427206 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:15.427823 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:15.427869 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:10:15.427888 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:15.428529 (+   641us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:15.428591 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:15.428626 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:15.429006 (+   380us) tablet.cc:701] Row locks acquired
0709 12:10:15.429022 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:15.429178 (+   156us) write_op.cc:270] Start()
0709 12:10:15.429297 (+   119us) write_op.cc:276] Timestamp: P: 1783599015429133 usec, L: 0
0709 12:10:15.429325 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:10:15.430059 (+   734us) log.cc:844] Serialized 1697 byte log entry
0709 12:10:16.492007 (+1061948us) op_driver.cc:464] REPLICATION: finished
0709 12:10:16.645275 (+153268us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdafc510ac 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb6791ef0
0709 12:10:16.747359 (+102084us) write_op.cc:301] APPLY: starting
0709 12:10:16.747495 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:16.747660 (+   165us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:16.747681 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:16.751235 (+  3554us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:16.751476 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:16.751526 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:16.754574 (+  3048us) log.cc:844] Serialized 40 byte log entry
0709 12:10:16.754773 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:16.754907 (+   134us) write_op.cc:454] Released schema lock
0709 12:10:16.754954 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:16.755425 (+   471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:16.755460 (+    35us) write_op.cc:454] Released schema lock
0709 12:10:16.811632 (+ 56172us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5832a 00007fbdb2cddf14 00007fbdb2cddec3 00007fbdb2cdde38 00007fbdb2cdddf3 00007fbdb2cdd0dc 00007fbdb2d06e16 00007fbdb2ceecbb 00007fbdb2cd939d 00007fbdb2cdcd75
Metrics: {"mutex_wait_us":4459581,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":233409,"apply.run_cpu_time_us":3039,"apply.run_wall_time_us":19304,"num_ops":4,"prepare.queue_time_us":233584,"prepare.run_cpu_time_us":89058,"prepare.run_wall_time_us":350651,"raft.queue_time_us":369228,"raft.run_cpu_time_us":11772,"raft.run_wall_time_us":406007,"replication_time_us":1036491,"spinlock_wait_cycles":58653312,"thread_start_us":821169,"threads_started":4,"wal-append.queue_time_us":586371}]]}
I20260709 12:10:16.915961 27905 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.925947 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:16.927917 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.929221 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:16.932881 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:16.948650 25759 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.904733 27816 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:16.909363 27785 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.952579 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:16.963939 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:16.956674 27905 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.966486 27816 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:16.969233 27816 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:16.942512 27887 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.920861 27842 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.908607 27466 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.930193 25501 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet fa0600a571a0457f804bf9bf88fd9fd4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 5
I20260709 12:10:16.959127 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:10:16.984304 25501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 54153.9us
W20260709 12:10:17.005942 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76804.9us
I20260709 12:10:17.021138 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.024911 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.005405 27785 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:17.009828 27823 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:17.010020 27844 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:17.029564 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:17.034011 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:17.035506 25515 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 4 to 5, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.044780 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.060591 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:17.087651 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.063755 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 157670us
I20260709 12:10:17.107035 25515 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.053378 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:17.116627 25732 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:17.119489 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:17.121592 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76911.9us
W20260709 12:10:17.123097 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 121188us
I20260709 12:10:17.123809 25582 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:17.124562 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71343.4us
I20260709 12:10:17.128703 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:17.129233 25685 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:17.129725 25689 raft_consensus.cc:2410] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:17.125875 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.131230 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.133025 25687 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.133368 25693 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.150689 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.151408 25515 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.147298 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.152786 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:17.153399 25690 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.153697 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.154784 27844 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:17.155300 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:17.155527 25692 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:17.155881 27844 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.156246 27844 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.156610 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.157051 27844 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.042479 27842 raft_consensus.cc:993] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:17.161777 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.151981 27887 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:17.153115 25515 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.164830 25762 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:17.166043 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.043320 27749 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.165416 25515 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.192462 25691 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:17.122049 27890 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.163641 27816 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:17.151758 27896 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.160382 27844 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.164003 27470 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:17.201211 25515 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 5 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.204638 25690 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:17.209178 25761 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:17.210914 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:17.212111 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:17.224442 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.224797 25767 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:17.225854 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.213295 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.214068 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.214452 25693 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.025250 27812 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.230969 25686 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:10:17.215574 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.045758 27895 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 12:10:17.239760 27858 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:17.240757 27466 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:17.241202 27466 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:17.241981 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.242117 27466 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.243566 27466 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.154805 27785 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.245244 27785 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:17.245704 27785 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.162407 27709 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.214993 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:17.228154 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.250885 25766 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.040256 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet b7b82e0d41f14cc2baa1e889ed4c7312 with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53278
I20260709 12:10:17.225970 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:17.228667 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:17.230886 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:17.231709 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71915.4us
I20260709 12:10:17.229962 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:17.218773 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52812.6us
I20260709 12:10:17.232425 25694 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:17.151516 27688 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:10:17.234149 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.235291 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.235958 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:17.194012 27887 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.263330 25686 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:17.205350 27902 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.236927 27903 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.223152 27874 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.239979 27470 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.231709 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:17.214538 27901 raft_consensus.cc:1081] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:17.258420 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.261533 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.221251 27861 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.214148 27816 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:17.267642 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 69436.4us
I20260709 12:10:17.228930 27882 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.278816 25766 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:17.281155 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.283738 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.276753 27902 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:17.274725 27688 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:17.277885 27861 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.280191 27816 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.278630 27882 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.273916 27903 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.293439 27874 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.294014 27749 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.303292 27902 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:17.314248 27470 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.315553 27902 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.316910 27902 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.301653 27890 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.327625 27903 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.328342 27903 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:17.329408 27903 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:17.329857 27903 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:17.333609 27785 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.334439 27861 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.335193 27887 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.335834 27861 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.337138 27785 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.307984 27688 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.340981 27688 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.341647 27688 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:17.341948 27688 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:17.343004 27812 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.329923 27752 raft_consensus.cc:993] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:17.342566 27882 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.312682 27874 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:17.348496 27874 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.352239 27709 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.231210 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.237650 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.407111 25515 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 3, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:17.408591 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 170856us
I20260709 12:10:17.410880 25515 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 5 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.414158 25583 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.416584 25515 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.419608 25515 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 5 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.421520 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.422911 25515 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 5 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.430070 25611 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:17.426776 25515 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.507025 27854 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.507144 27858 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:17.510684 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 226916us
I20260709 12:10:17.518432 27466 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:17.519585 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 98333.3us
I20260709 12:10:17.520151 25764 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:17.520910 25583 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.518699 27927 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.523691 27927 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:17.526039 27812 raft_consensus.cc:1081] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:17.526988 27858 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:17.527566 27858 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.530623 27926 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:17.532809 27926 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.529410 27858 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.506841 27852 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:17.537758 27852 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.538436 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:17.538638 27852 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.539906 27854 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:17.540678 27854 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:17.542706 27903 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.543088 27854 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.541042 27852 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.545099 27749 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:17.533486 27926 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:17.537343 27858 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.552591 27901 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:17.553537 27901 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.555999 27852 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.557029 27901 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.558821 27925 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.559880 27925 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.564551 27925 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.565861 27925 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.566519 27902 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.567513 27902 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:17.586201 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72465.5us
I20260709 12:10:17.551993 27926 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.593684 27926 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.595046 27896 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.595803 27896 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.597491 27688 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.599601 27688 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:17.602967 27925 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.605743 27932 tablet_replica.cc:333] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
W20260709 12:10:17.606330 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 288463us
I20260709 12:10:17.607816 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.608425 27932 raft_consensus.cc:2243] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:17.609661 27929 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:17.610687 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.610610 27929 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.611444 27846 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.612098 27846 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.613524 27929 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.605906 27925 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.609840 27932 raft_consensus.cc:2272] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:17.626047 27925 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.627615 27925 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.630427 27925 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.599622 27896 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:17.632707 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 320353us
I20260709 12:10:17.636015 27882 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.636637 27932 ts_tablet_manager.cc:1916] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:17.642345 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.656598 27752 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:17.658907 27895 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:17.659407 27846 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.651021 25515 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.657995 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:17.663650 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.647137 27703 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:17.647918 27929 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.667686 27703 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:17.690449 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:17.692304 27809 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.693199 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:17.693109 27809 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.695176 27922 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:17.695730 27809 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.681376 27703 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.705798 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:17.706668 27929 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.709932 27929 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.676367 27874 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.727830 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:17.739439 27902 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.751454 27902 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:17.752553 27902 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.752912 27902 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:17.754436 27902 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.758095 27902 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:17.749789 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 91988us
I20260709 12:10:17.730100 25515 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 4, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.747903 27925 consensus_queue.cc:1059] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:17.785418 27925 raft_consensus.cc:3055] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.792249 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:17.786005 27925 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:17.799751 25515 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 4, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 4 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.806674 27858 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:17.832047 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.834082 25612 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:17.809470 27874 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.847600 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:17.853967 27939 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:10:17.845286 25515 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 2 to 3, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.865908 27822 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:17.868944 27935 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:17.870283 27816 consensus_meta.cc:287] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.008s
W20260709 12:10:17.871093 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63891.6us
I20260709 12:10:17.870851 27816 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.872181 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:17.871682 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51355.8us
I20260709 12:10:17.874145 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.875558 27935 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.884047 27703 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:17.891611 27844 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.004s
I20260709 12:10:17.892318 27844 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.892932 27844 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.884348 27925 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.887539 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:17.888120 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.912099 27704 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.934752 27925 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:17.937911 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.913465 25619 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
W20260709 12:10:17.945158 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.950732 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76789.8us
I20260709 12:10:17.952239 25614 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:17.966517 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:17.968605 25618 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:17.967403 27688 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.970319 27704 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.970610 27688 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.970964 27704 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.973268 27688 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.973726 27704 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:17.970333 27861 consensus_meta.cc:287] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.016s
I20260709 12:10:17.977165 27816 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.960081 27703 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.982234 27926 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.982614 27874 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:17.983078 27844 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:17.983047 27926 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.983291 27874 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.985508 27926 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.985524 27874 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.988605 27926 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.988986 27896 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:17.989319 27926 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.989686 27896 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.990564 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:17.991295 25619 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.991921 27926 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.992059 27896 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:17.992626 27926 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.993219 27926 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:17.996047 27926 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:17.998013 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.004307 27703 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:18.003046 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51208us
I20260709 12:10:18.013111 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:18.038754 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:18.042435 25616 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:18.051337 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:18.052718 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.058959 27704 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:18.064069 27895 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:10:18.086365 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44563.1us
I20260709 12:10:18.090691 27826 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.091331 27826 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.093300 25619 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:18.096921 27844 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:18.097277 27826 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.097831 27844 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.100515 27844 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.101948 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.102979 27703 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.103508 27703 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.103883 27703 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.106982 25761 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:18.110788 25760 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.112471 25766 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:18.114815 27781 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:18.117455 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:18.119552 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45780.3us
I20260709 12:10:18.120258 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.122663 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:18.127550 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.129956 27852 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.131160 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.137084 27950 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:10:18.141398 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.142889 25762 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:18.142632 27704 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.149619 27936 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.150123 27936 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.150040 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.150646 27936 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.151912 25619 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.148917 27704 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:18.155062 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.150523 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.145615 27852 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.145768 27844 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.161291 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.161752 27844 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.162863 27852 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.164209 25616 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:18.163903 25610 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:18.163852 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:18.172844 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.173542 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.177955 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.166100 27844 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:18.183825 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.185120 27816 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:18.174893 27704 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.188115 27852 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.188830 27852 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.188422 27857 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:18.190207 27925 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.210597 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.213132 25619 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:18.220858 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:18.197553 27816 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:18.224499 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.226784 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.227598 25614 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:18.225430 27925 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.236395 27703 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.236948 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:10:18.237851 25762 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:18.238308 25762 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.251859 25759 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:18.254488 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:18.256587 27703 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.257122 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:18.258553 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.258879 27816 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.265583 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.258102 25768 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:18.271248 27932 ts_tablet_manager.cc:1929] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:10:18.243535 25658 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.285012 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
W20260709 12:10:18.290138 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86950.6us
I20260709 12:10:18.290602 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:18.293622 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:18.294446 25618 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.307569 25768 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:18.308128 25768 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.276676 27935 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:18.303108 27932 log.cc:1199] T b7b82e0d41f14cc2baa1e889ed4c7312 P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/b7b82e0d41f14cc2baa1e889ed4c7312
I20260709 12:10:18.314870 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.332119 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.313920 27935 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.333858 25762 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.348449 25764 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:18.349274 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45929.5us
I20260709 12:10:18.349565 25766 raft_consensus.cc:2393] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:18.352581 25618 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:18.359722 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.353695 25768 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.342722 27935 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:18.321810 27704 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:18.369702 25762 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:18.370769 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.371443 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:18.372006 25768 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:18.365777 27925 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:18.382476 27895 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.383157 27895 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.386701 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.390589 27902 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.390482 27704 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:18.378785 27926 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:18.391495 27902 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.393805 27704 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:18.398502 27932 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53278 (request call id 72) took 1451 ms. Trace:
I20260709 12:10:18.385673 27852 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.399084 27932 rpcz_store.cc:276] 0709 12:10:17.011283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.039165 (+ 27882us) service_pool.cc:224] Handling call
0709 12:10:17.584177 (+545012us) ts_tablet_manager.cc:1151] Deleting tablet b7b82e0d41f14cc2baa1e889ed4c7312
0709 12:10:17.604923 (+ 20746us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:18.124299 (+519376us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:18.271004 (+146705us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:18.398386 (+127382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":316806,"thread_start_us":299780,"threads_started":1}
I20260709 12:10:18.376567 27703 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.400966 27703 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.402055 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.402609 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.403316 27703 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:18.407470 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.415513 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.416531 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45181.4us
I20260709 12:10:18.401000 27936 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.425420 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.427132 25762 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:18.414948 27902 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:18.433557 25618 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:18.433796 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 73969.3us
I20260709 12:10:18.423453 27925 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.444526 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:18.428557 27852 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:18.452780 25762 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:18.458444 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:18.459703 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:18.481904 25768 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:18.482383 25764 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.461192 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.461799 27902 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.462502 25759 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.463842 27895 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.466666 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.467777 27936 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.468129 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.447093 27703 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:18.469298 27926 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.469177 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.490059 25761 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:18.487546 25766 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:18.502355 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.504097 27902 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.505079 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:18.506167 27897 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.506858 27897 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.504436 25614 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:18.506340 27874 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.502303 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.510526 25616 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:18.487593 27924 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.489367 27852 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.516810 25765 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:18.523778 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.522764 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.525179 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.545437 25612 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:18.548295 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.551345 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:18.488317 27925 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.559003 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.513623 27703 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:18.553526 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet b7b82e0d41f14cc2baa1e889ed4c7312 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:10:18.560616 25658 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.579063 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:18.574003 25762 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:18.591212 25502 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 144770us
I20260709 12:10:18.591544 27961 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.594961 27961 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.595427 27961 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.515995 27861 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:10:18.561719 27902 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:18.517979 27874 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.601490 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:18.604574 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.605185 25692 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:18.608819 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.608312 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 105203us
I20260709 12:10:18.588498 27882 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:18.562866 27924 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.612351 27936 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.613149 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.613744 27823 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:18.614719 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.621528 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.620321 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.643276 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.619073 27882 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.649274 27882 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:18.649673 27968 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.651206 27971 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:18.652197 25685 raft_consensus.cc:2376] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:18.656626 27935 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.660738 27970 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.661500 27970 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:18.662065 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.662943 27897 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.664273 25760 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 12:10:18.667908 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56302.4us
I20260709 12:10:18.668670 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:18.633633 27957 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:18.664659 25760 pending_rounds.cc:85] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 3
I20260709 12:10:18.625846 27902 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:18.648001 27895 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.687121 25760 pending_rounds.cc:107] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:18.636032 27936 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.702721 25760 raft_consensus.cc:2889] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:18.692613 27924 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.663451 27968 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:18.717775 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.718271 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 127857us
I20260709 12:10:18.722470 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.701610 27969 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.667038 27703 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.709527 27809 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.710246 27895 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.736807 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.729617 27969 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:18.732686 27925 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:18.741411 27959 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:10:18.747864 27857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37142 (request call id 2) took 1904 ms. Trace:
I20260709 12:10:18.735826 27852 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.734112 27897 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.749112 27704 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:18.748353 27857 rpcz_store.cc:276] 0709 12:10:16.833838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.833990 (+   152us) service_pool.cc:224] Handling call
0709 12:10:16.869776 (+ 35786us) log.cc:844] Serialized 508 byte log entry
0709 12:10:18.734083 (+1864307us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":30378,"mutex_wait_us":1910,"raft.queue_time_us":12574,"raft.run_cpu_time_us":1387,"raft.run_wall_time_us":1388,"thread_start_us":139916,"threads_started":1,"wal-append.queue_time_us":141725,"wal-append.run_cpu_time_us":2293,"wal-append.run_wall_time_us":1002274}
I20260709 12:10:18.735821 27924 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.742445 27902 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.767346 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:18.768814 27970 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.769294 27935 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.791333 27980 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:18.770762 27968 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:18.771781 27965 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:18.772184 27704 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.773008 27897 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.775275 27874 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:18.778973 27967 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:10:18.783437 25687 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.783988 25764 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:18.745427 27969 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.793592 25767 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:18.788671 27924 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.807631 27924 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.794502 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.733248 27974 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:18.736271 27809 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.803521 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.829627 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.811381 27982 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.793615 27902 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.796671 27882 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.857977 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.835567 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.879029 25611 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:18.837935 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:18.869683 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.874243 25687 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:18.880868 25615 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:18.881318 25688 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:18.882685 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.846065 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39e6df07fdde400cbbefc675d486ab4a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:18.854185 27809 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.859100 27882 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.857479 27704 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.885910 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:18.852157 27936 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.886579 25694 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.886948 25694 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:18.856318 27982 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:18.887713 25694 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.888733 25694 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.888765 25761 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:10:18.889416 27982 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:18.890118 25690 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:18.890810 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.891675 25689 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:18.891718 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.855279 27961 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.895756 25686 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:18.897074 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:18.868999 27926 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.835248 27957 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:18.911636 25687 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:18.918180 25687 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:18.917255 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 194291us
I20260709 12:10:18.918725 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.920763 25689 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:18.890799 27897 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.920559 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:18.923756 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.923967 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:18.926016 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.926746 25693 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:18.927942 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:18.928625 27984 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.929064 27984 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.929419 27984 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.931572 27826 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:18.932041 27826 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:18.933015 27826 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.920097 27982 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:18.934726 27982 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:18.935657 27895 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.938611 27961 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.925123 27902 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:18.925237 27882 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:18.939740 27982 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:18.940061 27882 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:18.940526 27882 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:18.928663 26337 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:18.943187 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:18.944681 25731 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:18.946695 27902 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.947079 27902 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.947413 27902 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.948123 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.946695 26303 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:18.950843 27852 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.951393 27852 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.951393 27781 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.952203 27781 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.952522 27781 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.953738 27852 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:18.955039 27823 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:18.959766 25690 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.962441 27982 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.963095 27982 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.965317 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.966753 27982 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:18.969058 25688 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:18.924925 25687 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:18.976915 25689 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.975657 25615 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:18.977581 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:18.974934 25694 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:18.978315 25692 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:18.978482 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:18.979406 25768 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:18.989199 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:18.990075 25764 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:19.002383 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:18.975353 27826 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.004225 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.007463 25694 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:19.007807 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.008592 25691 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:19.009876 25693 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:19.011251 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.011664 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.011804 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.011972 25689 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:19.005893 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:19.013923 25617 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.017560 27987 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.019405 25618 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:19.021373 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.022044 25614 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:19.022652 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:19.023278 25610 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.024041 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.026639 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.029872 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.031584 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.033495 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:19.037791 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.038544 25618 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:19.044494 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.041803 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:19.049435 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:19.022715 27987 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.015434 27984 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.067307 27852 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:19.067950 27852 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.067996 27971 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.068440 27852 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:19.068538 27971 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:19.069061 27971 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.074374 27982 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:19.077674 27852 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.036753 27861 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.079515 25761 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.001194 27957 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.077674 27781 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:19.087510 25658 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:19.084581 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:19.087713 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.090523 25764 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:19.145789 25611 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:10:19.178586 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.137112 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.217295 27976 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.218219 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 133678us
I20260709 12:10:19.179934 25687 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:19.117396 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 66472.4us
W20260709 12:10:19.219290 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 164066us
I20260709 12:10:19.194893 27972 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:19.176590 27987 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.115607 27926 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.220363 27925 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.053056 27969 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.053653 27897 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.298779 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.300557 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.214780 27861 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:19.319752 27861 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:19.323168 27992 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:19.246419 27985 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:19.317094 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.164688 27902 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:19.318009 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.306535 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.320926 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:19.310774 27936 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.246431 27968 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.325337 25687 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:19.135109 27984 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.217993 27974 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.259799 27874 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.246917 27976 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:19.479346 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 43587.9us
I20260709 12:10:19.352756 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.482385 25617 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 3.
I20260709 12:10:19.339356 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.328970 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.343577 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:19.491992 25694 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:19.335801 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.493041 25767 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:19.486927 25759 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.353711 25688 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:19.328918 25761 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:19.343830 25689 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:19.352684 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:19.485404 25693 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:19.491338 25611 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:19.497818 25610 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:19.354184 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.305580 27987 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:19.514997 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:19.325834 27897 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.523403 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:19.540659 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.323233 27861 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:19.531042 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 93020.6us
I20260709 12:10:19.539044 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:19.543812 25688 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:19.484062 27980 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.315828 27926 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.343900 27969 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:19.357625 27781 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.308296 27972 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.313254 27925 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.338429 27882 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.504215 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:19.590829 25611 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:10:19.839828 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.866215 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:19.771534 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.771347 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.868052 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:19.743780 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 416402us
W20260709 12:10:19.626797 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.672427 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:19.871690 25767 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:19.503647 27982 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:19.572130 25685 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:19.483862 27703 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.784441 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:19.893638 25760 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.822935 25694 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:19.583825 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:19.895892 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 312184us
W20260709 12:10:19.695719 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.900918 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:19.663604 27971 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
W20260709 12:10:19.911437 25616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.015s	sys 0.028s
W20260709 12:10:19.912066 25616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.015s	sys 0.028s
I20260709 12:10:19.672467 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:19.914760 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 242417us
I20260709 12:10:19.589396 25691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:19.915889 25691 raft_consensus.cc:606] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:19.916673 25691 raft_consensus.cc:614] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:19.484074 27968 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.903894 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.904717 25617 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.545339 27897 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.917853 25619 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:19.523358 27985 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:19.502651 27936 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.671976 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:19.876685 27852 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.922582 25763 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:19.521409 27974 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:19.923738 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 378906us
I20260709 12:10:19.877964 27982 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:19.902896 27895 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.925294 25733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.012s	sys 0.008s
W20260709 12:10:19.944495 25733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.012s	sys 0.008s
I20260709 12:10:19.904322 27975 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:19.523785 27874 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.934300 25765 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:19.525970 27987 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.952080 25617 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
I20260709 12:10:19.940207 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.953536 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.924260 27968 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.921319 27957 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.920985 27969 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.940866 27826 consensus_meta.cc:287] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.920s	user 0.013s	sys 0.000s
I20260709 12:10:19.954241 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.904327 27703 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.964664 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.892421 27980 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.962809 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:19.966336 25761 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:19.971594 27926 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:19.972391 27936 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.972532 25618 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:19.972628 27980 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.972977 27936 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.973508 27936 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.974646 27703 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:19.975220 27703 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.975714 27703 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.977710 25689 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:19.982206 25762 raft_consensus.cc:2393] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:19.983108 25760 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:19.921530 27971 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:19.985903 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:19.986953 25764 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:19.988029 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:19.951442 27986 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:19.991107 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:19.993643 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 77754.8us
I20260709 12:10:19.961272 27902 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:20.004930 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.003434 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:19.960038 27975 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:19.965118 27957 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:20.014680 27996 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:10:20.015851 27936 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.016259 27957 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.016746 27957 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.017309 27974 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.017222 27957 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.019399 25764 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:20.020506 27975 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.022413 27936 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.025985 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1081) took 1009 ms. Trace:
I20260709 12:10:19.965584 27969 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.026484 25616 rpcz_store.cc:276] 0709 12:10:19.016161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.016287 (+   126us) service_pool.cc:224] Handling call
0709 12:10:19.016676 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.017101 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.017133 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.017691 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.912567 (+894876us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:19.912632 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.912733 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.025755 (+113022us) raft_consensus.cc:1685] finished
0709 12:10:20.025776 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.025897 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":635,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":894183,"threads_started":1,"wal-append.queue_time_us":1005215}
I20260709 12:10:20.025964 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:20.031417 25759 consensus_meta.cc:287] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.005s
I20260709 12:10:20.031939 25759 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:20.032878 27936 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.028833 27982 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.034045 27902 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:19.965327 27976 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.035686 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.030022 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:20.028488 27969 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:19.950976 27895 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.040273 27974 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.034659 27852 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:20.034639 27902 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.044221 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1202) took 1058 ms. Trace:
I20260709 12:10:20.044891 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.050642 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.051091 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:20.051378 25764 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:20.051754 25616 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.069111 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.035974 28001 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.046481 25766 rpcz_store.cc:276] 0709 12:10:18.980671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.982726 (+  2055us) service_pool.cc:224] Handling call
0709 12:10:19.028808 (+ 46082us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:19.028946 (+   138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.029300 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.029329 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.040271 (+ 10942us) log.cc:844] Serialized 26 byte log entry
0709 12:10:19.251940 (+211669us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:19.251980 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.252049 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.029293 (+777244us) raft_consensus.cc:1685] finished
0709 12:10:20.029315 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.038977 (+  9662us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1870,"spinlock_wait_cycles":2731264,"thread_start_us":104690,"threads_started":1,"wal-append.queue_time_us":450401}
I20260709 12:10:20.069978 27936 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.043174 27974 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.058542 27976 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.040392 27984 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:10:20.102244 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 98921.8us
I20260709 12:10:20.103425 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.088542 25616 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:20.081530 27957 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.100097 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:20.041642 27985 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.100659 27987 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.058802 28008 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.131016 28008 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.131505 28008 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.135113 27874 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.107506 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.101935 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:20.075105 27980 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:20.124967 27882 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.125013 27703 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.125046 27968 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.127274 27826 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:20.129940 27861 consensus_meta.cc:287] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 12:10:20.063503 27823 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:20.036438 27986 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:20.157385 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 55531.3us
I20260709 12:10:20.106945 27925 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:20.158906 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55874.6us
I20260709 12:10:20.136879 27969 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.163739 25610 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:20.183837 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.188786 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.177470 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.190841 25765 raft_consensus.cc:2368] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:20.191511 25617 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:20.198686 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.199785 25615 raft_consensus.cc:2410] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:20.200345 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.160437 27874 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.163214 27703 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.212127 25611 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:20.214926 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:20.225924 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 122710us
I20260709 12:10:20.201252 27969 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:20.192938 27826 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:20.192461 27895 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.162130 27980 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:20.232868 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 78736.1us
I20260709 12:10:20.217541 27703 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.228747 27852 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:20.325565 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:20.306026 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89281.6us
I20260709 12:10:20.307192 25613 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:20.234704 25692 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:20.306947 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 120395us
I20260709 12:10:20.332823 25685 raft_consensus.cc:606] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:20.235378 25617 raft_consensus.cc:2955] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:10:20.340449 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.291249 25732 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.602s (SENT)
I20260709 12:10:20.236352 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.343327 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.327767 27852 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.327219 27902 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.282523 27971 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.375600 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.331907 27703 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.266772 27972 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.285213 28009 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:20.388019 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.289832 27826 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:20.391820 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 155617us
I20260709 12:10:20.249421 27961 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:20.378618 27852 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:20.232244 28012 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.159s
I20260709 12:10:20.397107 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:20.401052 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 114698us
W20260709 12:10:20.403713 28023 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:10:20.404350 25732 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.809s (SENT)
I20260709 12:10:20.404808 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.399345 28019 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:20.341414 27957 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:20.400744 27968 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.411111 27980 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.378275 27969 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.413089 27826 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.396397 28009 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.388408 28001 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.415931 28009 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.347577 27895 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 12:10:20.411175 28014 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:20.419191 25616 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:20.401583 27961 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.427727 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:20.434082 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.435262 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54182.2us
I20260709 12:10:20.436419 28017 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.113s
I20260709 12:10:20.424044 28012 consensus_queue.cc:1243] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:20.437860 27925 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:20.438548 27975 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.438442 27925 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.438853 28031 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:20.440601 27925 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.438447 27984 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.441495 28017 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.441547 27984 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:20.442643 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.442739 27984 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.443969 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.444556 25764 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:20.422086 27961 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.446803 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.445446 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:20.449663 25762 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:20.455830 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.456638 28032 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:20.459666 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 1034) took 1247 ms. Trace:
I20260709 12:10:20.460072 25686 rpcz_store.cc:276] 0709 12:10:19.212096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.221677 (+  9581us) service_pool.cc:224] Handling call
0709 12:10:20.459443 (+1237766us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000aa854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:20.459575 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441292544}
I20260709 12:10:20.465281 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.466114 25764 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:20.470353 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.471210 25610 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:20.473045 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:20.474304 25615 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:20.490542 28019 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:20.490837 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.491510 25612 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:20.491797 28019 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.474890 27986 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.499137 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1672) took 1182 ms. Trace:
I20260709 12:10:20.499825 25618 rpcz_store.cc:276] 0709 12:10:19.316513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.316805 (+   292us) service_pool.cc:224] Handling call
0709 12:10:20.498784 (+1181979us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b540021d254. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:20.499001 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120765824}
I20260709 12:10:20.500730 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1667) took 1200 ms. Trace:
I20260709 12:10:20.501161 25614 rpcz_store.cc:276] 0709 12:10:19.300443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.308645 (+  8202us) service_pool.cc:224] Handling call
0709 12:10:19.350780 (+ 42135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.983165 (+632385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.983195 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.983243 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:19.983284 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.500412 (+517128us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540021e654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:20.500466 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.500633 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453830016}
I20260709 12:10:20.503261 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.504662 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.505445 28015 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.452306 28031 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:20.507320 28031 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.438957 27975 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.506206 28015 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.502067 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1022) took 1514 ms. Trace:
I20260709 12:10:20.509974 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 1045) took 1168 ms. Trace:
I20260709 12:10:20.506094 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:20.523131 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 87188.6us
I20260709 12:10:20.522060 25582 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.531940 25689 rpcz_store.cc:276] 0709 12:10:19.342039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.509639 (+167600us) service_pool.cc:224] Handling call
0709 12:10:20.509740 (+1000101us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003ff054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:20.509892 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003198336}
I20260709 12:10:20.530925 25692 rpcz_store.cc:276] 0709 12:10:18.988061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.988225 (+   164us) service_pool.cc:224] Handling call
0709 12:10:18.988639 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.234480 (+1245841us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b540039e020. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd2dc0 00007fbdb2d5d1c0 00007fbdb2d5e231 00007fbdb2d5ad8f 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c
0709 12:10:20.332653 (+ 98173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.501701 (+169048us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54001946d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:20.501952 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096115328}
I20260709 12:10:20.534090 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.535562 27874 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:20.537554 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.538507 25615 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:20.540100 25762 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:20.541646 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.549101 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.550931 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.536707 28009 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.557556 28009 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:20.536856 28032 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:20.560504 28032 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:20.531488 27969 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.563122 25658 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:20.552506 28001 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.564934 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.566130 28021 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.566766 28021 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:20.567234 28021 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.442163 28017 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.570787 28012 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.571259 28012 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.571652 28012 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.572271 27974 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.574630 28030 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:20.565207 25658 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:20.563383 27971 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.577967 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.578729 25768 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:20.558066 28009 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.582873 27882 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:20.583396 27882 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:20.584399 27882 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.585813 27882 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.531946 27975 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.588902 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1678) took 1056 ms. Trace:
I20260709 12:10:20.589375 25619 rpcz_store.cc:276] 0709 12:10:19.532388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.545266 (+ 12878us) service_pool.cc:224] Handling call
0709 12:10:19.545808 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.923250 (+377442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.588598 (+665348us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540008cfd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:20.588827 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855129344}
I20260709 12:10:20.574946 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.593142 25765 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:20.593549 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.594128 28033 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.594659 28033 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.595002 28033 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.596619 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:20.595849 28016 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:20.602420 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:20.604300 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 372815us
I20260709 12:10:20.608520 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.609345 25762 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:10:20.611424 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.613122 25762 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:20.595011 28015 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.596719 27925 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.612186 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:20.616127 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 240596us
I20260709 12:10:20.605261 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.617981 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.618781 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.628479 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.629962 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.604573 28016 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:20.633946 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.634672 25615 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:20.636505 27936 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:20.637449 27936 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:20.637809 27936 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:20.638718 27936 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.639238 25616 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:20.640004 27936 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:20.637893 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.644587 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:20.608956 27809 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:20.613243 27822 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.652701 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.653059 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:20.616601 27961 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.660285 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.661403 27961 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.665162 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:20.666791 25692 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:20.665197 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:20.667157 25692 raft_consensus.cc:614] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:20.632076 27974 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:20.632254 27971 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:20.655933 27897 consensus_meta.cc:287] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.713s	user 0.014s	sys 0.000s
W20260709 12:10:20.662323 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 43525.6us
I20260709 12:10:20.656032 27874 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.672640 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.666425 27895 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.675072 28015 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.666219 27822 raft_consensus.cc:697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:20.709872 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.659274 27925 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.716310 28018 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.664474 28008 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.006s
I20260709 12:10:20.665897 27961 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.722087 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.670732 27971 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.699880 27897 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.747884 27997 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:10:20.749058 28010 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.749541 28010 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.749940 28010 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.750739 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:20.750764 27897 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.752591 28007 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.753311 28007 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:20.754380 28011 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.752658 27897 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:20.755867 27897 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.757779 27897 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:20.756528 28011 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:20.757195 28035 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.760705 28035 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.761536 28051 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.763052 28029 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:20.763157 28035 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.657882 27809 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:20.763574 28029 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:20.764024 28029 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:20.765369 27809 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:20.756247 28007 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:20.721349 28038 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.722383 28032 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:20.735702 27957 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 12:10:20.771070 27999 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:10:20.773123 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51135.1us
I20260709 12:10:20.777628 28007 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:20.778548 28007 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:20.777879 27822 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:20.779706 28007 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.781427 28040 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.762001 28051 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:20.653059 27852 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.774140 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.720592 28015 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:20.737275 27974 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.656350 27703 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.793063 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.772027 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:20.800606 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:20.794157 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:20.777314 27971 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:20.802750 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 134927us
I20260709 12:10:20.806035 27703 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.809695 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.791209 27926 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:20.791821 28051 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.796782 28015 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.780838 28009 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.812799 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.724900 27895 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.797659 27997 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.817870 27852 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.818303 28036 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:20.835805 28036 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.836220 28036 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:20.813202 27926 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:20.803947 27974 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.838963 27926 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.776880 28008 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.840441 27895 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.841676 25731 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:20.842211 28008 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.842463 28009 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.807521 27969 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.772769 28018 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.843366 27969 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.843811 27969 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.840423 28041 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:20.846408 28041 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:20.847543 28041 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.795109 28012 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.853713 28012 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:20.856756 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:20.857563 25759 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:20.858297 27997 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.858814 27997 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.831893 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:20.834295 28048 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:20.834969 28050 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:20.840548 27974 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:20.842888 28008 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.811209 27902 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:20.860498 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.863165 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 141036us
W20260709 12:10:20.876092 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 166302us
I20260709 12:10:20.724049 28016 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.892638 28016 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.894635 28048 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:20.832697 28031 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.840409 27926 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.886530 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54759.7us
I20260709 12:10:20.890424 28055 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:20.896374 25619 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:20.865600 27982 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:20.932816 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:20.948678 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 230866us
W20260709 12:10:21.006604 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58190.6us
I20260709 12:10:20.881516 27902 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.008095 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52366.3us
I20260709 12:10:21.022650 27882 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:21.049602 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 152444us
W20260709 12:10:21.147658 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.151234 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:21.123143 28033 consensus_meta.cc:287] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.528s	user 0.015s	sys 0.009s
I20260709 12:10:21.185186 27902 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.130502 28010 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.896194 28012 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.204473 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:21.219486 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 68403.4us
W20260709 12:10:21.221763 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.227602 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:21.095238 27975 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.003s
I20260709 12:10:21.092824 27974 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:21.203109 27882 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:21.127523 28018 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:21.319836 27826 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:21.235841 27975 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.220726 28033 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.330363 28033 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:21.264205 27997 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:21.265956 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.231086 28036 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:20.896791 28050 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.344794 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:21.229879 28031 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:21.315963 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 77262.4us
I20260709 12:10:21.316161 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:21.366187 25768 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.316664 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:21.367877 25765 raft_consensus.cc:2368] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
W20260709 12:10:21.317104 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.317232 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89763.5us
I20260709 12:10:21.225468 27861 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.375633 25761 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:10:21.318315 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 443391us
I20260709 12:10:21.022953 28019 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.209s
I20260709 12:10:21.320456 25766 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.320349 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:21.391351 25762 raft_consensus.cc:2410] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:21.327176 27826 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:21.393822 27826 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:21.263547 27882 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:21.241408 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.335556 28036 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:21.341215 28051 consensus_meta.cc:287] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.524s	user 0.025s	sys 0.028s
I20260709 12:10:21.321120 27895 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.341850 27969 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.395052 28051 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:21.397882 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.399910 27902 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.345659 25763 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:21.375528 28021 consensus_meta.cc:287] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.807s	user 0.013s	sys 0.009s
I20260709 12:10:21.357812 25692 raft_consensus.cc:606] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:21.379993 28050 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:21.381286 28048 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:21.381585 27971 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.000s
I20260709 12:10:21.385700 27975 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:21.317440 27968 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.419708 25657 leader_election.cc:400] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:21.421562 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:21.388440 28038 consensus_meta.cc:287] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.620s	user 0.013s	sys 0.014s
I20260709 12:10:21.338632 27974 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.412791 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:21.391352 28029 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.627s	user 0.014s	sys 0.011s
I20260709 12:10:21.455056 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:21.420430 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:21.425622 25768 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:21.418900 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:21.421572 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:21.409893 25610 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:21.447186 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75947.5us
I20260709 12:10:21.453715 25612 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.415385 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:21.418391 28015 consensus_meta.cc:287] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.013s
I20260709 12:10:21.503118 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:21.503782 25616 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.503507 28015 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.505825 28015 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:21.507998 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1223) took 1067 ms. Trace:
I20260709 12:10:21.508284 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:21.508953 25685 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:21.508553 25766 rpcz_store.cc:276] 0709 12:10:20.440409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.446366 (+  5957us) service_pool.cc:224] Handling call
0709 12:10:21.016384 (+570018us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:21.148143 (+131759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.390646 (+242503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.507771 (+117125us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b540003aa54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:21.507940 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227143808}
W20260709 12:10:21.482965 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.413844 27861 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:21.446954 27897 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.680s	user 0.020s	sys 0.004s
I20260709 12:10:21.499986 27974 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:21.412885 28025 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:21.419632 28056 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:21.416196 28021 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.500941 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:21.406678 28016 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.446704 27961 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.646s	user 0.017s	sys 0.012s
I20260709 12:10:21.502310 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:21.492820 28038 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.511077 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:21.512933 25615 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:10:21.403170 27969 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:21.513413 25616 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:21.599556 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:21.515722 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:21.600500 25618 raft_consensus.cc:2368] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:21.600626 25693 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:21.516525 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:21.523679 25612 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:21.515864 27861 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.525007 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:21.524705 27897 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.444159 27971 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.528931 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:21.542500 25617 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:21.403425 28051 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:21.525971 28025 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.492283 28029 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.402230 27902 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:21.578630 25613 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:21.451220 27926 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:21.599316 25685 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:21.759196 28019 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.749450 25610 raft_consensus.cc:1813] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:22.297101 25610 raft_consensus.cc:2410] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 5 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:22.296881 27926 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.750475 25760 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.577771 27974 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:22.301762 27974 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.300642 27926 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.305927 27974 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:21.599912 27961 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.308074 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:22.308895 25612 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:22.309062 27961 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:21.863731 27982 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.309967 27982 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.262547 25764 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:21.825830 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.263036 28029 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.319394 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1236) took 1711 ms. Trace:
I20260709 12:10:21.760494 28056 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:21.689742 28071 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:10:21.773866 27975 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:22.211355 27902 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.903805 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.328406 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:22.065080 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.759593 27984 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.084909 28038 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:22.049203 27882 consensus_meta.cc:287] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.002s
I20260709 12:10:21.597707 28016 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:21.500420 28010 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.319921 25764 rpcz_store.cc:276] 0709 12:10:20.607735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.608275 (+   540us) service_pool.cc:224] Handling call
0709 12:10:22.262050 (+1653775us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:22.262300 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.318729 (+ 56429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.319314 (+   585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4826368}
I20260709 12:10:22.327284 25612 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:22.330085 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:22.272922 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.339010 25691 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:22.254391 27897 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:22.340570 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.315007 27982 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.253403 27971 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.325699 27961 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.328382 28050 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.332355 27975 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:22.347828 28050 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:22.349862 27975 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:22.340222 25686 raft_consensus.cc:2376] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:22.351024 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.342892 27926 raft_consensus.cc:476] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:22.353256 28016 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.349866 28050 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:22.358078 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.353286 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:22.331874 28030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.018s
I20260709 12:10:22.346061 27974 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:22.337826 27984 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.326004 28019 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.341187 28048 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:22.361368 28030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.008s	sys 0.019s
I20260709 12:10:22.365989 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.367828 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.336369 27882 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.334697 27902 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.340313 28038 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.370983 25691 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 2.
I20260709 12:10:22.357043 27961 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.369163 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:22.378609 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:22.379514 25686 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.383961 25610 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:22.387391 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:22.379235 28058 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.392333 28017 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.369361 27974 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.372120 28048 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.398562 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:22.401422 25691 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:22.405961 27974 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.417785 27974 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:22.418139 25686 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:22.419716 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.418756 27974 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.420429 25686 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:22.397786 28038 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.421542 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.421777 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.423225 25691 raft_consensus.cc:1813] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:22.448483 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.455523 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:22.455945 25767 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:22.456235 25686 raft_consensus.cc:606] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:22.456429 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.456883 25691 raft_consensus.cc:2393] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:22.458799 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.459960 25766 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:22.460052 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:22.460912 25764 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:22.426615 27982 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.435562 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.474689 25768 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:22.456684 25686 raft_consensus.cc:614] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.479749 25764 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:22.480278 25614 raft_consensus.cc:2368] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6.
I20260709 12:10:22.541900 25762 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:22.549216 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.551249 25767 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:22.397836 28058 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.564842 28083 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:22.574951 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.583380 25768 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:22.575013 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.420823 27971 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.602896 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.603758 25763 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:22.603906 25766 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:22.602699 28083 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:22.573998 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1103) took 1150 ms. Trace:
I20260709 12:10:22.607318 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.607578 25619 rpcz_store.cc:276] 0709 12:10:21.424014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.281512 (+857498us) service_pool.cc:224] Handling call
0709 12:10:22.282074 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.306697 (+ 24623us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:22.403930 (+ 97233us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.573419 (+169489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.573520 (+   101us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.573604 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.573716 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.573906 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96687,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":137,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":264741,"threads_started":2,"wal-append.queue_time_us":168920}
I20260709 12:10:22.631718 28087 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.632355 28087 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.635778 28088 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:22.637326 28087 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.636795 28088 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.640324 28088 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.640920 28087 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.641855 28087 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.644133 28087 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.601964 27984 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.648811 28088 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:22.655864 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.656607 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.656965 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:22.657588 25614 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:22.663870 28069 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 1.104s	user 0.004s	sys 0.012s
I20260709 12:10:22.665752 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.666519 28056 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.666661 25689 raft_consensus.cc:1813] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:22.667578 25689 raft_consensus.cc:2410] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:22.668135 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1132) took 1162 ms. Trace:
I20260709 12:10:22.668553 25689 rpcz_store.cc:276] 0709 12:10:21.506088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.507895 (+  1807us) service_pool.cc:224] Handling call
0709 12:10:22.665531 (+1157636us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36e9c 00007fbdafc36a5b 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:22.668054 (+  2523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722856832}
I20260709 12:10:22.671506 25766 pending_rounds.cc:85] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 2
I20260709 12:10:22.671947 25766 pending_rounds.cc:107] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:10:22.672190 25766 raft_consensus.cc:2889] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.513937 27982 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.691262 25689 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:22.694434 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1159) took 1110 ms. Trace:
I20260709 12:10:22.695114 25689 rpcz_store.cc:276] 0709 12:10:21.584410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.669998 (+1085588us) service_pool.cc:224] Handling call
0709 12:10:22.688377 (+ 18379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.693962 (+  5585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.694343 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:22.697921 27823 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.698683 27823 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.701170 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:22.701890 25693 raft_consensus.cc:2376] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
W20260709 12:10:22.702461 25693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1153) took 1181 ms (client timeout 1566 ms). Trace:
I20260709 12:10:22.702013 27823 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:22.702898 25693 rpcz_store.cc:269] 0709 12:10:21.521000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.694412 (+173412us) service_pool.cc:224] Handling call
0709 12:10:22.701004 (+1006592us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:22.702397 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26566528}
I20260709 12:10:22.695703 28083 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:22.691885 28088 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:22.717032 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.691521 28078 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:10:22.626900 27971 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:22.731887 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.746863 25658 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:22.749311 25658 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:22.755421 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45158.4us
I20260709 12:10:22.765614 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:22.777486 25658 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:22.744166 27961 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.783628 27816 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:22.751973 28019 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.763042 28038 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.781405 27957 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:22.787089 28011 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.799327 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:22.763224 28087 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:22.785688 28084 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.804301 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:22.791390 27816 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:22.799769 27861 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.041s	user 0.009s	sys 0.006s
I20260709 12:10:22.805759 25767 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.811175 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.815920 25694 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:22.817360 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1137) took 1307 ms. Trace:
I20260709 12:10:22.801507 28011 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.858626 28011 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.864311 28025 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.801623 28038 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:22.870930 25768 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:22.871387 25768 pending_rounds.cc:85] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 4
I20260709 12:10:22.871601 25768 pending_rounds.cc:107] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:22.871637 28038 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:22.871847 25768 raft_consensus.cc:2889] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.811290 27974 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.874599 27902 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.876036 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1714) took 1278 ms. Trace:
I20260709 12:10:22.806835 28084 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:22.909507 28084 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.820711 28010 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:22.820991 27926 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:22.821465 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:22.982822 25765 raft_consensus.cc:2368] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:22.821516 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.818177 25694 rpcz_store.cc:276] 0709 12:10:21.510237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.511804 (+  1567us) service_pool.cc:224] Handling call
0709 12:10:22.808869 (+1297065us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:22.817298 (+  8429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22905216}
I20260709 12:10:22.817126 28083 raft_consensus.cc:2764] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:22.817318 27957 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:22.827162 25759 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:22.829252 28086 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:23.028467 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.029455 25765 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.835856 27816 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.836958 28048 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.838225 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1709) took 1373 ms. Trace:
I20260709 12:10:22.835887 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:22.841373 25612 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:22.842332 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:22.862241 27882 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.843366 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:22.845145 28021 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.846668 27971 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.846997 27861 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.847777 27968 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:22.849089 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.849357 28088 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:22.851213 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.855306 27997 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.855377 25614 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:22.856262 28058 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:22.858036 27982 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:22.877357 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:22.880858 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1710) took 1386 ms. Trace:
I20260709 12:10:22.891223 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:22.894932 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1224) took 2454 ms. Trace:
I20260709 12:10:22.819670 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:22.958693 25516 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 3 to 5, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 2 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:22.933768 27902 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.938881 25657 connection.cc:256] RPC call timeout handler was delayed by -1.6080606319999333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
I20260709 12:10:22.961781 28025 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:22.938973 28034 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.966192 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:22.938958 25767 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
W20260709 12:10:22.936034 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.935432 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:22.941715 28011 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:22.854072 25761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1438) took 2946 ms (client timeout 2630 ms). Trace:
I20260709 12:10:22.901551 25610 rpcz_store.cc:276] 0709 12:10:21.597919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.302653 (+704734us) service_pool.cc:224] Handling call
0709 12:10:22.303007 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.384470 (+ 81463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.875783 (+491313us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b5400361ad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:22.875972 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185697664}
W20260709 12:10:22.987275 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.469s (SENT) [suppressed 19 similar messages]
I20260709 12:10:23.009990 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.010910 25763 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:23.014240 25583 connection.cc:256] RPC call timeout handler was delayed by -1.1464042559998688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 12:10:23.014763 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.010780 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1100) took 1587 ms. Trace:
I20260709 12:10:23.035569 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1155) took 1452 ms. Trace:
I20260709 12:10:23.041085 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:22.843199 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.043469 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1101) took 1619 ms. Trace:
I20260709 12:10:23.011061 28010 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.039750 25615 rpcz_store.cc:276] 0709 12:10:21.464530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.817639 (+1353109us) service_pool.cc:224] Handling call
0709 12:10:22.837625 (+ 19986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.837854 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.837880 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.837933 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:22.837977 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.838033 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.838164 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.041543 28086 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:22.982372 27926 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.048712 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.094949 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1150) took 1574 ms. Trace:
I20260709 12:10:23.159363 25616 rpcz_store.cc:276] 0709 12:10:21.495233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.880007 (+1384774us) service_pool.cc:224] Handling call
0709 12:10:22.880322 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.880497 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.880520 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.880566 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:22.880595 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.880677 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.880793 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.160451 25611 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:23.161893 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1106) took 1711 ms. Trace:
I20260709 12:10:23.162195 25764 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:23.115420 25765 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
W20260709 12:10:23.099594 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 332048us
I20260709 12:10:23.163097 25613 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.160852 25687 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:23.159864 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:23.163241 25762 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:23.162245 25686 rpcz_store.cc:276] 0709 12:10:21.583358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.878386 (+1295028us) service_pool.cc:224] Handling call
0709 12:10:22.878730 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.878989 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:22.879285 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.035196 (+155911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.035253 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.035306 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.035376 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.035506 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2360,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":93,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4966,"thread_start_us":155474,"threads_started":1}
I20260709 12:10:23.160140 25618 rpcz_store.cc:276] 0709 12:10:21.423268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.857341 (+1434073us) service_pool.cc:224] Handling call
0709 12:10:22.857794 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.858067 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:22.925017 (+ 66950us) log.cc:844] Serialized 14 byte log entry
0709 12:10:23.010373 (+ 85356us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.010445 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.010495 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.010569 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.010720 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6119,"prepare.queue_time_us":79107,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":125,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":17364,"thread_start_us":37889,"threads_started":1}
I20260709 12:10:23.050808 25582 leader_election.cc:400] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.168169 25582 leader_election.cc:403] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:10:23.168726 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 118066us
I20260709 12:10:23.170639 28025 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.171618 27974 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.172201 27974 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.172216 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.174398 28034 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.174989 27974 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.175917 28017 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:23.176651 28034 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.177449 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.162410 25611 rpcz_store.cc:276] 0709 12:10:21.479088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.842794 (+1363706us) service_pool.cc:224] Handling call
0709 12:10:23.161815 (+319021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.178238 25767 raft_consensus.cc:2368] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.178714 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.179139 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.179719 25767 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:23.180099 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:23.060295 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.181252 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1139) took 1668 ms. Trace:
I20260709 12:10:23.182353 25688 raft_consensus.cc:2368] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
W20260709 12:10:23.159340 25761 rpcz_store.cc:269] 0709 12:10:19.917936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.985578 (+ 67642us) service_pool.cc:224] Handling call
0709 12:10:22.853645 (+2868067us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400165654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:22.853914 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005028096}
I20260709 12:10:23.182632 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.160216 25617 rpcz_store.cc:276] 0709 12:10:21.423544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.835459 (+1411915us) service_pool.cc:224] Handling call
0709 12:10:23.043397 (+207938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.183463 25768 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:23.163383 25760 rpcz_store.cc:276] 0709 12:10:20.440728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.446465 (+  5737us) service_pool.cc:224] Handling call
0709 12:10:20.879071 (+432606us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:20.879361 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.301050 (+1421689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.894630 (+593580us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b5400165b54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:22.894826 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006613632}
I20260709 12:10:23.187753 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:23.184034 25687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1135) took 1656 ms (client timeout 1560 ms). Trace:
I20260709 12:10:23.188704 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:23.188901 25687 rpcz_store.cc:269] 0709 12:10:21.509581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.509955 (+   374us) service_pool.cc:224] Handling call
0709 12:10:22.848878 (+1338923us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:23.165422 (+316544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26006784}
W20260709 12:10:23.184804 25692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1149) took 1662 ms (client timeout 1533 ms). Trace:
I20260709 12:10:23.189895 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:23.190306 25692 rpcz_store.cc:269] 0709 12:10:21.520104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.693473 (+173369us) service_pool.cc:224] Handling call
0709 12:10:22.890987 (+1197514us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:23.182212 (+291225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25048960}
I20260709 12:10:23.191008 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.191499 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:23.185446 25688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1140) took 1670 ms (client timeout 2056 ms). Trace:
I20260709 12:10:23.181613 25690 rpcz_store.cc:276] 0709 12:10:21.514405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.514527 (+   122us) service_pool.cc:224] Handling call
0709 12:10:22.851011 (+1336484us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:23.181187 (+330176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26190720}
W20260709 12:10:23.186080 25685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1144) took 1668 ms (client timeout 1619 ms). Trace:
I20260709 12:10:23.186084 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:23.186569 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 366982us
W20260709 12:10:23.193076 25688 rpcz_store.cc:269] 0709 12:10:21.514724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.514847 (+   123us) service_pool.cc:224] Handling call
0709 12:10:22.877186 (+1362339us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:10:23.185385 (+308199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32606976}
W20260709 12:10:23.198501 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.202615 25767 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:23.174033 28025 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:23.204815 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 217314us
W20260709 12:10:23.194628 25685 rpcz_store.cc:269] 0709 12:10:21.517837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.009597 (+1491760us) service_pool.cc:224] Handling call
0709 12:10:23.185997 (+176400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.159799 25691 rpcz_store.cc:276] 0709 12:10:21.520341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.602226 (+1081885us) service_pool.cc:224] Handling call
0709 12:10:22.651464 (+ 49238us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:22.652014 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.652058 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:22.656635 (+  4577us) log.cc:844] Serialized 52 byte log entry
0709 12:10:22.927812 (+271177us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:22.937418 (+  9606us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.937823 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.937998 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.938080 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.094612 (+156532us) raft_consensus.cc:1685] finished
0709 12:10:23.094643 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.094858 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10604,"prepare.queue_time_us":9872,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1635,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":57659,"thread_start_us":221710,"threads_started":1,"wal-append.queue_time_us":346534}
I20260709 12:10:23.047813 28056 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:23.212002 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:23.224220 25616 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:23.213240 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.214150 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:23.227005 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.210321 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:23.227737 25689 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:23.211287 25610 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:23.222832 25732 connection.cc:256] RPC call timeout handler was delayed by -1.4067091370000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 12:10:23.099639 28079 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.211915 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.229355 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.229689 25760 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.217705 25613 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:23.220629 25617 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:23.230954 25613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1712) took 1657 ms (client timeout 2111 ms). Trace:
I20260709 12:10:23.221200 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.233141 25686 raft_consensus.cc:2368] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.227837 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.238576 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:23.238924 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.239647 25693 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:23.231344 25613 rpcz_store.cc:269] 0709 12:10:21.573805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.965843 (+1392038us) service_pool.cc:224] Handling call
0709 12:10:23.230883 (+265040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:23.246029 25760 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:23.178996 27984 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:23.185177 27902 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.254416 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.254776 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:23.256142 25658 leader_election.cc:400] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6.
I20260709 12:10:23.256410 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.256577 25685 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.256817 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:23.257534 25764 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:23.273978 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.273856 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.275563 25686 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.274721 25618 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:23.276515 25658 leader_election.cc:403] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:23.258276 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:23.259019 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 99175.4us
I20260709 12:10:23.260705 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.197428 25516 catalog_manager.cc:5697] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 4 to 5, term changed from 2 to 5, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132), VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 5 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:23.260426 25759 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:23.226584 28034 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.196476 28058 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:23.296185 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.251022 28061 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.205983 28090 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:23.299723 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:23.300524 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 63313us
I20260709 12:10:23.312816 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:23.307133 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.300838 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:23.304152 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 97285.5us
I20260709 12:10:23.243875 27882 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.256489 27982 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.184620 27968 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:23.097235 27957 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.316872 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.309109 28025 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:23.433414 25759 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:23.304361 27895 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.320175 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.435791 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.420807 25687 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:23.436082 25688 raft_consensus.cc:2368] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.437271 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.438320 25610 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:23.422483 25689 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:23.400069 25686 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:23.438756 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.437209 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.392190 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:23.295722 27997 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.439306 25689 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:23.433701 28025 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.417977 28030 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:10:23.450814 28025 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.364838 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.446861 25762 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:23.259403 28056 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:23.453114 28025 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:23.445613 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.455046 25619 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:23.257359 28079 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.295266 27974 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.295042 27971 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:23.467660 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.467779 25658 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:23.468374 25614 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:23.462432 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:23.441169 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:23.300166 28038 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:23.307962 27823 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:23.474642 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.431391 28017 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:23.475287 25611 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:23.384768 28081 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:23.471431 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.302901 28098 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:23.310724 27946 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
I20260709 12:10:23.476800 25760 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:23.430554 28090 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:23.478762 25766 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.392642 28058 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:23.382658 27984 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:23.456034 28056 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:23.475749 25689 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.505182 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.474460 28034 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:23.315001 28061 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.393030 28084 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:23.515658 25689 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.475183 27971 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.520141 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.524639 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.456840 27982 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.479995 28017 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:23.464188 27997 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.470814 27974 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.511307 28081 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:23.530932 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.515604 28110 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:23.496769 27823 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.538301 25694 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.537391 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.528192 28034 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:23.507333 28038 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:23.547691 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.550642 25691 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:23.553226 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.554316 25688 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:23.535163 28010 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.533344 28011 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.512975 28098 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:23.541091 27861 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.518378 27984 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:23.544659 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.563566 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.566623 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:23.565820 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.568181 25611 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:23.570593 25611 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:23.571955 27982 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.572067 27971 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.572582 27982 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:23.572999 27982 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:23.573395 27982 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.575652 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.576469 25763 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:23.561554 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 120489us
I20260709 12:10:23.570761 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.577895 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.584932 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.574211 27974 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.565057 28090 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.586881 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:23.574996 28096 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:10:23.587890 25615 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:23.588070 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.561564 28017 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.589037 28017 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.589499 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:23.564339 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 124715us
I20260709 12:10:23.594585 28115 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.595573 27974 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:23.596305 25583 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.632s (SENT)
I20260709 12:10:23.596789 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.597465 25615 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.599750 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.600260 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.602311 25619 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:23.603099 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.605129 25610 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.600073 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.606966 25615 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:23.610247 27968 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:23.611982 27823 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.612542 25762 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:23.616154 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.616346 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.619626 25767 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:23.620185 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:23.616266 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.613612 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.622629 25762 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:23.622987 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.623580 25686 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.616231 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.625183 25768 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.621548 25692 raft_consensus.cc:2376] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:10:23.638095 28098 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:23.639183 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.640463 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.640740 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.641315 25687 raft_consensus.cc:2376] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:10:23.641619 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.642174 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.642736 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.642988 28079 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.643429 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.643883 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.644454 25692 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 3.
I20260709 12:10:23.645392 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.544926 28110 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.647008 25689 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:23.647383 25689 pending_rounds.cc:85] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 4
I20260709 12:10:23.647598 25689 pending_rounds.cc:107] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:23.647778 28110 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.556382 28058 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.652033 25685 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:23.653064 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.647823 25689 raft_consensus.cc:2889] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:23.644908 28081 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.654215 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.661408 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.642844 25687 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:23.655267 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.640493 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.665985 25688 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:23.667200 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.668466 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.669287 25760 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:23.670439 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.675302 25768 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:23.679754 25767 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:23.681030 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.682776 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.689169 25760 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:23.690927 25768 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:23.692180 25760 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:23.701682 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:23.702541 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82446.6us
I20260709 12:10:23.703703 25582 leader_election.cc:400] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.704084 25582 leader_election.cc:403] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:10:23.704592 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 108308us
I20260709 12:10:23.706501 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.706918 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:23.708567 25732 leader_election.cc:336] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.547s (SENT)
I20260709 12:10:23.623965 28086 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:23.710929 25732 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.566s (SENT)
I20260709 12:10:23.654645 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.655546 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.711701 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.711856 25761 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.681994 28079 raft_consensus.cc:476] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:23.719589 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:23.720397 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:23.688634 27861 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.721170 28112 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.712173 28114 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:23.712706 25732 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.582s (SENT)
I20260709 12:10:23.727881 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:23.716809 25686 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:23.722043 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:23.726568 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.731917 25615 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:23.732514 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:23.734242 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.744586 25583 leader_election.cc:400] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7.
I20260709 12:10:23.738511 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.655299 27982 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.740113 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.740504 25768 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.743151 25691 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:23.745965 25732 leader_election.cc:336] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.619s (SENT)
W20260709 12:10:23.764256 25732 leader_election.cc:336] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.639s (SENT)
I20260709 12:10:23.764767 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.740904 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:23.767227 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.768081 25692 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:23.747568 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.738963 28084 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:23.773955 28117 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:23.778290 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.759496 25686 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:23.786764 25732 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.715s (SENT)
I20260709 12:10:23.787511 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.790199 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.790719 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:23.790794 25732 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.791s (SENT)
I20260709 12:10:23.791597 25612 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.791605 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.735342 28061 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:23.808979 25732 leader_election.cc:336] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.851s (SENT)
I20260709 12:10:23.756870 28017 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:23.755131 28079 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:23.738816 28116 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.817431 25768 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:23.823398 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.741158 28038 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:23.756955 28056 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:10:23.838665 28056 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:23.839341 28056 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:23.840508 28056 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.789271 27895 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6.
I20260709 12:10:23.832192 27997 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.795614 28117 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.783022 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.841208 27984 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.845485 25612 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:23.847540 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:23.824985 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52923.3us
I20260709 12:10:23.824548 28017 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.806984 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:23.808894 28010 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.855960 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:23.864012 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 121992us
I20260709 12:10:23.868857 28017 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.876468 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:23.881225 27984 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.842180 28056 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.882885 25583 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.741894 28034 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.832335 28058 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:23.891696 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 166133us
I20260709 12:10:23.887909 28128 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:23.888509 27982 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.887143 27861 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:23.894758 27926 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.895252 27861 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.897450 27861 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.891212 28038 raft_consensus.cc:2764] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:23.893148 28079 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:23.893935 28128 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.903177 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.844928 28114 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:23.907701 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.904665 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.908515 25690 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:23.909211 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.910600 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.917387 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.850741 28121 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:23.919348 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.919351 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.916396 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:23.922870 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.924072 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.924957 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:23.925031 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:23.926482 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:23.927079 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:23.927805 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:23.929626 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:23.929666 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.932366 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:23.936820 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:23.936930 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.938067 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.939214 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.940445 25692 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.844987 28116 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.936277 27926 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.940037 27982 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:23.949416 27982 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.949864 27982 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.950505 28058 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:23.951939 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.953083 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.954334 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:23.955444 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.956108 25686 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:23.957170 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:23.957445 25644 heartbeater.cc:646] Failed to heartbeat to 127.23.222.190:33735 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.222.190:33735 timed out after 15.000s (SENT)
I20260709 12:10:23.957892 25686 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:23.942821 27957 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:23.936182 28090 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.958937 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.918359 28079 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:23.959539 25686 raft_consensus.cc:2376] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7. Re-sending same reply.
I20260709 12:10:23.960378 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.961170 28128 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.949549 27981 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:23.943202 28126 raft_consensus.cc:2764] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:23.923909 27895 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.965559 25692 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:23.924041 27823 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.963016 25686 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:23.971951 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.941157 28086 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:23.936023 28084 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:23.936378 27971 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.974931 25657 leader_election.cc:400] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:23.940927 27984 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.981846 27984 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:23.982374 27984 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.982771 28114 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:23.976227 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.980772 28116 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:23.966763 28133 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:23.936084 28061 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:23.996203 28133 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:23.996767 28133 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:23.997211 27902 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:23.997973 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1251) took 1152 ms. Trace:
I20260709 12:10:23.998477 25764 rpcz_store.cc:276] 0709 12:10:22.845338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.302676 (+457338us) service_pool.cc:224] Handling call
0709 12:10:23.331750 (+ 29074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:23.729085 (+397335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.729116 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:23.729582 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:10:23.942194 (+212612us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:23.942234 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.942328 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:23.997706 (+ 55378us) raft_consensus.cc:1685] finished
0709 12:10:23.997727 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:23.997889 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":231587,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8908,"thread_start_us":535046,"threads_started":2,"wal-append.queue_time_us":212105}
I20260709 12:10:23.976203 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:23.982017 28011 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:23.923821 28010 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:24.008221 28117 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:23.992573 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71385.6us
I20260709 12:10:24.001766 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:23.987529 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.002478 25686 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:23.986159 27971 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.004832 28034 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:24.012413 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.013947 25692 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:24.014078 27971 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.024004 28062 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:24.002796 28133 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.027455 28034 consensus_queue.cc:1243] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:24.010448 28017 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.029589 27984 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:24.031208 27982 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.033161 27823 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.043073 28126 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:24.062060 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60392.3us
I20260709 12:10:24.069657 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:23.518007 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:24.067487 27982 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:24.070643 28083 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:24.050791 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 122572us
I20260709 12:10:24.071753 28086 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.072569 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:24.082712 28086 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:24.083120 27882 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.083396 28086 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.083657 27882 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:24.074697 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.084148 27882 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.061268 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.052961 28062 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:24.080406 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1255) took 1045 ms. Trace:
I20260709 12:10:24.085003 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.086246 28062 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.083309 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:24.089720 28062 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.090471 28056 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.090874 28056 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.091215 28056 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.092206 28017 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.086762 25583 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.093926 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.094753 27823 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.086926 28126 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.095391 27823 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.086941 28011 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.096776 28011 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.097129 28011 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.096239 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:24.087082 25759 rpcz_store.cc:276] 0709 12:10:23.035275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.447923 (+412648us) service_pool.cc:224] Handling call
0709 12:10:23.474220 (+ 26297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.697070 (+222850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:23.697114 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:23.697172 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:23.697244 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.899584 (+202340us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4800120258. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:10:24.080045 (+180461us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b54000afad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:24.080129 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.080318 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":975,"raft.queue_time_us":66729,"raft.run_cpu_time_us":2390,"raft.run_wall_time_us":326970,"spinlock_wait_cycles":78547968,"thread_start_us":189888,"threads_started":1}
I20260709 12:10:24.100558 28126 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:24.101454 28126 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:24.102905 28126 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.106559 28084 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.110285 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.096180 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.114007 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.116837 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.120277 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.081243 28083 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.123688 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.125028 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.127508 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.128309 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.128654 25760 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.127883 25761 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:24.129889 25615 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.132076 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.133999 28098 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.137519 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.142396 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.147137 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.149394 28098 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.150578 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:24.152096 28137 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.152647 28137 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.154120 28114 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.154479 28010 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.154815 28114 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.156093 28109 consensus_queue.cc:1059] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:24.157872 28109 raft_consensus.cc:3055] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.129488 28061 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.125443 28136 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.108055 28084 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:24.148408 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.165896 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.166436 25759 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:24.167449 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.168390 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.169693 25762 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:10:24.173418 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.187363 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73434.9us
I20260709 12:10:24.188292 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.171674 25760 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:24.172343 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.199636 25583 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.161788 28084 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.161748 28109 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:24.171416 27902 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.171029 28098 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.186007 28121 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.185253 27997 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.186841 28061 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:24.221400 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49100.6us
I20260709 12:10:24.225528 28109 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:24.227193 28137 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.207434 27982 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:24.230779 25761 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:24.232856 28128 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.234227 27984 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:24.235172 25686 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:24.257025 25686 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:24.245965 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.198186 28019 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.212837 27974 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.258137 25686 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.262141 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.238013 28086 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.277333 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.286216 25686 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.241636 27971 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:24.267030 27997 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.275386 28109 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.268905 28137 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.279134 28121 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:24.301769 26303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.348366 25686 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:24.348534 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71324.4us
I20260709 12:10:24.261044 27982 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.356189 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.359710 25767 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:24.292546 28114 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.270292 28056 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.297484 27974 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:24.364471 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.363878 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:24.367564 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:24.353164 28115 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:24.372290 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.372486 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.373034 25618 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:24.373939 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.373957 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.374296 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.375543 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.376363 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.376652 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.377562 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:24.377873 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.375478 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.364269 27997 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.383786 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.383388 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.384752 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.386973 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.387308 25618 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.388554 28011 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.390878 28011 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.381758 27816 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:24.392773 27816 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.394966 27816 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.395313 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.396982 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.398643 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.399317 27926 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:24.399533 25611 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:24.400341 28141 log.cc:927] Time spent T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 12:10:24.401970 28142 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:10:24.404518 28056 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.405897 28086 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:24.406462 28146 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:10:24.395494 28152 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:24.369779 27902 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:24.369192 28121 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:24.416796 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 217235us
I20260709 12:10:24.418737 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.420725 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:24.421654 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.422212 25694 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:24.423318 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.424656 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.425172 25616 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.426580 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.427783 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.428797 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.429373 25617 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:24.430055 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.431115 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.432127 25613 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:24.430150 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.433398 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.433794 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.434720 25685 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:24.434880 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.436187 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.433717 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.435899 25617 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:24.437009 25611 raft_consensus.cc:2368] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:24.437599 25694 raft_consensus.cc:2410] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:24.437887 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.439090 27926 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:24.454979 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:24.469537 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 48934.8us
I20260709 12:10:24.411624 28152 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:24.414978 28079 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.440357 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:24.441535 28090 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:24.433437 25613 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:24.494366 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.386729 28021 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.446545 27974 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.452487 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.498999 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.499284 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.499044 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.500140 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.452565 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.454319 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.462749 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.417821 27902 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:24.469789 25616 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:24.469792 25685 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:24.471807 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.476663 25615 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:24.480409 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.488055 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.491489 25614 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:24.436770 28144 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:24.495011 25689 raft_consensus.cc:2376] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7. Re-sending same reply.
I20260709 12:10:24.451572 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.500262 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.412922 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.379626 28115 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.455651 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.503435 25693 raft_consensus.cc:2368] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:24.419611 28121 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:24.366916 28061 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.515868 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:24.518229 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 105387us
I20260709 12:10:24.525579 25764 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:24.526367 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.529644 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.490801 28079 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.527019 28025 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:24.531495 28038 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:24.512411 25618 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:24.538408 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:24.504585 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:24.507946 27902 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:24.550105 27926 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.533074 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.520249 28048 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.526546 28117 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.504007 28102 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:24.524590 28121 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:24.537156 28010 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.543231 28079 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.547781 28152 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.559894 27984 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:24.578253 28152 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.580338 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:24.577713 27971 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:24.520591 28148 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:10:24.583544 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67784.8us
I20260709 12:10:24.591342 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:24.531782 27997 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:24.554392 27823 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:10:24.596804 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 134860us
I20260709 12:10:24.560514 28117 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:24.557717 27882 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:24.632652 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 99633us
I20260709 12:10:24.635418 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.637768 25732 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:24.641851 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 50651.5us
I20260709 12:10:24.570108 28090 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:24.643596 25583 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.594017 28081 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:24.647562 27971 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.599129 28038 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.600548 28025 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.605054 28117 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.600770 27984 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:24.651482 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.601151 28109 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.603837 27982 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:24.652020 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:24.664816 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:24.631419 28137 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.646584 28010 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.675123 25583 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.648995 28151 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.666668 28109 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:24.679061 27982 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.685171 28038 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:24.680493 28151 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:24.712801 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:24.662104 28081 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.699610 28058 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.695327 28112 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.716456 25583 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:24.673877 28137 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:24.720819 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 68931.3us
I20260709 12:10:24.721490 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:24.732422 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.733636 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.733942 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.734854 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.736091 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.734237 25686 raft_consensus.cc:2376] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6. Re-sending same reply.
I20260709 12:10:24.740217 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.741195 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.743423 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.711611 27982 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.733258 25694 raft_consensus.cc:2376] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:10:24.756523 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.756935 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.757360 25686 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:24.757989 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.754805 25687 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:24.755312 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:24.759842 25692 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.728590 28025 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:24.778985 28025 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:24.779912 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.786031 25763 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:24.786006 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.786914 25760 raft_consensus.cc:2393] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:24.766618 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.775151 25694 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:24.773773 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.774555 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:24.794981 25688 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:10:24.778461 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.715468 28151 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.767381 25761 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:24.724996 28038 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:24.784358 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.726991 28128 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.804620 28025 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:24.784046 25583 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.810981 25690 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:24.813050 25583 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:24.755988 28158 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:10:24.783903 28126 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:24.820297 28128 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.721217 27984 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.820335 28126 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.823271 28126 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.816387 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.761924 27982 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.803270 28038 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.730967 27861 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:10:24.823170 25693 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:24.747962 27816 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:24.781221 28062 consensus_meta.cc:287] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.003s
W20260709 12:10:24.825917 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 65237.7us
I20260709 12:10:24.715937 28084 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:24.830871 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.857055 25689 raft_consensus.cc:2410] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:24.858939 25693 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:24.859247 25583 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.819410 28112 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.861907 27823 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.864255 25658 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:24.865593 25658 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:24.866621 28062 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:24.761051 27895 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:24.836457 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.841799 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:24.749147 27926 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:24.775805 28098 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:24.779534 28160 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:24.847956 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.850881 25764 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:24.810150 28115 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:24.868525 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.879562 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:24.881970 25691 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.855744 28166 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:24.856868 28150 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.776573 28109 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:24.903165 28155 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:24.900061 28019 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.906325 28019 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:24.906749 28019 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.875801 28090 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:24.909340 28165 log.cc:927] Time spent T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:10:24.911514 27882 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:24.911827 28133 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.870373 27895 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.913060 27895 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.916183 28084 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:24.917093 28149 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.873063 28112 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.882673 28170 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.920606 28021 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:24.893460 28098 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.921120 28021 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.921339 27902 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.925515 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:24.890497 27926 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:24.931020 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.931432 25760 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:10:24.936044 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 271269us
I20260709 12:10:24.955607 25732 leader_election.cc:400] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:24.956000 25732 leader_election.cc:403] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:24.958525 28115 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:24.955860 28112 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.963781 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:24.888638 27974 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.968472 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.965871 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.970949 25764 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:24.967141 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:24.972767 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.977397 25765 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.979764 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:24.980614 25619 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:24.980371 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:24.967945 27882 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:24.984673 28149 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:24.985260 28149 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.985489 28079 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.988740 25759 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:24.981638 28166 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.991834 28166 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.996129 27926 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:24.998600 28149 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:24.978006 27997 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:25.000880 28025 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.003018 28081 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.003459 28121 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.004621 25762 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:24.975530 28102 consensus_queue.cc:1059] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:25.007342 28175 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.007505 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:25.008204 26337 raft_consensus.cc:1813] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:25.008873 26337 raft_consensus.cc:2410] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:25.011206 28149 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.010737 28021 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:25.012670 27982 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.016469 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:25.030002 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 161719us
I20260709 12:10:25.005776 28121 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:24.987941 28079 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:25.032212 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51991.4us
I20260709 12:10:25.042045 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.043825 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.046382 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.033543 28048 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.032723 28115 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:25.001880 28117 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.049237 28079 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.051126 28137 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:25.054531 28159 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.422s	user 0.003s	sys 0.001s
I20260709 12:10:25.061280 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:25.062924 25768 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:25.064347 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.066537 28166 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.044863 27974 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.068334 28021 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:25.069407 28025 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.096962 25764 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:25.032917 28151 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.099349 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.028348 28128 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:25.089154 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:25.113500 25766 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:25.094218 28019 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.047254 28121 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:25.099876 25761 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:25.101778 27895 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.119359 27895 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:25.122980 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.086194 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.081374 25762 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:25.107066 27982 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:25.079742 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:25.124171 28011 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:25.124991 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45390.9us
I20260709 12:10:25.124835 28011 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.126677 28081 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:25.127271 28081 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:25.129566 28019 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.130640 27895 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.131911 27895 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.132247 27895 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.133365 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.122821 27902 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:25.123746 28171 consensus_queue.cc:1059] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:25.130045 28081 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:25.099268 28117 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:25.134727 28171 raft_consensus.cc:3055] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.133368 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:25.136693 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 50630.9us
I20260709 12:10:25.137398 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:25.098163 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.139039 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.141669 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.144591 27982 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.146162 28117 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.148694 28011 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.154364 25732 leader_election.cc:400] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:25.154765 25732 leader_election.cc:403] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:25.161831 25658 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:25.163777 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.161306 28117 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.162494 28121 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:25.167248 28115 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:25.167845 28115 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:25.168785 28115 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.169346 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.170447 28179 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.140118 27902 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.171149 28179 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:25.172907 28081 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.160415 28088 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.135553 28171 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:25.177183 28166 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:25.177232 28171 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:25.178642 28098 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:25.178735 28171 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.182711 28148 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.183180 28148 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:25.183068 25658 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.188403 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.191403 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:25.195070 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:25.202419 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:25.205365 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.208148 25658 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.212761 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:25.220403 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.221704 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.223003 25687 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:25.223315 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.224280 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.224412 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.225119 25686 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:25.211735 28179 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:25.225891 28179 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:25.226323 28179 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.229449 25760 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:25.231760 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.221779 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.232788 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.233196 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.233388 25615 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.234887 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:25.235401 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.236660 25617 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:25.237723 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.244118 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.207715 28011 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.183725 28161 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:10:25.246480 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.246706 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.247383 25619 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:25.247824 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.248139 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.248713 25610 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:25.249996 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.250636 28084 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.251178 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.251296 28084 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.252279 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.253417 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:25.253665 28157 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.620s	user 0.000s	sys 0.005s
I20260709 12:10:25.253887 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:25.254531 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.254586 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:25.244522 28025 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:25.215633 28162 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:25.246213 28178 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:25.236780 28088 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:25.236512 28117 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.229352 28116 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:25.288836 28178 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.289570 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.296557 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.297235 25618 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:25.298243 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.298863 25618 raft_consensus.cc:1813] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Handling vote request from an unknown peer c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.215752 27984 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:25.258656 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.259153 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:25.262244 27823 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.263233 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.263514 25617 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.299510 25618 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:25.269477 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.275985 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:25.305995 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.302146 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:25.302834 25688 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:25.299750 28178 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.304702 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:25.266993 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.303916 25692 raft_consensus.cc:1813] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Handling vote request from an unknown peer 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:25.281085 28162 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:25.305061 25760 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:25.271632 28151 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.291142 25615 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:25.313225 25768 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:25.317641 25692 raft_consensus.cc:2393] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:25.310065 25613 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:25.344846 25615 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:10:25.310647 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.346850 25618 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:25.304093 25693 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.321247 28090 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.271570 28081 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:25.351101 25613 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.300848 28167 raft_consensus.cc:3055] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.321838 28088 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:25.351908 28090 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:25.358003 28090 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.359499 28090 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.360085 28166 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.356098 28167 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:25.363935 28167 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:25.356787 28086 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.365154 28167 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.365676 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 45) took 7963 ms. Trace:
I20260709 12:10:25.303838 27823 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.371534 25617 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
W20260709 12:10:25.357828 28143 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 1.005s	user 0.003s	sys 0.001s
I20260709 12:10:25.357803 28160 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:10:25.374614 27823 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.375286 25688 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:25.375792 28179 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.376868 25688 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:25.377955 28179 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.378194 25688 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:25.371680 28088 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.407061 28162 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.409787 28179 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:10:25.416093 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.437399 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.406392 28088 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.441248 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.442689 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:25.444468 28179 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.444864 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:25.445744 25767 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:25.393985 28083 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:25.464538 25765 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.446413 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet b28e719d6586469e8c186ce7b5af6bc7 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54016
I20260709 12:10:25.472513 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:25.474288 25765 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:25.483014 26337 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:25.507114 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:25.511075 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:25.512319 28133 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:25.513800 28133 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:25.515055 25658 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:25.516335 27823 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:25.516939 27823 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.517431 27823 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:25.444972 25750 tablet_service.cc:1558] Processing DeleteTablet for tablet fa0600a571a0457f804bf9bf88fd9fd4 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54016
I20260709 12:10:25.518388 28162 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.518980 28133 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.522799 28196 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:10:25.523535 27861 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:25.366139 25516 rpcz_store.cc:276] 0709 12:10:17.403022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.403843 (+   821us) service_pool.cc:224] Handling call
0709 12:10:25.365586 (+7961743us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:23.726251 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.726968 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.727013 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:10:23.727036 (+    23us) tablet.cc:662] Decoding operations
0709 12:10:23.727566 (+   530us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:23.727637 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:23.727677 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:23.728018 (+   341us) tablet.cc:701] Row locks acquired
0709 12:10:23.728039 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:23.728232 (+   193us) write_op.cc:270] Start()
0709 12:10:23.728388 (+   156us) write_op.cc:276] Timestamp: P: 1783599023728173 usec, L: 0
0709 12:10:23.728412 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:23.734492 (+  6080us) log.cc:844] Serialized 920 byte log entry
0709 12:10:23.981439 (+246947us) op_driver.cc:464] REPLICATION: finished
0709 12:10:24.065898 (+ 84459us) write_op.cc:301] APPLY: starting
0709 12:10:24.066003 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:24.066131 (+   128us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:24.066281 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:24.066700 (+   419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:24.066883 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:24.066924 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:24.067133 (+   209us) log.cc:844] Serialized 28 byte log entry
0709 12:10:24.067333 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:24.067427 (+    94us) write_op.cc:454] Released schema lock
0709 12:10:24.067469 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:24.067827 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:24.067854 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2128343,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":84122,"apply.run_cpu_time_us":2005,"apply.run_wall_time_us":2011,"num_ops":2,"prepare.queue_time_us":215649,"prepare.run_cpu_time_us":32526,"prepare.run_wall_time_us":67547,"raft.queue_time_us":126526,"raft.run_cpu_time_us":11469,"raft.run_wall_time_us":91711,"replication_time_us":252822,"thread_start_us":273947,"threads_started":4,"wal-append.queue_time_us":92322,"wal-append.run_cpu_time_us":37842,"wal-append.run_wall_time_us":1244682}]]}
I20260709 12:10:25.523942 27861 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:25.529738 28010 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:25.530925 28010 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.531334 28010 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:25.532604 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 91436.6us
I20260709 12:10:25.532461 28010 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.533787 28010 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.534035 28179 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.524742 28148 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.529795 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.545225 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.547406 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.549542 27902 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.575177 25583 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.566980 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.506171 28156 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:25.597054 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 82128.4us
I20260709 12:10:25.524986 27861 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.596853 28056 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:25.629365 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.565698 28128 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:25.590698 27997 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.596506 28149 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.596544 28151 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.599678 28156 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:25.606411 28148 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.591648 28116 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:25.612643 28086 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.641973 28128 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.699546 25693 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:25.660686 28086 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:25.660581 28161 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.710637 28116 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:25.722231 28160 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:25.726933 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.725528 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:25.735812 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.736019 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 160969us
I20260709 12:10:25.725422 27861 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:25.735033 27895 consensus_meta.cc:287] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.602s	user 0.015s	sys 0.003s
I20260709 12:10:25.742502 27895 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.716652 28086 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.727156 28109 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.751717 28128 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.755338 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:25.755529 25691 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:25.759639 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 192759us
I20260709 12:10:25.760591 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:25.761265 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 216133us
I20260709 12:10:25.762347 25732 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.765749 27895 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.763302 27816 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.767338 27823 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:25.779369 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.725348 28116 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:25.780869 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.770845 28062 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:25.678864 28156 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.796317 25613 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:25.799407 28115 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:25.728708 28161 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.810709 28161 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.815469 28117 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:25.816084 28117 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:25.817554 28117 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.838421 27823 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.774886 27902 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.780015 28151 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:25.790601 27982 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.849527 27823 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.859751 27823 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.776979 28133 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:10:25.851706 28025 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.784221 28038 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
W20260709 12:10:25.878153 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.849656 27861 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:25.862177 27823 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.899662 28170 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.915618 28179 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:25.918696 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 153332us
I20260709 12:10:25.917992 28200 tablet_replica.cc:333] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:10:25.908277 26334 raft_consensus.cc:1813] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Handling vote request from an unknown peer c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.908317 28102 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.895013 28025 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.870501 28088 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.942325 25689 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:25.942646 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:25.938946 28167 consensus_meta.cc:287] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.573s	user 0.017s	sys 0.000s
I20260709 12:10:25.945506 25686 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.870916 28116 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.947058 28116 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:25.907305 27861 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:25.922842 28170 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:25.961275 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 174698us
W20260709 12:10:25.963025 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 179242us
I20260709 12:10:25.964654 26334 raft_consensus.cc:2410] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:25.968508 28133 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:25.969882 27823 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.970249 27823 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:25.971199 27823 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.972788 27823 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.941421 28102 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:25.976862 28102 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:25.977063 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:25.978307 25610 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 4: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:25.979749 28025 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.983866 28086 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:25.986460 25694 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:25.988529 28117 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:25.988651 28170 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.992329 28088 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:25.994001 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:25.994814 25690 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:10:25.995013 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:25.995862 28010 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.997387 27861 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:25.998468 28200 raft_consensus.cc:2243] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:25.999444 28200 raft_consensus.cc:2272] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:25.997337 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:26.003830 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:26.004093 28010 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.004801 28102 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.004983 28010 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:26.005223 28102 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.005519 28010 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.005726 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.003830 28200 ts_tablet_manager.cc:1916] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:25.998593 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:26.005606 28102 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.009195 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:26.010735 25690 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:26.012979 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:26.009078 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:26.020965 28038 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:26.021559 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:26.022743 28038 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:26.022974 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:26.025064 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:26.024930 25582 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:26.026887 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:26.031376 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.031797 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:26.032274 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.033298 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.033663 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.034588 25763 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:26.036294 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:26.036962 25611 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:26.033090 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:26.039434 25760 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:26.040436 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:26.013650 28148 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.042860 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.044281 25759 raft_consensus.cc:2393] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:26.047327 25762 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:26.010339 28086 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:26.063660 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:26.064670 25615 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 2.
I20260709 12:10:26.065675 25611 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.066111 25612 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:26.067404 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:26.064713 25617 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.069644 25619 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:26.069691 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:26.070513 25615 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:26.072355 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.041306 28038 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:26.075904 25760 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:26.078045 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:26.069211 28151 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.087278 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:26.088294 25693 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:26.081286 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:26.097216 25613 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:26.080366 28056 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.101493 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:26.108212 25658 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:26.108500 25693 raft_consensus.cc:2393] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 3: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:26.103976 25615 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:26.106200 28217 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:26.110194 25614 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.075136 28166 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:26.079954 28019 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:26.094394 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:26.115211 28056 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.099308 28086 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.111667 28025 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.139683 28166 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:26.112169 28209 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:26.092953 28151 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.147385 25694 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.148607 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:26.149055 25693 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:26.120308 28207 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.161227 25693 pending_rounds.cc:85] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 4
I20260709 12:10:26.161532 25693 pending_rounds.cc:107] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:26.161751 25693 raft_consensus.cc:2889] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.173137 28218 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.174178 28218 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.177568 28218 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:26.130021 28217 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.125799 27997 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.132570 27902 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.151923 28086 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.152376 28056 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:26.217787 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.190092 28038 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:26.150063 28102 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:26.247897 28086 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.253307 25760 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:26.159688 28166 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:26.178584 28061 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:26.269119 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 157250us
I20260709 12:10:26.261059 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:26.266093 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.155509 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:26.276019 25768 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:26.218961 28209 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:26.280911 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:26.297127 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.275535 28207 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:26.299425 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:26.256072 28218 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:26.280228 28061 raft_consensus.cc:697] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:26.342886 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62032.3us
I20260709 12:10:26.279937 28116 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:26.250125 28217 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:26.376863 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 221420us
I20260709 12:10:26.318976 26337 raft_consensus.cc:2368] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 3. Current term is 4.
I20260709 12:10:26.297035 27895 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:26.389108 28160 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:26.392966 27984 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.393572 27984 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:26.387010 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:26.402221 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:26.408450 25768 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:26.394099 27984 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.413331 28217 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:26.371399 28062 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:26.442488 28210 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:26.414742 28160 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.442587 28062 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.447953 28062 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:26.319918 28166 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.429078 28209 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.460304 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:26.462785 25694 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.454811 28166 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:26.301419 28038 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.456630 27895 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:26.461525 28102 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:26.488830 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 410841us
I20260709 12:10:26.493387 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:26.478331 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 364017us
W20260709 12:10:26.622306 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.622921 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.624686 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:26.625468 25615 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.640863 25694 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
W20260709 12:10:26.646761 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86060.5us
I20260709 12:10:26.649912 25615 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:10:26.651014 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:26.651840 25761 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:26.658331 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 216385us
I20260709 12:10:26.506788 28151 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:26.623903 28218 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.467974 28207 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.677186 28111 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.656757 27997 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:10:26.713554 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 368711us
I20260709 12:10:26.712639 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:26.664433 28217 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:10:26.729569 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:26.475353 28061 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:26.680742 28115 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:10:26.791754 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 143123us
I20260709 12:10:26.693264 28218 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.729127 27902 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:26.728925 28111 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:26.836568 28229 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:10:26.792733 28235 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:26.802477 28117 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.808s	user 0.018s	sys 0.004s
I20260709 12:10:26.793792 28062 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.452706 28210 consensus_queue.cc:1175] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "04e6206f9e924fb3931891bf3a64b392" responder_term: 9 status { last_received { term: 6 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:26.804226 28151 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:26.872895 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:26.873860 25615 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
I20260709 12:10:26.875490 26304 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:26.715723 27895 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.832003 27902 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:26.870407 28220 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 12:10:26.877321 28111 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:10:26.866991 28234 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:26.871405 28151 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.875610 28237 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:26.900727 27902 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:26.901474 28218 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:26.909309 28233 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:26.910192 28233 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.913568 28233 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:26.914893 28251 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:26.915522 28251 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.918787 28251 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:26.919963 27984 consensus_meta.cc:287] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.004s
I20260709 12:10:26.920502 27984 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.905560 28234 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:26.901357 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 106771us
I20260709 12:10:26.923748 28234 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:26.924153 27902 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:26.924865 28245 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.925397 28245 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.925753 28245 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.928124 28237 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:26.929020 28010 consensus_meta.cc:287] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.000s
I20260709 12:10:26.929533 28010 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.930037 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:26.932101 28237 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:26.934352 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:26.936606 25618 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:26.934633 25613 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.870774 28062 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:26.903553 28151 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.943957 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.944928 25761 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:26.946907 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.955564 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:26.950911 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:26.969622 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 240116us
I20260709 12:10:26.972908 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:26.973965 25613 raft_consensus.cc:2410] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:26.896136 28117 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:26.975633 25759 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.981043 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:26.969923 28237 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:26.972664 28236 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:26.998912 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 302593us
I20260709 12:10:26.974885 28233 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.983552 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:26.977240 28218 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.977337 28062 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:27.012779 25762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.013s
I20260709 12:10:26.979308 28249 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:27.016269 25762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.000s	sys 0.013s
I20260709 12:10:27.018072 28248 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:10:27.016641 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 141284us
W20260709 12:10:27.004292 28086 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.724s	user 0.013s	sys 0.000s
I20260709 12:10:27.002118 28236 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:26.984637 28117 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.025846 28217 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.026311 27984 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.004760 28237 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:27.064049 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63564.5us
I20260709 12:10:27.032805 28253 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:27.027025 28116 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.032015 28235 raft_consensus.cc:697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:27.008062 28233 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.015556 28218 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.032353 28086 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.073091 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:27.075721 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:27.065868 28217 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.037701 28236 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:27.077917 25765 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:27.033641 28255 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:27.029695 28247 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:10:27.134392 28255 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.135310 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:27.028178 28249 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.033036 28248 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.078171 28252 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.137691 28056 consensus_meta.cc:287] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.857s	user 0.015s	sys 0.000s
I20260709 12:10:27.145771 25761 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:27.138641 28217 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.063717 28254 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:10:27.166481 28200 ts_tablet_manager.cc:1929] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:27.077040 28116 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.138410 27895 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.132478 28209 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.184140 28086 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:27.184866 28259 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:10:27.185070 28086 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.176555 28200 log.cc:1199] T b28e719d6586469e8c186ce7b5af6bc7 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/b28e719d6586469e8c186ce7b5af6bc7
I20260709 12:10:27.185632 28086 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.152603 28252 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.152493 28056 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.180081 28265 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.178948 27895 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.195868 28117 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:27.073300 28253 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.217171 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:27.218096 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:27.218438 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:27.219254 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:27.219970 28116 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.219796 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:27.221412 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:27.222775 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 246686us
I20260709 12:10:27.256349 25690 raft_consensus.cc:2410] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:27.266391 25694 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:27.181171 28209 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.163800 28235 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:27.256798 25765 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
W20260709 12:10:27.267257 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.268077 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:27.276233 25760 raft_consensus.cc:2393] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:27.267287 25692 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:27.280656 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:27.283444 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:27.212147 26334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60620 (request call id 78) took 1950 ms (client timeout 2073 ms). Trace:
I20260709 12:10:27.284268 25616 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.282122 25760 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
W20260709 12:10:27.298659 28261 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:10:27.300262 28218 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:27.301530 28255 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:27.303187 28266 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.303761 28266 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.313227 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:27.263347 28238 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:27.328686 25616 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:27.318557 28166 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.843s	user 0.003s	sys 0.011s
W20260709 12:10:27.329002 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 107031us
I20260709 12:10:27.284235 28237 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:27.306057 28200 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54016 (request call id 61) took 1848 ms. Trace:
I20260709 12:10:27.312620 28233 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.320143 28086 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.213747 28265 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:27.324913 28151 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:27.288360 26334 rpcz_store.cc:269] 0709 12:10:25.253343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.254347 (+  1004us) service_pool.cc:224] Handling call
0709 12:10:27.195009 (+1940662us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540054f454. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:27.203737 (+  8728us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439870720}
I20260709 12:10:27.337651 27895 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:27.354998 28263 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:27.324533 28238 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.362499 25615 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:27.349558 28249 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.359869 28275 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:27.352828 28245 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:27.367249 28209 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.446763 28266 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.370493 28252 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:27.447542 28238 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.383487 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:27.448421 25760 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:27.353487 28248 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.449049 28217 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.449467 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:27.385135 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:27.455375 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 70386.1us
I20260709 12:10:27.462625 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:27.449714 28237 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.449395 28275 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.523976 28233 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:27.442922 28151 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.469841 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:27.470722 28238 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.335383 28200 rpcz_store.cc:276] 0709 12:10:25.437316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.446022 (+  8706us) service_pool.cc:224] Handling call
0709 12:10:25.851262 (+405240us) ts_tablet_manager.cc:1151] Deleting tablet b28e719d6586469e8c186ce7b5af6bc7
0709 12:10:25.873043 (+ 21781us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:26.413907 (+540864us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:27.166282 (+752375us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:27.279903 (+113621us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60009,"tablet-delete.queue_time_us":327266,"thread_start_us":186547,"threads_started":1}
I20260709 12:10:28.047390 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.100171 25766 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:27.499866 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:28.101620 25618 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:10:27.466418 28266 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.154029 25585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.023s	sys 0.066s
W20260709 12:10:28.156006 25585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.024s	sys 0.066s
I20260709 12:10:28.159832 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.155843 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:27.789569 28218 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.060806 27982 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:28.158169 28160 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:27.467875 28209 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.995690 28249 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.550935 28258 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.064826 28238 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.624761 28149 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:27.548285 28116 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.015938 27816 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.791271 28272 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:27.521970 28217 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:27.791420 28252 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:27.881611 28245 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:10:27.519717 28265 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:27.689896 27895 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:27.439683 28236 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.153106 28151 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.049572 28233 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:27.499490 28237 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.176872 27982 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:28.186631 28209 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.201933 28238 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:28.205013 28011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.008s	sys 0.042s
I20260709 12:10:28.161870 28266 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.237389 28275 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.217319 28200 tablet_replica.cc:333] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:10:28.189527 28160 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:28.213142 28285 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.198734 28249 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.227840 28217 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.185223 28218 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.238099 28288 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.239507 28275 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.224735 28287 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.202365 28258 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:28.235502 28209 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.223368 28252 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.248860 28287 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.252043 28266 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.253250 28252 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.253584 28287 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.254962 28258 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.255446 28236 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.255788 28249 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.249542 28288 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.257730 28288 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.248839 28275 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.259744 28275 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.218434 28272 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.245432 28285 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.261840 28272 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:28.262894 28280 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:10:28.262432 28285 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:28.294214 25584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.182s	user 0.074s	sys 0.147s
W20260709 12:10:28.295588 25584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.183s	user 0.075s	sys 0.147s
I20260709 12:10:28.304692 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:28.306339 25618 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.312330 28293 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.313402 28293 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.318163 28293 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.206786 28149 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.330178 28293 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.345531 28293 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.346711 28237 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.210176 28116 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:28.343086 28011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.009s	sys 0.042s
I20260709 12:10:28.348898 28293 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.349375 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1225) took 1133 ms. Trace:
I20260709 12:10:28.349884 25693 rpcz_store.cc:276] 0709 12:10:27.215359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.215497 (+   138us) service_pool.cc:224] Handling call
0709 12:10:27.215958 (+   461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.318075 (+102117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.318225 (+   150us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:27.336202 (+ 17977us) log.cc:844] Serialized 52 byte log entry
0709 12:10:27.593826 (+257624us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:27.691556 (+ 97730us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.692057 (+   501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.692193 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.341705 (+649512us) raft_consensus.cc:1685] finished
0709 12:10:28.342063 (+   358us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.349021 (+  6958us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2106,"prepare.queue_time_us":98542,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":127774,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":2113,"spinlock_wait_cycles":57344384,"thread_start_us":346700,"threads_started":2,"wal-append.queue_time_us":838660}
I20260709 12:10:28.338768 28272 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.353781 28272 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.354723 28233 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.247625 28217 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.356498 28272 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.357795 28217 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.339538 28160 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:28.339747 28286 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.239954 28152 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.232173 28151 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.352875 28218 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.345975 28149 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.215111 27816 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.369138 28266 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.369524 28152 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.370450 28266 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.371546 27816 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.372663 28236 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.372838 28152 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.373557 28266 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.373487 28236 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.229475 27895 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.376606 28151 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.377561 27895 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.376670 28236 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.337456 27982 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.382647 27982 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.350186 28116 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.395136 28266 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.409860 25618 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:10:28.395674 28286 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.413311 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:28.414768 28272 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:28.415300 28272 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.415750 28272 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:28.415882 28286 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:28.416749 25657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.010s	sys 0.003s
W20260709 12:10:28.417212 25657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.010s	sys 0.003s
W20260709 12:10:28.417627 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 1.08367e+06us
I20260709 12:10:28.412598 28218 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.422643 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 317321us
I20260709 12:10:28.421577 28218 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.425999 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1226) took 1210 ms. Trace:
I20260709 12:10:28.439405 25689 rpcz_store.cc:276] 0709 12:10:27.215660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.215798 (+   138us) service_pool.cc:224] Handling call
0709 12:10:27.216128 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.348425 (+132297us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:27.348503 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.349022 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.549005 (+199983us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.549049 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.425203 (+876154us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b54000a9e54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:28.425283 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.425378 (+    95us) raft_consensus.cc:1685] finished
0709 12:10:28.425392 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.425760 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80232,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":111010560,"thread_start_us":282867,"threads_started":2,"wal-append.queue_time_us":838643}
W20260709 12:10:28.458173 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.459687 25768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1548) took 2164 ms (client timeout 1680 ms). Trace:
I20260709 12:10:28.460618 28237 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.461695 28287 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.426606 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.465224 28285 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.427107 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:28.482426 28152 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.487836 28025 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.488701 28025 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.488463 28285 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.488951 28152 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.466117 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1557) took 1393 ms. Trace:
I20260709 12:10:28.490556 25765 rpcz_store.cc:276] 0709 12:10:27.072673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.134909 (+ 62236us) service_pool.cc:224] Handling call
0709 12:10:28.458095 (+1323186us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b540024b3d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:28.465865 (+  7770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207796480}
I20260709 12:10:28.492163 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.493129 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.482700 28160 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:28.464501 25768 rpcz_store.cc:269] 0709 12:10:26.295055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.296833 (+  1778us) service_pool.cc:224] Handling call
0709 12:10:28.459074 (+2162241us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400249fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:28.459340 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253348224}
I20260709 12:10:28.470947 28237 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.493556 28287 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.435958 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1540) took 2173 ms. Trace:
I20260709 12:10:28.467159 28298 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.426561 28266 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.509723 28160 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.485491 28010 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.470223 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:28.492200 28152 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.499750 25759 rpcz_store.cc:276] 0709 12:10:26.262000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.263423 (+  1423us) service_pool.cc:224] Handling call
0709 12:10:26.263790 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.976183 (+712393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.434956 (+1458773us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540034fb54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:28.435611 (+   655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636615552}
I20260709 12:10:28.622278 25618 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:28.618059 25613 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:28.824862 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 354885us
I20260709 12:10:28.742830 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:28.509759 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.833467 28171 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.834091 28171 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.834599 28171 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.763633 28272 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.837522 28272 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.569788 27823 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.838968 27823 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.842681 25768 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:28.843133 28208 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.844089 28208 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.846639 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:28.847858 25617 raft_consensus.cc:2368] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:28.582149 28010 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.850152 27823 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:28.857117 28209 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.605s	user 0.019s	sys 0.005s
I20260709 12:10:28.858194 28210 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.858469 28244 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:28.859000 28206 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.861001 28250 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.861735 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:28.817502 28287 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.581046 28298 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.593863 28288 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.580744 28292 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.580469 28286 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.867172 28208 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.585151 28296 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.871047 28247 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:28.872123 28264 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 1.674s	user 0.010s	sys 0.004s
I20260709 12:10:28.873090 28152 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.871068 28160 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.513880 28266 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.614933 28116 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:28.512029 25582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.132:39515 timed out after 2.047s (SENT) [suppressed 27 similar messages]
I20260709 12:10:28.875095 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.590869 27816 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.591620 27895 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.591194 28166 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.786633 28275 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.511230 28237 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.879585 25765 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:28.879418 28267 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:28.880391 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:28.926908 25760 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:28.928546 25618 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:28.888542 26304 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:10:28.932638 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44288.7us
I20260709 12:10:28.935776 28206 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.936574 28286 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.901855 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.938716 25610 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:28.897255 28171 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:28.803858 27982 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:28.584580 27902 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.783898 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:28.503614 28218 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.904417 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:28.579284 27984 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:28.818214 28011 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:28.580312 27861 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.476655 28238 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.925549 25759 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:28.910779 28244 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:28.936095 27816 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.913987 28209 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.938633 28111 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.946599 28247 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.941265 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:28.930670 28250 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.943854 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.916965 28010 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:28.943755 28292 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.933805 28152 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.945713 28210 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.748241 28025 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.962409 28111 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:28.964435 28171 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.966091 25689 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:28.966696 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.967926 28011 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:28.974623 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 221274us
I20260709 12:10:28.938484 28296 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.981634 25613 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:28.933913 28116 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.934974 28288 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.948930 28166 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.952194 27895 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.975986 27816 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.969741 27902 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.005802 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:29.009052 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 497038us
I20260709 12:10:28.981318 28267 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.990288 27984 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:28.990171 28275 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.017148 28010 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:28.996007 28250 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:28.996556 27861 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.004097 28171 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:29.026790 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:28.995040 27982 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:29.019748 25617 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:29.033589 28111 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:29.035952 28210 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.036269 28298 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.036386 27895 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.031145 28152 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:29.041309 25761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1558) took 1966 ms (client timeout 1961 ms). Trace:
W20260709 12:10:29.043504 25761 rpcz_store.cc:269] 0709 12:10:27.074865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.075482 (+   617us) service_pool.cc:224] Handling call
0709 12:10:29.036841 (+1961359us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54000591d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:29.041075 (+  4234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42944896}
I20260709 12:10:29.044935 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.041770 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:29.046856 26340 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:29.047281 27982 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:29.047713 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.048661 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.051656 25761 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:29.039122 28253 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.037762 28286 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.050990 28206 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.049284 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.053251 25614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1168) took 2987 ms. Trace:
I20260709 12:10:29.053457 25619 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:29.053714 25614 rpcz_store.cc:276] 0709 12:10:26.065345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.065464 (+   119us) service_pool.cc:224] Handling call
0709 12:10:26.109943 (+ 44479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.115841 (+  5898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.052787 (+2936946us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b540008eb50. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:29.053029 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81018752}
I20260709 12:10:29.055794 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.056336 28288 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.042971 28056 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.056726 27984 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.057029 28200 raft_consensus.cc:2243] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:29.057649 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.057809 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1172) took 2130 ms. Trace:
I20260709 12:10:29.057904 28011 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:29.058198 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.060729 28292 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.061971 28209 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.064189 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:29.054558 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.039609 25759 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:29.067049 25618 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:29.067432 25765 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:29.064167 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.071700 28285 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.071954 28200 raft_consensus.cc:2272] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:29.074398 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.075577 25514 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.069522 25615 rpcz_store.cc:276] 0709 12:10:26.927646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.928276 (+   630us) service_pool.cc:224] Handling call
0709 12:10:26.928720 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.362983 (+434263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.057328 (+1694345us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400303754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:29.057626 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996656000}
W20260709 12:10:29.088631 25515 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 175) took 20168 ms (client timeout 15000 ms). Trace:
I20260709 12:10:29.029090 28275 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.085089 25617 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:29.088188 25616 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:29.101538 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.102289 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.102634 25616 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:29.102886 28238 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.103240 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:29.104082 25614 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.104224 25616 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.105368 25611 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 7. Ops: []
I20260709 12:10:29.068538 28247 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:28.469197 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet b28e719d6586469e8c186ce7b5af6bc7 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
W20260709 12:10:29.107154 25501 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 638154us
I20260709 12:10:29.108268 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.109117 28116 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.112681 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.109731 25619 raft_consensus.cc:2410] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:29.125615 25760 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:29.111725 28200 ts_tablet_manager.cc:1916] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:29.086445 28267 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.138427 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.112676 25514 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 5, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:29.147387 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.150687 25514 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 5, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:29.153571 25514 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:29.154517 28255 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:29.160360 27902 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.138068 28296 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.163420 28166 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.170867 25765 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:29.171701 27861 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.172115 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.173350 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.174440 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:29.175141 25760 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:29.092768 25515 rpcz_store.cc:269] 0709 12:10:08.919978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.920463 (+   485us) service_pool.cc:224] Handling call
0709 12:10:29.088256 (+20167793us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:18.572484 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:18.759994 (+187510us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b540001c128. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb91179e1 00007fbdb911664c 00007fbdb67a5d5d 00007fbdb67910a6 00007fbdb6790d58 00007fbdb67959f1 00007fbdb67959a9 00007fbdb6795939 00007fbdb6795901 00007fbdb6794b2d 0000000000388634
0709 12:10:18.760154 (+   160us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:18.760222 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:10:18.760260 (+    38us) tablet.cc:662] Decoding operations
0709 12:10:18.864681 (+104421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:18.864759 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:18.864789 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:10:18.866429 (+  1640us) tablet.cc:701] Row locks acquired
0709 12:10:18.866469 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:10:18.866669 (+   200us) write_op.cc:270] Start()
0709 12:10:18.866910 (+   241us) write_op.cc:276] Timestamp: P: 1783599018866595 usec, L: 0
0709 12:10:18.866938 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:10:18.867826 (+   888us) log.cc:844] Serialized 7582 byte log entry
0709 12:10:19.148755 (+280929us) op_driver.cc:464] REPLICATION: finished
0709 12:10:19.958566 (+809811us) write_op.cc:301] APPLY: starting
0709 12:10:19.958681 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:19.959159 (+   478us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:19.959196 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:20.013795 (+ 54599us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:20.014151 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:10:20.014200 (+    49us) write_op.cc:312] APPLY: finished
0709 12:10:20.100986 (+ 86786us) log.cc:844] Serialized 131 byte log entry
0709 12:10:20.225423 (+124437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.279012 (+ 53589us) write_op.cc:454] Released schema lock
0709 12:10:20.294287 (+ 15275us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:20.326614 (+ 32327us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.327868 (+  1254us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":933593,"reported_tablets":54,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":747385,"apply.run_cpu_time_us":16061,"apply.run_wall_time_us":361436,"num_ops":19,"prepare.queue_time_us":162485,"prepare.run_cpu_time_us":17875,"prepare.run_wall_time_us":344499,"raft.queue_time_us":105211,"raft.run_cpu_time_us":27994,"raft.run_wall_time_us":634637,"replication_time_us":213521,"spinlock_wait_cycles":2541312,"thread_start_us":583553,"threads_started":5,"wal-append.queue_time_us":173229,"wal-append.run_cpu_time_us":21613,"wal-append.run_wall_time_us":2251092}]]}
I20260709 12:10:29.160044 28255 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.178877 25761 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:29.183867 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.184517 25761 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:29.184566 28255 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.183862 25614 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:29.182137 27861 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.186527 28217 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:29.193157 27861 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.196691 27861 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.198529 28275 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:29.200137 28275 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:29.200641 28275 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:29.202358 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.203207 25765 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:29.203104 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.204427 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.205718 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.206511 25765 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:29.193320 28217 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.215037 28267 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:29.219058 25761 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
W20260709 12:10:29.219348 28232 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 2.511s	user 0.011s	sys 0.014s
I20260709 12:10:29.220827 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.221877 28252 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:29.222113 28219 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:29.223008 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1341) took 2281 ms. Trace:
I20260709 12:10:29.228080 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.228610 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1335) took 2723 ms. Trace:
I20260709 12:10:29.230361 25615 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:29.226337 25614 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.229380 28219 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.229336 28252 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.227931 25617 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:29.227864 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.234468 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.228158 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.229949 25767 rpcz_store.cc:276] 0709 12:10:26.941517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.941661 (+   144us) service_pool.cc:224] Handling call
0709 12:10:26.969256 (+ 27595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.969512 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:29.121771 (+2152259us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.157282 (+ 35511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.192011 (+ 34729us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:29.215804 (+ 23793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.222640 (+  6836us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.222823 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2119114,"prepare.queue_time_us":2176295,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3157,"raft.queue_time_us":7960,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":15267,"thread_start_us":32058,"threads_started":2,"wal-append.queue_time_us":10729}
I20260709 12:10:29.235965 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.236874 25765 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:29.222796 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1334) took 2731 ms. Trace:
I20260709 12:10:29.240540 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.230335 25763 rpcz_store.cc:276] 0709 12:10:26.491795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.491921 (+   126us) service_pool.cc:224] Handling call
0709 12:10:26.492203 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.492442 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:26.669519 (+177077us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.071229 (+2401710us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b180039a420. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafbe8c0a 00007fbdb9328219 00007fbdafc70a40 00007fbdafc6b4e4 00007fbdafc6b455 00007fbdb67533c7 00007fbdb2d659a7 00007fbdb2d750bf 00007fbdb2d75038
0709 12:10:29.071652 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.159125 (+ 87473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.179090 (+ 19965us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.186320 (+  7230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.186401 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.214900 (+ 28499us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2548071,"prepare.queue_time_us":2661064,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":170739,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":25563,"spinlock_wait_cycles":36673664,"thread_start_us":69618,"threads_started":1,"wal-append.queue_time_us":77898}
I20260709 12:10:29.244145 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.245609 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.247097 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1536) took 2992 ms. Trace:
I20260709 12:10:29.249102 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.251157 25760 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:29.251857 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.252909 25617 raft_consensus.cc:2410] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:29.255267 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.258561 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.259473 25616 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:29.239208 25764 rpcz_store.cc:276] 0709 12:10:26.491367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.491541 (+   174us) service_pool.cc:224] Handling call
0709 12:10:26.491880 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.492126 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:26.639740 (+147614us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.087774 (+2448034us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.208609 (+120835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.221404 (+ 12795us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:29.221500 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.222404 (+   904us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.222573 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4783212,"prepare.queue_time_us":2607700,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":5413,"raft.queue_time_us":159783,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":9184,"thread_start_us":144126,"threads_started":2,"wal-append.queue_time_us":360620,"wal-append.run_cpu_time_us":1694,"wal-append.run_wall_time_us":1127248}
I20260709 12:10:29.201998 28275 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.263055 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.259691 28244 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.263983 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.265606 28217 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.266434 28156 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.262033 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:29.247925 25762 rpcz_store.cc:276] 0709 12:10:26.254113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.254292 (+   179us) service_pool.cc:224] Handling call
0709 12:10:26.289973 (+ 35681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.290588 (+   615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.290634 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.291369 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.022170 (+730801us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.102131 (+2079961us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.246382 (+144251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.246632 (+   250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.246713 (+    81us) raft_consensus.cc:1685] finished
0709 12:10:29.246741 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.246918 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2061157,"prepare.queue_time_us":2083528,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":21955,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":5645,"thread_start_us":716306,"threads_started":3,"wal-append.queue_time_us":741950,"wal-append.run_cpu_time_us":2487,"wal-append.run_wall_time_us":1123266}
I20260709 12:10:29.288085 28244 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.292285 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.291504 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.292675 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.294212 25616 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:29.299902 25617 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:29.288853 28115 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.301988 28086 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:29.323509 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.302237 27997 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.305307 28275 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:29.335284 26337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60616 (request call id 116) took 3282 ms (client timeout 2047 ms). Trace:
I20260709 12:10:29.335863 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1352) took 1948 ms. Trace:
I20260709 12:10:29.336309 25766 rpcz_store.cc:276] 0709 12:10:27.387004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.183494 (+796490us) service_pool.cc:224] Handling call
0709 12:10:28.183807 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.184059 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:29.190474 (+1006415us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.335208 (+144734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.335297 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.335404 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.335490 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.335645 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":914978,"prepare.queue_time_us":921978,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":10504,"raft.queue_time_us":4752,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"thread_start_us":156938,"threads_started":2}
I20260709 12:10:29.353363 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:29.354473 25613 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.360340 25759 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:29.353868 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.363636 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.364805 25617 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:29.323573 28086 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:29.383124 28320 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:29.370609 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.387667 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.388545 28116 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.388967 28116 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:29.389357 28116 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.390726 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.391188 28219 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:29.391491 25760 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:29.392673 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.326833 27997 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:29.393347 25760 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:29.395087 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:29.395813 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.396445 28209 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.396859 28209 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:29.396912 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.397392 28209 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.401419 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.383405 28086 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.322320 28115 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:29.371114 28025 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.368328 27861 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:29.374784 28252 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:29.335906 26337 rpcz_store.cc:269] 0709 12:10:26.052472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.061826 (+  9354us) service_pool.cc:224] Handling call
0709 12:10:29.334765 (+3272939us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54005ffd54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:29.335012 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306045312}
I20260709 12:10:29.404019 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.402963 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.419929 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.424675 25760 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:29.425238 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:29.404760 27997 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.419513 27861 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:29.425937 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.430702 28295 consensus_queue.cc:1059] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:10:29.439566 27997 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:29.443737 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.499616 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.449759 25767 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:29.450515 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46780.3us
I20260709 12:10:29.503211 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.504313 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.504978 28148 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.505336 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.505605 28148 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:29.506100 25763 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 2.
I20260709 12:10:29.451112 25759 raft_consensus.cc:2410] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:10:29.470381 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52347.7us
I20260709 12:10:29.441152 28115 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.513520 28115 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.474382 28234 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.514889 28234 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.426182 27957 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:29.519183 27957 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:29.521322 28295 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.521790 28295 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:29.522857 28295 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.524129 28295 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.436846 25764 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:29.441519 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet b7b82e0d41f14cc2baa1e889ed4c7312 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:53278
W20260709 12:10:29.427217 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 57407.9us
I20260709 12:10:29.506178 28148 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.530200 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:29.545965 28161 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.539099 25613 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:10:29.470870 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:29.549094 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44859.7us
I20260709 12:10:29.495752 25760 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:10:29.562598 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44310.2us
I20260709 12:10:29.431216 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:29.571538 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.573261 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:29.617071 25582 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:29.576510 25761 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:29.616074 25759 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:29.548666 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:29.439975 27861 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.549003 28238 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.546416 28161 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.453848 28025 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:29.542106 28219 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.555891 28234 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:29.465860 28061 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:29.793385 25762 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:10:29.837433 25762 pending_rounds.cc:85] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 3
W20260709 12:10:29.809545 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 174460us
I20260709 12:10:29.546715 28275 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.236s
I20260709 12:10:29.548190 28156 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.235s
I20260709 12:10:29.546188 28200 ts_tablet_manager.cc:1929] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
W20260709 12:10:29.809867 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.549782 28086 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.783582 28238 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:29.770663 28285 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:29.539122 28116 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:29.556602 27957 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:29.971545 25766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.038s	sys 0.084s
W20260709 12:10:30.160300 25766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.038s	sys 0.122s
W20260709 12:10:30.160730 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.161298 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.161779 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.970491 28320 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:10:29.910137 25762 pending_rounds.cc:107] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 7.4
W20260709 12:10:30.173743 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.178733 25762 raft_consensus.cc:2889] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:29.794306 28161 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:30.097311 28324 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:10:30.162639 28209 consensus_meta.cc:287] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.765s	user 0.065s	sys 0.088s
W20260709 12:10:30.186601 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.187202 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.832190 28219 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.191099 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:30.197393 28295 consensus_meta.cc:287] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.673s	user 0.014s	sys 0.000s
I20260709 12:10:30.199460 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:30.200564 28115 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:30.201174 28115 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.188926 28209 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.203827 28115 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:30.204679 28209 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.205293 28209 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.188704 28244 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:30.206768 28244 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:30.207334 27997 consensus_meta.cc:287] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.007s
I20260709 12:10:30.207960 27997 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:30.208904 28244 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:30.215095 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.186146 28200 log.cc:1199] T fa0600a571a0457f804bf9bf88fd9fd4 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/fa0600a571a0457f804bf9bf88fd9fd4
I20260709 12:10:30.218294 28200 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54016 (request call id 60) took 4847 ms. Trace:
I20260709 12:10:30.218832 28200 rpcz_store.cc:276] 0709 12:10:25.405893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.444669 (+ 38776us) service_pool.cc:224] Handling call
0709 12:10:28.196147 (+2751478us) ts_tablet_manager.cc:1151] Deleting tablet fa0600a571a0457f804bf9bf88fd9fd4
0709 12:10:28.200652 (+  4505us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:29.342932 (+1142280us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:29.545943 (+203011us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:30.218166 (+672223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":824873,"tablet-delete.queue_time_us":2673146}
I20260709 12:10:30.224100 28219 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:30.176321 28238 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.236234 28086 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.237681 28086 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:30.242494 28086 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:30.205767 28209 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.244742 28285 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:29.973580 28061 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.204442 28115 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:30.270368 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:30.272078 25760 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
W20260709 12:10:30.273319 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.269542 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet fa0600a571a0457f804bf9bf88fd9fd4 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:10:30.269601 28295 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:30.268074 28086 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.955375 28148 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.280336 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1574) took 1430 ms. Trace:
I20260709 12:10:30.281497 25762 rpcz_store.cc:276] 0709 12:10:28.849619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.301529 (+451910us) service_pool.cc:224] Handling call
0709 12:10:29.322637 (+ 21108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.190150 (+867513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.280094 (+ 89944us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400319cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:30.280282 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044814592}
I20260709 12:10:30.273866 27957 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.283718 28285 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:30.283653 28116 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.284005 28061 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.287338 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:30.277884 28115 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:30.279109 28295 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:30.326390 25582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.012s	sys 0.047s
I20260709 12:10:30.299345 28116 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:30.328014 25582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.013s	sys 0.047s
W20260709 12:10:30.336660 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 719692us
I20260709 12:10:30.342684 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:30.329506 28116 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:30.346215 28116 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.365270 28285 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.401572 25584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.039s	sys 0.093s
W20260709 12:10:30.402172 25584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.039s	sys 0.093s
I20260709 12:10:30.397855 28285 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:30.396875 27861 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
I20260709 12:10:30.411087 28148 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.454506 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:30.444203 28295 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.461707 26340 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:30.436106 27861 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.454952 28115 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:30.460947 28148 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.453639 28238 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.482647 28148 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.495643 28148 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.506632 28209 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.505949 28332 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53278 (request call id 73) took 1070 ms. Trace:
I20260709 12:10:30.531602 28285 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:30.557489 28285 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.537424 27861 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.560642 28285 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.547413 28238 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.569240 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 145) took 1213 ms. Trace:
I20260709 12:10:30.573148 25616 rpcz_store.cc:276] 0709 12:10:29.352580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.358675 (+  6095us) service_pool.cc:224] Handling call
0709 12:10:29.359122 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.359402 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.359431 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.360019 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.616004 (+255985us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:29.616066 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.616275 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.565356 (+949081us) raft_consensus.cc:1685] finished
0709 12:10:30.565393 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.565624 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":255293,"threads_started":1,"wal-append.queue_time_us":1042429}
W20260709 12:10:30.580786 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 1.03208e+06us
W20260709 12:10:30.585870 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 315069us
I20260709 12:10:30.546922 28332 rpcz_store.cc:276] 0709 12:10:29.433270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.441208 (+  7938us) service_pool.cc:224] Handling call
0709 12:10:30.480116 (+1038908us) ts_tablet_manager.cc:1151] Deleting tablet b7b82e0d41f14cc2baa1e889ed4c7312
0709 12:10:30.484570 (+  4454us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:30.501888 (+ 17318us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":943280,"thread_start_us":283458,"threads_started":1}
I20260709 12:10:30.600056 28238 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:30.600703 28238 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.603096 28238 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.619756 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet b7b82e0d41f14cc2baa1e889ed4c7312 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
W20260709 12:10:30.626039 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.585268 28025 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.008s
W20260709 12:10:30.633561 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.634086 25657 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.012s	sys 0.027s
W20260709 12:10:30.636327 25657 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.012s	sys 0.027s
W20260709 12:10:30.636711 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 862784us
I20260709 12:10:30.638444 28285 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:30.642333 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 206496us
W20260709 12:10:30.636822 28025 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.002s	sys 0.008s
W20260709 12:10:30.643694 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 444396us
W20260709 12:10:30.639958 28331 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
W20260709 12:10:30.652927 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.621673 28086 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.646610 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:30.643718 25658 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:30.658051 25689 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 9. Ops: []
W20260709 12:10:30.661180 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.636353 28161 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.642078 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:30.665107 28340 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.666062 27861 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:30.666431 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:30.666708 28337 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:30.667351 28337 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.669178 28161 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:30.670400 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.672329 28156 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.677261 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.678568 28156 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:30.678763 27861 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:30.679024 25694 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:30.679668 28156 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.679832 27861 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.680584 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.681070 28156 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.681286 25692 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:30.665118 25616 raft_consensus.cc:606] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:30.674711 25693 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:30.682950 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:30.685746 25658 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:30.654850 28025 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:30.687080 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.684504 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.687803 25693 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:30.687844 25689 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:30.670071 28337 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.693523 28209 raft_consensus.cc:993] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:30.699556 28086 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.700627 28025 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.701606 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:30.704159 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.705052 25693 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:30.707675 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:30.715477 25693 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:30.718045 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.722364 25686 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:30.693825 28116 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.725807 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:30.727344 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62692.6us
I20260709 12:10:30.727820 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.709275 28285 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:30.715173 28238 raft_consensus.cc:1081] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:10:30.743021 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.722406 28086 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.730350 28334 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:30.760622 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.770730 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.757128 28086 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:30.771410 25617 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:30.778640 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.779671 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.780160 25613 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:30.776137 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.782701 27957 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:30.794505 28344 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:30.795282 28344 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.796293 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.796955 25692 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:30.797273 25686 raft_consensus.cc:2410] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:30.797858 28344 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.798225 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.799191 25694 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:30.799734 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.800493 25686 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:30.800597 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.802758 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.763242 28334 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.804170 25689 raft_consensus.cc:2410] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:30.804761 25617 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:30.805441 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:30.809362 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.809954 25614 raft_consensus.cc:2376] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6. Re-sending same reply.
I20260709 12:10:30.810078 25693 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:30.812242 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.812917 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.815188 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.816704 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:30.817327 25610 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.818001 28061 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.818284 27957 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:30.818740 27957 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:30.818905 28061 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:30.819708 27957 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.820560 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:30.821131 27957 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.822935 28156 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.823556 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:30.823665 28156 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.824609 28340 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.824972 28285 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.825047 28340 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:30.825786 28340 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.825626 28285 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.826745 28156 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.827623 28061 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:30.828338 28285 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:30.828341 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 70450.2us
I20260709 12:10:30.812470 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.831101 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:30.817214 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.813179 25613 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:30.821177 25615 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:30.832345 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:30.833124 25617 raft_consensus.cc:606] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:30.833506 25617 raft_consensus.cc:614] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:30.855014 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.856139 25618 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:30.821950 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:30.781723 28086 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.859536 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:30.860237 25614 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:30.861987 25611 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:30.862654 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 102845us
I20260709 12:10:30.810734 28334 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.770147 28148 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:30.905094 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.907300 28116 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.960641 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.914616 28338 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:30.960047 28285 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.961674 25658 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:30.971396 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.963047 25613 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:30.974400 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:30.984654 25615 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:30.962821 28337 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:30.964701 28238 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:30.996253 28238 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:30.996690 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.998402 28337 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:31.000626 28337 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:31.003393 28238 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:30.968600 28338 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.010434 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.011179 25689 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:31.011268 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.013227 25692 raft_consensus.cc:2368] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:30.975095 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:31.013578 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 183635us
I20260709 12:10:31.014050 25618 raft_consensus.cc:2410] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:31.014474 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:30.974016 27861 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:31.018965 28340 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.021431 28340 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:31.009075 28338 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:30.969226 25610 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:30.975378 25616 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:30.984694 25762 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:30.974936 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.988754 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.026650 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:31.026942 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.027354 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.027563 25764 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.028355 25691 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:31.028499 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.029270 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.029719 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.989373 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.990175 28148 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:30.990782 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.990958 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:30.991539 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.030598 25687 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:31.031083 25760 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.031522 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.031901 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.032491 25688 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:30.992568 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.032895 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.033560 25762 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:31.033653 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.033860 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.034984 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.035290 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.036007 25694 raft_consensus.cc:2368] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9.
I20260709 12:10:31.036094 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.036850 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.037163 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.037724 25693 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.037415 25694 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:31.031546 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:30.974741 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.039377 25612 raft_consensus.cc:1813] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Handling vote request from an unknown peer c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.039845 25612 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:31.032788 25690 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.039871 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.025941 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.041265 28086 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.032234 25761 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:31.041424 25766 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:31.026643 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.043088 25759 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.021687 25516 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 3 to 6, term changed from 4 to 5, leader changed from 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) to <none>, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 5 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:30.963431 25614 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:31.041599 25691 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:31.012059 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.022516 28338 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:31.051905 25583 leader_election.cc:336] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.643s (SENT)
W20260709 12:10:31.050714 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 149221us
I20260709 12:10:31.052510 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.051231 25760 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:30.957583 28115 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.993799 28334 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:31.157145 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.158301 25688 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:31.155850 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.160131 25686 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.107057 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:31.096197 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.160821 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.161198 25759 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.161281 25693 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:31.075625 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:31.094758 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.127064 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 110055us
I20260709 12:10:31.155339 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:31.162940 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 104669us
I20260709 12:10:31.172926 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:31.171304 25766 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:10:31.126673 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 74807.1us
I20260709 12:10:31.163985 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:31.167263 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.076965 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.177194 25694 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:31.174135 25614 raft_consensus.cc:606] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:31.178239 25614 raft_consensus.cc:614] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:31.179283 25692 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:31.180649 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.182829 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.168489 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.184038 25765 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:31.074932 28339 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:31.174188 25583 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.644s (SENT)
I20260709 12:10:31.191188 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.192274 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.186923 25768 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:31.164759 25764 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:31.185705 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.186897 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.188102 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.194954 25760 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.195042 25689 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:31.196868 25761 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.074993 28161 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.144451 28344 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.051520 28338 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:31.200454 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:31.200587 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 186250us
I20260709 12:10:31.225967 28338 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.226192 25768 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.190637 28339 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.227795 28339 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.193446 28238 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.232837 28238 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:31.199760 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.235652 28238 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:31.236199 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.237985 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:31.242946 25617 raft_consensus.cc:606] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:31.201941 25582 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.203536 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.203924 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:31.244570 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71758.8us
I20260709 12:10:31.244951 25759 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.245138 25767 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.207793 25583 leader_election.cc:336] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.686s (SENT)
I20260709 12:10:31.208279 28148 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.207835 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.249722 25766 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.214627 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.210059 28086 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:31.215492 28161 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.216120 28334 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:31.216912 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.252702 25688 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.217621 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.250711 25763 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:31.221660 25760 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:31.222445 25761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:31.246234 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.200048 28340 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.254019 25691 raft_consensus.cc:2410] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:31.249781 25765 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:31.254949 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:31.256531 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.257174 25688 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.258594 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.259385 25687 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
W20260709 12:10:31.271066 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 63294.7us
W20260709 12:10:31.272528 25583 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.707s (SENT)
I20260709 12:10:31.272921 25759 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:31.271162 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.281229 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.284173 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:31.284451 28351 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:31.284848 25617 raft_consensus.cc:606] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:31.285213 25617 raft_consensus.cc:614] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:31.284202 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.288401 25687 raft_consensus.cc:2368] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:31.288673 28161 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:31.289402 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.263118 28340 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:31.282480 25583 leader_election.cc:336] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.721s (SENT)
I20260709 12:10:31.290799 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.356786 25688 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:10:31.384655 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 129777us
W20260709 12:10:31.292294 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.381081 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 179253us
I20260709 12:10:31.386886 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.197446 28115 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.388972 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.389835 28115 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:31.390460 28161 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:31.390666 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:31.391286 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.293663 25762 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:31.391517 25617 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.291170 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.394438 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.347564 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.397219 25690 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:31.387377 28340 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.401192 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:31.401640 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 167632us
I20260709 12:10:31.402055 25767 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:31.400861 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:31.411249 25616 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:31.320765 28344 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.405010 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.426436 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.428318 25617 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:31.430486 25686 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:31.430639 25616 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.435808 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.449599 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.450382 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.458400 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.460650 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.461361 25767 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:10:31.460711 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.463296 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.464964 25617 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.431560 28334 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:31.347302 28339 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:31.467034 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 193079us
I20260709 12:10:31.506170 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.514125 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.515810 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:31.539196 25583 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.774s (SENT)
I20260709 12:10:31.516223 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.513681 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.515491 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.541361 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.541687 25617 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.505980 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.505723 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.544307 25615 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:31.516484 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:31.545635 25583 leader_election.cc:336] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.804s (SENT)
I20260709 12:10:31.542223 25611 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:10:31.547708 25514 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 179) took 21937 ms (client timeout 15000 ms). Trace:
I20260709 12:10:31.546404 25616 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:31.550004 25612 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.467150 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.513401 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.471765 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.552919 25686 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:31.557497 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.550755 28338 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.558336 25767 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.560220 28338 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:31.560864 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.562863 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.563498 25765 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.565912 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet fa0600a571a0457f804bf9bf88fd9fd4 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:54016
I20260709 12:10:31.566354 25761 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:31.566788 25761 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.567063 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:31.514963 28353 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:31.467372 25691 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:10:31.576164 25691 pending_rounds.cc:85] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 6
W20260709 12:10:31.516986 28331 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:10:31.576476 25691 pending_rounds.cc:107] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:10:31.576751 25691 raft_consensus.cc:2889] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.544412 25693 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:31.541968 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.578826 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.579385 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.579516 25686 raft_consensus.cc:2376] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:10:31.580072 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.580637 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.593565 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.593541 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.570014 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.593842 28339 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:31.599109 25686 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.579525 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.591728 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:31.516079 25610 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
W20260709 12:10:31.551571 28356 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:31.601675 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.571283 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.519011 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.541865 25613 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:31.577350 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.579547 27957 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:31.601326 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:31.570209 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.575160 25689 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:31.602177 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.575431 25765 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:10:31.583316 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.602891 25687 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:31.624423 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.731777 25612 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:31.600184 25611 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.602425 25763 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:10:31.635645 25688 raft_consensus.cc:2393] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:31.735040 25614 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.619168 25766 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:31.647892 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.642737 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 97147.2us
I20260709 12:10:31.737282 28338 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:31.738083 28338 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:31.657048 25767 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:10:31.739562 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:31.737165 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 145765us
W20260709 12:10:31.679322 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 280873us
I20260709 12:10:31.740327 25616 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:31.742586 25760 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:31.744356 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.747221 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.748255 25610 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.584973 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.745652 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:31.750190 25685 raft_consensus.cc:2376] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:10:31.751380 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.752036 25686 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:31.741425 27957 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:31.755867 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.757085 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:31.548170 25514 rpcz_store.cc:269] 0709 12:10:09.610302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.611471 (+  1169us) service_pool.cc:224] Handling call
0709 12:10:09.995503 (+384032us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:10:31.547585 (+21552082us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:29.378419 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:29.379189 (+   770us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:29.379250 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:10:29.379272 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:29.437985 (+ 58713us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:29.438091 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:29.438140 (+    49us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:29.438800 (+   660us) tablet.cc:701] Row locks acquired
0709 12:10:29.438881 (+    81us) write_op.cc:260] PREPARE: finished
0709 12:10:29.439075 (+   194us) write_op.cc:270] Start()
0709 12:10:29.439271 (+   196us) write_op.cc:276] Timestamp: P: 1783599029438999 usec, L: 0
0709 12:10:29.439295 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:29.440323 (+  1028us) log.cc:844] Serialized 1717 byte log entry
0709 12:10:30.812700 (+1372377us) op_driver.cc:464] REPLICATION: finished
0709 12:10:30.974640 (+161940us) write_op.cc:301] APPLY: starting
0709 12:10:30.974760 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:30.974968 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:30.975107 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:30.988549 (+ 13442us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:30.988853 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:30.988901 (+    48us) write_op.cc:312] APPLY: finished
0709 12:10:30.989232 (+   331us) log.cc:844] Serialized 40 byte log entry
0709 12:10:30.989435 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:30.989546 (+   111us) write_op.cc:454] Released schema lock
0709 12:10:30.989617 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:30.990075 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:30.990114 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":662192,"reported_tablets":50,"spinlock_wait_cycles":94457088,"child_traces":[["op",{"apply.queue_time_us":161590,"apply.run_cpu_time_us":2991,"apply.run_wall_time_us":15408,"num_ops":4,"prepare.queue_time_us":87095,"prepare.run_cpu_time_us":47983,"prepare.run_wall_time_us":629048,"raft.queue_time_us":105564,"raft.run_cpu_time_us":25788,"raft.run_wall_time_us":153447,"replication_time_us":1373226,"thread_start_us":628010,"threads_started":4,"wal-append.queue_time_us":1025940}]]}
I20260709 12:10:31.729236 28061 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:31.756433 27957 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.760679 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.761492 25688 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:31.762516 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.762835 28338 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.763763 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.765031 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.766619 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.767711 25691 raft_consensus.cc:2376] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7. Re-sending same reply.
I20260709 12:10:31.767927 25616 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:31.768741 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.769858 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.755663 28362 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:31.770481 25760 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:31.770664 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:31.771428 25610 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:31.771747 27957 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.772980 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:31.774087 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.777094 28354 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:31.778225 28357 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:31.778620 28357 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:31.779759 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:31.780403 25612 raft_consensus.cc:2376] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7. Re-sending same reply.
I20260709 12:10:31.790098 25693 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:31.791862 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.793377 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.793753 28337 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.794605 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.799480 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.801381 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:31.786139 25761 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.806669 25688 raft_consensus.cc:2376] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7. Re-sending same reply.
I20260709 12:10:31.810626 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:31.810941 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:31.811964 28337 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.818915 25767 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 7. Ops: []
W20260709 12:10:31.821394 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 75851.8us
I20260709 12:10:31.838416 28362 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:31.839430 28362 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:31.837050 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:31.851904 25583 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.894s (SENT)
I20260709 12:10:31.852829 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.853048 25760 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:10:31.878541 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.779793 28357 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.885191 28357 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.886119 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:31.888156 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:31.888859 25765 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
W20260709 12:10:31.889834 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 116974us
I20260709 12:10:31.892931 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:31.899432 25760 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:31.901026 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:31.901432 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 64622us
I20260709 12:10:31.902129 25687 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:31.898007 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46172.3us
W20260709 12:10:31.905843 25583 leader_election.cc:336] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.900s (SENT)
I20260709 12:10:31.906510 25767 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:31.906423 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:31.896600 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:31.867300 28161 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:31.895850 25768 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:31.908519 25694 raft_consensus.cc:2368] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9.
I20260709 12:10:31.911098 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:31.840735 28362 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.938498 25686 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:31.893517 28334 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.989631 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:31.997817 25760 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:32.004864 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 100534us
W20260709 12:10:32.005831 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.907413 28061 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.010696 28362 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.011256 28363 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.011776 28363 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:32.012323 28363 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.012758 27957 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:32.013701 28061 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.014781 28061 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.015965 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:32.016721 25693 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:32.018388 28340 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:32.018551 25692 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:32.019028 28340 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.019969 28340 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.021369 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:32.004292 28161 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.022804 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet fa0600a571a0457f804bf9bf88fd9fd4 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:10:32.023362 28161 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:31.989552 28354 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.024647 28354 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.027099 28354 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:32.011824 28238 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:32.032763 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:32.035082 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.039067 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.035290 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:32.041836 25688 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.048704 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.052007 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:32.049965 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.052922 25619 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:32.022838 28364 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:10:32.054579 25582 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.058665 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:32.066713 25761 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:32.056093 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:32.094573 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 105042us
I20260709 12:10:32.095453 25610 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:32.096326 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.098721 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:32.107513 25617 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:32.118649 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.127038 25688 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:32.055727 28334 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.052045 28344 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:32.102241 25732 connection.cc:256] RPC call timeout handler was delayed by -1.2004584700000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:10:32.132151 25732 connection.cc:256] RPC call timeout handler was delayed by -1.2004584700000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:10:32.132462 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1743584700000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 12:10:32.132715 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1743584700000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 12:10:32.132977 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1716584700000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:10:32.130492 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 224700us
W20260709 12:10:32.133219 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.133704 25583 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.942s (SENT)
W20260709 12:10:32.133221 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1716584700000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:10:32.134346 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1581584699999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:10:32.134649 25583 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.984s (SENT)
W20260709 12:10:32.134768 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1581584699999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 12:10:32.135201 25583 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:32.135951 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.136850 25614 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
W20260709 12:10:32.135281 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0087584699999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:10:32.141866 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 108151us
I20260709 12:10:32.117223 28337 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.128027 28238 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:32.131965 28344 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.131764 28334 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:32.158367 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 222176us
I20260709 12:10:32.141772 28374 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.152967 28362 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.174952 28374 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:32.175572 28374 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.167912 26303 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:32.166544 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.170403 28334 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:32.175094 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.163604 28337 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.150573 28376 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.154892 28238 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:32.209182 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 154884us
I20260709 12:10:32.214586 28238 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:32.216729 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:32.213881 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 79265.8us
I20260709 12:10:32.213621 28381 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:32.164964 28344 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:32.223620 28367 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 12:10:32.226119 25583 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.004s (SENT)
I20260709 12:10:32.227460 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:32.236461 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.240784 25619 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:32.242408 25583 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:32.243897 25687 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:10:32.245242 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.246140 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.248225 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.249065 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:32.252861 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 156687us
I20260709 12:10:32.254526 25687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
W20260709 12:10:32.259063 28372 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:10:32.260449 28390 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.242468 28337 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:32.261535 25687 raft_consensus.cc:606] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:32.262092 25687 raft_consensus.cc:614] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:32.231401 28378 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.266770 25614 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:32.268366 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 123508us
W20260709 12:10:32.277854 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55577.8us
W20260709 12:10:32.279038 25583 leader_election.cc:336] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.023s (SENT)
I20260709 12:10:32.252499 28376 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:32.285341 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.287292 25583 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.074s (SENT)
I20260709 12:10:32.280947 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.293195 28390 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.296856 25619 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:32.266921 28337 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:32.304888 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 165111us
I20260709 12:10:32.305387 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:32.307420 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1215) took 1087 ms. Trace:
I20260709 12:10:32.274466 28378 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.307801 25691 rpcz_store.cc:276] 0709 12:10:31.219845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.769623 (+549778us) service_pool.cc:224] Handling call
0709 12:10:32.037792 (+268169us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:10:32.049166 (+ 11374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.049444 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:32.251222 (+201778us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.307060 (+ 55838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.307103 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:32.307135 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.307230 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.307357 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3620,"spinlock_wait_cycles":11881216,"thread_start_us":200695,"threads_started":2}
I20260709 12:10:32.314960 25658 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:32.314678 28376 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.308251 28337 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:32.318039 27957 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.318150 28344 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.318745 27957 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.299458 28351 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.319224 27957 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.320518 28344 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.321419 28344 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:32.319319 28351 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.322518 28351 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.323040 28370 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:10:32.322922 28390 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.324329 28382 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.310384 28086 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.327800 28337 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.331020 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:32.333947 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84975.3us
I20260709 12:10:32.334713 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.335181 25658 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:32.338317 25658 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:32.339383 28340 raft_consensus.cc:2764] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:32.340288 28382 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:32.340794 28382 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.341807 28382 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.344422 28365 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.345028 28365 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.345947 28365 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.346619 28340 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.347170 28340 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.347792 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.348731 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.350925 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.351595 28156 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.352028 28391 consensus_queue.cc:1059] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.353157 28374 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.355088 28161 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:32.364409 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.310456 28378 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.357983 28368 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
I20260709 12:10:32.358579 25614 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:32.359042 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:32.385108 28394 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.385608 28394 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:32.385979 28394 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.393834 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.399029 25611 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.400038 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.383925 28344 raft_consensus.cc:2764] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:32.411577 28337 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.423619 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.407053 28061 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:32.426045 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 145918us
I20260709 12:10:32.401643 28362 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:32.382412 28238 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:32.428764 25583 leader_election.cc:336] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.074s (SENT)
W20260709 12:10:32.446149 28357 consensus_meta.cc:287] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.003s
I20260709 12:10:32.381533 28363 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.448019 28374 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.448792 28382 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:32.449657 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55932.9us
I20260709 12:10:32.348167 28340 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:32.456260 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.456090 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:32.458817 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 93368.1us
I20260709 12:10:32.427477 28061 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:32.481881 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.488073 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.493148 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:32.495827 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67131.6us
W20260709 12:10:32.496755 25583 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.096s (SENT)
I20260709 12:10:32.498566 28238 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.462895 28382 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:32.465656 28161 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.507141 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.509399 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 46) took 6520 ms. Trace:
I20260709 12:10:32.492837 28061 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.494626 28362 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:32.540597 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47549.9us
I20260709 12:10:32.522426 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.541391 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.495769 28374 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.542359 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.507856 28382 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.548579 25582 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.516152 28156 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:32.507620 28161 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:32.555367 28156 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.520287 25516 rpcz_store.cc:276] 0709 12:10:25.985186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.985403 (+   217us) service_pool.cc:224] Handling call
0709 12:10:32.505717 (+6520314us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:31.388014 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:31.388608 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:31.388645 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:31.388665 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:31.389031 (+   366us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:31.389107 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:31.389148 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:31.389338 (+   190us) tablet.cc:701] Row locks acquired
0709 12:10:31.389356 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:31.389522 (+   166us) write_op.cc:270] Start()
0709 12:10:31.389645 (+   123us) write_op.cc:276] Timestamp: P: 1783599031389470 usec, L: 0
0709 12:10:31.389664 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:31.410887 (+ 21223us) log.cc:844] Serialized 500 byte log entry
0709 12:10:32.171107 (+760220us) op_driver.cc:464] REPLICATION: finished
0709 12:10:32.302978 (+131871us) write_op.cc:301] APPLY: starting
0709 12:10:32.307895 (+  4917us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:32.312681 (+  4786us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:32.312828 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:32.313135 (+   307us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:32.313349 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:32.313406 (+    57us) write_op.cc:312] APPLY: finished
0709 12:10:32.313629 (+   223us) log.cc:844] Serialized 22 byte log entry
0709 12:10:32.313837 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.313932 (+    95us) write_op.cc:454] Released schema lock
0709 12:10:32.313978 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:32.314530 (+   552us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.314557 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3159755,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":96655,"apply.run_cpu_time_us":2246,"apply.run_wall_time_us":30273,"num_ops":1,"prepare.queue_time_us":229624,"prepare.run_cpu_time_us":3057,"prepare.run_wall_time_us":50180,"replication_time_us":781243,"thread_start_us":205778,"threads_started":2}]]}
I20260709 12:10:32.557562 28156 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.559084 28156 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.563973 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:32.564098 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:32.514889 28399 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:32.540467 28238 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.540215 28375 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:32.573045 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.554056 28374 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.600409 28375 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.600926 28375 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:32.601265 28374 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.546370 28393 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.521597 28400 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:10:32.539888 27957 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.578713 28399 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.610714 28399 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.611719 27957 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:32.613180 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.579604 28363 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.579900 28394 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.552592 28402 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.519649 28334 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.590399 28373 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:32.564920 28161 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.551925 28338 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.549609 28337 raft_consensus.cc:2764] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:10:32.562538 28344 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.598392 28357 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.599103 28238 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:32.608515 28400 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:32.545166 28391 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 12:10:32.629783 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.656001 25611 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:32.622725 28086 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:32.671474 26304 leader_election.cc:336] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.839s (SENT)
W20260709 12:10:32.690593 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 200588us
I20260709 12:10:32.758728 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.690764 28393 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:32.691431 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 147882us
W20260709 12:10:32.703729 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 155959us
W20260709 12:10:32.714903 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.762248 25583 leader_election.cc:336] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.137s (SENT)
I20260709 12:10:32.626423 28338 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.599848 28351 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.645258 28400 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.655027 28373 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:32.733574 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 187357us
W20260709 12:10:32.737123 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.608556 28378 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:32.802428 25517 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.806413 28378 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.655143 28344 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.806365 25517 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.807384 28394 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.808044 28344 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.808346 25517 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:32.760313 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 88886.1us
I20260709 12:10:32.810842 28393 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.813534 28334 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:32.813551 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:32.816706 25517 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.818943 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:32.820853 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 256989us
I20260709 12:10:32.823236 25517 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:32.827332 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 65121.7us
W20260709 12:10:32.829092 25583 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.158s (SENT)
I20260709 12:10:32.830637 25610 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:32.774097 28381 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.837422 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.834904 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.839309 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.839576 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.840075 28416 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:32.840572 25615 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:32.841367 28416 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.841696 28390 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.842237 28390 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.842799 28376 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.843185 28238 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:32.843815 28238 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:32.843866 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 39e6df07fdde400cbbefc675d486ab4a with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:39676
I20260709 12:10:32.844270 28238 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.843204 28376 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.845532 28376 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.836298 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:32.836983 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:32.841934 28416 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.803210 28373 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:32.771298 28338 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.849608 25613 raft_consensus.cc:2368] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:32.843276 28390 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.849267 25617 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.855324 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.857087 25517 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.860102 28365 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:32.861891 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.861160 25517 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:32.862913 25517 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 4, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 4 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:32.848183 28086 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.864612 25517 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:32.869203 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:32.873268 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.845520 28238 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:32.877010 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.880930 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:32.851835 28408 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.885730 28344 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:32.852628 28402 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:32.894124 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 65064.7us
W20260709 12:10:32.895879 25583 leader_election.cc:336] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.163s (SENT)
I20260709 12:10:32.896615 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:32.856783 28410 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.873883 28086 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:32.906124 25517 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:32.881946 28156 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.881104 28400 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.930495 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:32.949868 25658 leader_election.cc:400] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:32.951713 25658 leader_election.cc:403] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:32.951803 25767 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:32.857203 28061 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:32.894626 28238 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.929738 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:32.930895 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:32.954759 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:32.959097 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:32.959182 25765 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.959659 25760 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.959784 25759 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:32.955127 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:32.960762 25764 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:32.963562 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 78338.6us
I20260709 12:10:32.876832 27957 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:32.966478 28339 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:32.958932 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 63092.2us
I20260709 12:10:32.971444 28391 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:32.961721 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.972988 28391 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:32.974797 28391 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:32.975792 28424 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:32.976143 28391 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:32.972996 25583 leader_election.cc:336] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.199s (SENT)
W20260709 12:10:32.979077 25583 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.214s (SENT)
W20260709 12:10:32.980249 25583 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.300s (SENT)
I20260709 12:10:32.974677 25657 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:32.980880 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:32.886039 28362 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:10:32.989769 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:32.990562 25763 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.919176 28344 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:32.987035 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:32.987339 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.000180 25762 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:32.994320 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:32.994526 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:32.981513 25517 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:32.885946 28415 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 12:10:32.985904 28391 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.015751 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:32.920565 28156 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:32.919657 28086 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.020612 25767 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:33.021580 25760 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:33.014384 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:32.990422 28424 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:32.990617 28393 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:32.989827 25764 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:33.012825 28379 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.028956 25517 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:33.028069 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.046830 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.048072 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.012333 28334 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.026902 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:33.043457 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.058300 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:33.059429 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.044926 26337 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:33.065579 25765 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:33.039448 28402 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.016074 28344 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:32.920049 28373 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.055092 28416 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.061734 25763 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:33.061877 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:33.072994 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:33.063030 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.028296 28156 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.067987 25517 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 8 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:33.042557 28424 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:33.083055 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.084528 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.087747 25610 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:33.085889 25616 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:33.091739 28373 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.118577 28407 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.119848 25612 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:33.121739 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.122661 25612 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:33.124574 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.125502 25610 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:33.092657 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.099035 25517 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:33.042325 28375 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.149590 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.149726 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:33.117396 28382 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.000s
I20260709 12:10:33.172019 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.055552 28102 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.169s
I20260709 12:10:33.124702 28379 raft_consensus.cc:2764] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:33.174711 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:33.090569 28424 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.089731 28408 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:33.179731 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.179615 25517 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:33.181483 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 248074us
I20260709 12:10:33.187578 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.072994 28334 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.200371 25617 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:33.200971 25618 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:33.201967 25616 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:10:33.202349 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.202745 28344 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.203150 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.211112 25762 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.203801 25768 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:33.208738 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:33.183996 28420 tablet_replica.cc:333] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
W20260709 12:10:33.183794 28423 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:10:33.177979 28382 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.346139 25619 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:33.352653 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 372439us
I20260709 12:10:33.243671 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:33.226922 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.272351 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.184111 28409 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:33.184201 28414 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:33.359754 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.250592 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:33.261782 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.183930 28401 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:33.383973 25762 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
W20260709 12:10:33.385244 25583 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.304s (SENT)
I20260709 12:10:33.217594 25517 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:33.396266 25615 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:33.399006 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.399410 28375 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:33.400383 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.401546 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.240850 28430 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:33.402729 28430 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:33.243748 28427 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:33.406169 28427 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.409372 28427 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:33.243884 28397 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.258s
I20260709 12:10:33.410058 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.395166 28409 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.411970 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.412642 25613 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:33.419211 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 303789us
I20260709 12:10:33.424362 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.425244 25764 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.428478 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.429443 25767 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:33.186050 28408 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:33.327976 28340 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.358352 28431 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.206213 28428 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:33.393142 28338 consensus_meta.cc:287] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.001s
I20260709 12:10:33.273460 28334 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.437425 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.391026 28061 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.440294 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.393563 28401 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:33.347854 28404 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.183s
I20260709 12:10:33.333966 28086 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.431303 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.473335 25760 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.644680 25762 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:33.432528 28427 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.616499 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.646412 25767 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:33.628257 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.609935 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.648360 25610 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:33.451654 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.618474 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 262868us
I20260709 12:10:33.651083 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:33.651654 25583 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.384s (SENT)
W20260709 12:10:33.652885 25583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.713s (SENT) [suppressed 99 similar messages]
I20260709 12:10:33.644901 25761 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.472501 28431 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.446084 25764 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:33.563409 25517 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:33.433308 28426 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:33.480178 28339 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.005s
I20260709 12:10:33.662773 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.437356 28408 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.437844 28340 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:33.624898 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:33.577273 28393 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:33.562212 28430 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:33.679104 28436 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:33.647435 28401 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.672299 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.679080 25517 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:33.649906 28428 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:33.679183 28440 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:33.670368 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.643378 28338 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.671517 28339 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:33.696002 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.693492 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.696913 25759 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:33.697898 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.648741 28427 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.691951 25761 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:33.691855 25517 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:10:33.676927 28156 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.004s
I20260709 12:10:33.703733 25517 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:33.707557 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:33.709213 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.710096 25761 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:33.717818 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.721305 25759 raft_consensus.cc:2393] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:33.706888 28404 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.724839 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.725592 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.697695 28409 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:33.726642 25760 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:33.669517 28426 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.727082 25759 raft_consensus.cc:2368] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:33.699790 28382 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.727900 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.731094 25759 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:10:33.732683 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.732702 25517 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:33.735133 25657 connection.cc:256] RPC call timeout handler was delayed by -2.4603202020000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:10:33.683808 28393 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:33.735543 25657 connection.cc:256] RPC call timeout handler was delayed by -2.1867202020000605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 12:10:33.736294 25760 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:33.740690 25761 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:10:33.735996 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 83147.3us
I20260709 12:10:33.745590 25759 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:33.716349 28156 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.732204 28404 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:33.750349 28443 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:10:33.739080 28376 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.893s	user 0.014s	sys 0.000s
I20260709 12:10:33.750768 25760 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:33.755474 28338 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:33.755995 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.756847 28439 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:33.763540 25759 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.738013 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:33.750563 25761 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:33.766618 25583 connection.cc:256] RPC call timeout handler was delayed by -1.1660973470000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 12:10:33.770917 25583 connection.cc:256] RPC call timeout handler was delayed by -1.1448258919999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 12:10:33.771442 25583 connection.cc:256] RPC call timeout handler was delayed by -1.0578243129998555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 12:10:33.772089 28086 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.774348 28428 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:33.776779 28161 consensus_meta.cc:287] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.131s	user 0.013s	sys 0.000s
I20260709 12:10:33.777230 28161 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.720199 28340 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:33.779264 25583 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.549s (SENT)
W20260709 12:10:33.782975 28446 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:33.780027 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.784765 28426 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:33.785383 25760 raft_consensus.cc:2368] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:33.786690 28427 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:33.788621 28393 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.772934 28431 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.780225 25657 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:33.794174 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.795248 25565 placement_policy_util.cc:248] tablet 39e6df07fdde400cbbefc675d486ab4a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 12:10:33.795598 28404 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.796296 28404 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.798498 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.806075 25760 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:33.772365 28238 consensus_meta.cc:287] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.006s
I20260709 12:10:33.815207 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1892) took 1276 ms. Trace:
I20260709 12:10:33.827750 25619 rpcz_store.cc:276] 0709 12:10:32.538519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.538657 (+   138us) service_pool.cc:224] Handling call
0709 12:10:32.549161 (+ 10504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.352252 (+803091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.814807 (+462555us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54003a7854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:33.815115 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832338688}
I20260709 12:10:33.828989 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.829751 25693 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:33.814082 28431 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.831017 28431 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.831815 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.833307 28431 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.835327 25689 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:33.836709 25765 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:33.837141 25761 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:33.837076 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.837980 25689 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:33.771064 28376 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:33.817335 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.820531 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.821319 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.848492 25610 raft_consensus.cc:1217] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-8.5]   Dedup: 8.5->[]
I20260709 12:10:33.854471 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.854980 25690 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:33.855832 25614 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:33.840276 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.858276 25610 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 12:10:33.855196 25760 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:33.858196 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.860157 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.860349 25689 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:33.860615 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:10:33.861708 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.838119 25765 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:33.840749 28156 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.867233 28351 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.859803 28390 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:33.873514 25616 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:33.875818 28400 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.882091 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:33.882902 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.882428 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:33.886304 25617 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:33.888324 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.863149 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.897336 25658 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:33.902887 25760 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:33.841341 28340 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.906214 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:33.861776 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:33.911285 25611 raft_consensus.cc:2368] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 7.
I20260709 12:10:33.911361 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:33.912984 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:33.927469 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.928179 25687 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:33.929733 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:33.931883 28238 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.932367 28238 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.932727 28238 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.934600 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:33.935292 28434 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.935798 28434 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.936081 25766 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.936105 28434 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.927002 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:33.938642 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.947085 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:33.862725 28374 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:33.951601 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89937.2us
W20260709 12:10:33.913007 28391 consensus_meta.cc:287] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.882s	user 0.005s	sys 0.010s
I20260709 12:10:33.909431 28398 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.955428 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:33.952474 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:33.956385 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.963548 25687 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:33.965590 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.953343 28379 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:33.966964 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:33.967335 28161 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.968771 28393 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.974720 28379 consensus_queue.cc:1243] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:33.975672 28379 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.976151 28379 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:33.977306 28379 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.979348 28379 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.980815 28437 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.981408 28437 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.959273 28374 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:33.984354 28437 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.959544 28086 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:33.984477 28374 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:33.986367 28339 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.953332 28431 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:33.986907 28339 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.987502 28431 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.987867 28431 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:33.989032 28339 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:33.988759 28431 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.991269 25615 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:33.991600 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:33.974911 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 1423) took 1045 ms. Trace:
I20260709 12:10:33.992700 25768 rpcz_store.cc:276] 0709 12:10:32.929357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.929495 (+   138us) service_pool.cc:224] Handling call
0709 12:10:33.974700 (+1045205us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540024a4d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:33.974846 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532823936}
W20260709 12:10:33.999241 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46857.7us
I20260709 12:10:34.000443 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:34.001750 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:33.985090 28437 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.990058 28431 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.953794 28351 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:10:33.960271 28424 consensus_meta.cc:287] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
I20260709 12:10:33.965521 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:34.020490 25688 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:33.960026 28416 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:34.017298 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:34.024724 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:33.973917 28408 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:33.995005 28418 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.033654 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:34.033514 25766 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:34.035431 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.004094 28357 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:34.013823 28390 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:34.034916 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69511.6us
I20260709 12:10:34.018424 28374 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:34.041764 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.042299 25691 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:34.014375 28398 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:34.042865 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:34.054294 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.032847 28427 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:34.062671 25685 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:34.033452 28334 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.029870 28351 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:34.072192 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 91810.2us
I20260709 12:10:34.043416 28394 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.079133 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.081905 25610 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:34.027666 28161 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:34.051477 28338 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:34.081969 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53295.8us
I20260709 12:10:34.025869 28424 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:34.026036 28437 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.095315 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.100013 25691 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:34.101925 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.048014 28426 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:34.102581 25692 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.064577 28427 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.062718 28390 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:34.053413 28393 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:34.052953 28357 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.117576 25687 raft_consensus.cc:1240] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.093875 28338 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:34.141623 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.142470 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.101747 28334 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:34.145383 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.149744 25691 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:34.144511 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.093885 28416 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:34.151047 25687 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
W20260709 12:10:34.178653 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 126146us
I20260709 12:10:34.117506 28427 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:34.189208 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:34.192628 25583 leader_election.cc:336] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.915s (SENT)
W20260709 12:10:34.193531 25583 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.086s (SENT)
W20260709 12:10:34.194181 25583 leader_election.cc:336] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.114s (SENT)
I20260709 12:10:34.201169 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.201996 25687 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:34.134721 28338 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.105835 28382 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:10:34.210099 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.214816 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.206614 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.214701 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.216221 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.216996 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.218504 25690 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
W20260709 12:10:34.219216 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 128046us
I20260709 12:10:34.219933 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:34.217808 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 81970.6us
I20260709 12:10:34.221184 25685 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
W20260709 12:10:34.224714 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.174365 28374 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:34.201622 28086 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.177881 28376 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:34.234287 25688 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.242061 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.243551 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.244445 25685 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:34.237252 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:34.239096 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 123047us
I20260709 12:10:34.239022 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.246318 25689 raft_consensus.cc:2410] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:10:34.252149 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.262234 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.265321 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.266249 25685 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 4.
I20260709 12:10:34.150417 28398 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.297418 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.298727 25685 raft_consensus.cc:2410] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:34.298346 28334 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.276962 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.301879 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.299813 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.302960 25685 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:34.303485 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.304257 25689 raft_consensus.cc:2376] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5. Re-sending same reply.
I20260709 12:10:34.305199 25692 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:34.305308 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.306143 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:34.306622 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.280906 28451 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:10:34.281937 28453 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:34.285570 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.286986 28432 consensus_queue.cc:1059] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:34.290823 28416 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.294495 28238 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:34.203665 28351 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.314826 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:34.315485 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51593.8us
I20260709 12:10:34.318436 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.322935 25685 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:34.255899 28086 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.328413 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.330822 25693 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:34.337805 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.338510 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.340121 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.341035 25693 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:34.343401 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.326543 28408 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:34.344121 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 146490us
I20260709 12:10:34.362788 28086 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:34.346474 28238 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:34.376085 28337 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.378687 28457 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.363283 28374 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:34.378314 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 157853us
I20260709 12:10:34.381469 25582 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:34.383672 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:34.384305 25612 raft_consensus.cc:606] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:34.384670 25612 raft_consensus.cc:614] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:34.346621 25694 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:34.354501 28357 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:34.362419 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.266297 28390 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:34.344611 28401 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.007s
I20260709 12:10:34.371380 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.390597 25693 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:34.385643 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:34.398682 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 177604us
W20260709 12:10:34.381402 28404 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 12:10:34.402638 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.403579 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.458870 25614 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:34.374557 28437 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:34.421845 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.401885 26303 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:34.457182 25685 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:34.405292 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:34.472515 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:34.474431 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:34.474591 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:34.474817 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.475067 25760 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.475359 25613 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:34.475096 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.463384 28471 raft_consensus.cc:3055] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:34.476899 28471 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:34.465986 25692 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.477965 28471 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:34.480877 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:34.481315 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.482005 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.483685 25618 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:34.484778 25761 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:34.485253 25618 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.482681 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.482921 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:34.487897 25613 raft_consensus.cc:2368] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:34.491061 25764 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:34.494331 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 89093.4us
I20260709 12:10:34.460075 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.503885 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.504670 25685 raft_consensus.cc:2376] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6. Re-sending same reply.
I20260709 12:10:34.505050 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:34.390833 28394 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.495631 25693 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
W20260709 12:10:34.509963 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 108192us
I20260709 12:10:34.514626 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:34.514935 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:34.516692 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:34.519307 25763 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:34.519553 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.519537 25766 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:34.527719 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.528487 25688 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:34.529390 25689 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:34.460343 28404 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.534081 25692 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:34.534611 25760 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:34.459460 28464 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.542613 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.543699 25693 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:34.538516 25732 leader_election.cc:336] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.509s (SENT)
I20260709 12:10:34.539630 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.402915 28401 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.547664 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.548012 25686 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:34.548877 28401 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:34.549026 25689 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.544847 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:34.393743 28460 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 12:10:34.522650 28456 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.552098 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.553007 25688 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:34.517369 26334 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.535818 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.581648 25685 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:34.508204 28394 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.539711 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.579036 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:34.582682 25732 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.538s (SENT)
I20260709 12:10:34.583325 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:34.580508 28357 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.589458 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.590816 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.591785 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.592262 25692 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 4.
I20260709 12:10:34.592958 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.599958 25692 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.601715 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.604272 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.608227 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.609197 25688 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:34.532346 28466 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:10:34.616091 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.581218 28420 raft_consensus.cc:2243] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:10:34.622449 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.587085 28394 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.635823 25689 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:34.636032 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 53406.1us
W20260709 12:10:34.637027 25732 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.541s (SENT)
I20260709 12:10:34.637543 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:34.638047 25689 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:34.638574 25689 pending_rounds.cc:85] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 4
I20260709 12:10:34.638898 25689 pending_rounds.cc:107] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:34.639196 25689 raft_consensus.cc:2889] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.639988 25688 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:10:34.641203 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 97858us
I20260709 12:10:34.642670 25689 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.645066 25689 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:34.596032 28456 raft_consensus.cc:697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:34.671970 25693 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:34.673460 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.555518 28467 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:10:34.595338 28238 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:10:34.673910 25732 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.556s (SENT)
I20260709 12:10:34.623622 28426 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:34.674125 25688 raft_consensus.cc:2376] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:10:34.683622 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:34.677464 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:34.623174 28464 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:34.689287 25692 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:34.718896 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.720597 28464 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.679251 28469 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:34.793953 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.804560 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.805868 25693 raft_consensus.cc:2376] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7. Re-sending same reply.
I20260709 12:10:34.728343 28374 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:34.803568 28340 consensus_meta.cc:287] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.873s	user 0.014s	sys 0.000s
I20260709 12:10:34.847615 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.857264 25691 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
W20260709 12:10:34.832362 28379 consensus_meta.cc:287] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.009s
W20260709 12:10:34.841053 28338 consensus_meta.cc:287] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.007s
W20260709 12:10:34.891010 28473 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:10:34.891549 28433 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.178s
W20260709 12:10:34.892907 28472 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.305s	user 0.000s	sys 0.000s
W20260709 12:10:34.893404 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.899854 28475 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
W20260709 12:10:34.902420 28434 consensus_meta.cc:287] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.965s	user 0.015s	sys 0.001s
I20260709 12:10:34.914842 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:34.924011 25687 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:34.770395 28458 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:10:34.926199 25692 raft_consensus.cc:2376] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6. Re-sending same reply.
I20260709 12:10:34.775341 28426 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.937078 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:34.937484 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.924381 28339 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:34.951602 25694 consensus_meta.cc:287] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 12:10:34.952163 25694 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:34.935180 28374 raft_consensus.cc:697] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:34.912753 28338 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.944432 28339 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:34.957546 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:34.957966 28339 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.959707 28339 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:34.950510 28400 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.007s
I20260709 12:10:34.928532 28434 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:34.969714 25690 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:10:34.969938 25583 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.210s (SENT)
W20260709 12:10:34.970846 25583 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.220s (SENT)
I20260709 12:10:34.907505 28456 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:34.971836 25583 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.234s (SENT)
I20260709 12:10:34.974970 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:34.971602 28480 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 12:10:34.986774 28374 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:34.980494 28434 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:34.971426 28404 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.987720 28338 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:35.014611 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.017194 28427 consensus_meta.cc:287] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.810s	user 0.005s	sys 0.009s
I20260709 12:10:35.017719 28427 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.018712 28424 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:35.019841 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet d5b02303361d43d1903c3e943b866b64: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:34.996779 28404 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:35.026227 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 352341us
W20260709 12:10:35.028647 25732 leader_election.cc:336] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.722s (SENT)
I20260709 12:10:35.031993 28420 raft_consensus.cc:2272] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:35.034358 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.035840 25688 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:35.036478 28486 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.036947 28486 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:35.037035 28338 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.039997 26334 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:35.040787 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.739s (SENT)
I20260709 12:10:35.041338 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.042222 28338 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:35.048874 25732 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.751s (SENT)
I20260709 12:10:35.049458 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:35.050813 25732 leader_election.cc:336] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.781s (SENT)
I20260709 12:10:35.051265 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.051962 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:35.103081 28484 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.291s	user 0.001s	sys 0.003s
W20260709 12:10:35.103210 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52421.8us
I20260709 12:10:35.103741 28420 ts_tablet_manager.cc:1916] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:35.106881 25692 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.038026 28486 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:35.053658 28409 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.109944 25692 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.110350 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet 594f26e3426243d5b79945733b1f2dd5: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:10:35.115578 25732 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.838s (SENT)
I20260709 12:10:35.116070 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.120519 28394 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:35.122808 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 67117.6us
I20260709 12:10:35.055335 28344 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:35.123553 25762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.001s	sys 0.018s
W20260709 12:10:35.140920 25762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.001s	sys 0.018s
I20260709 12:10:35.125445 25692 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.125764 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:35.126549 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.145005 25686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1260) took 1330 ms (client timeout 1651 ms). Trace:
W20260709 12:10:35.145529 25686 rpcz_store.cc:269] 0709 12:10:33.794022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.798180 (+  4158us) service_pool.cc:224] Handling call
0709 12:10:35.124388 (+1326208us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54003ff054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:35.124580 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721347456}
I20260709 12:10:35.159394 25694 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:35.169286 25686 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:35.188320 25688 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:35.186384 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.198452 25762 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.184644 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:35.199862 25611 raft_consensus.cc:2368] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 7.
I20260709 12:10:35.161875 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:35.161744 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46214.1us
I20260709 12:10:35.201145 25614 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:35.201128 25732 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.845s (SENT)
I20260709 12:10:35.202780 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:35.205087 25732 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.863s (SENT)
W20260709 12:10:35.207412 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.205897 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.208000 25688 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:35.213637 25688 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:35.186599 28469 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.219256 25688 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:35.216840 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:35.221776 25694 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.169754 28409 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.227265 28338 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.229346 28471 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:35.230855 28499 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:10:35.232198 25732 leader_election.cc:336] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.869s (SENT)
I20260709 12:10:35.263310 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:35.264513 25732 leader_election.cc:336] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.871s (SENT)
I20260709 12:10:35.264561 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:35.265074 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.235822 28394 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:35.243911 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:35.266130 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.267345 25732 leader_election.cc:336] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.924s (SENT)
I20260709 12:10:35.212450 28427 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:35.275210 26334 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.278978 25583 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:35.267854 28357 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:35.268071 28469 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.283691 28404 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:35.287220 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:35.287592 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.268220 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.263595 28409 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:35.334118 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55263us
I20260709 12:10:35.288002 25686 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.206697 28428 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.289076 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:35.290620 25732 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.972s (SENT)
I20260709 12:10:35.340023 25694 raft_consensus.cc:2376] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
W20260709 12:10:35.340342 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49754.8us
W20260709 12:10:35.341068 25732 leader_election.cc:336] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.048s (SENT)
I20260709 12:10:35.341449 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.259316 25762 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:35.300206 28394 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.303208 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:35.344687 25614 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.304291 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:35.345439 25611 raft_consensus.cc:2376] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7. Re-sending same reply.
I20260709 12:10:35.345682 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.346433 25768 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:35.261440 28426 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:35.348963 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.343187 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:35.308185 28338 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:35.349764 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.354360 25762 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:35.364545 25732 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.228s (SENT)
I20260709 12:10:35.365302 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.366775 25762 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
W20260709 12:10:35.367204 25732 leader_election.cc:336] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.244s (SENT)
I20260709 12:10:35.367658 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.368304 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.370016 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.371387 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.373809 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:35.379505 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.382375 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:35.352447 28469 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:35.423044 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.412286 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.423959 25760 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:35.413857 25614 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:35.415959 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.425834 25759 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.419101 25686 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:35.384685 28398 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.428292 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.436674 25766 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.379506 28496 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.390479 28362 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.409935 28338 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.424674 28458 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:35.412938 28409 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:35.473935 25762 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:35.439280 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.478178 25759 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:35.479694 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.470779 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.485278 25766 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:35.486125 25761 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.439244 28457 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:35.502482 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:35.503746 25759 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 5: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:35.486740 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.504490 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.504218 28458 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:35.519395 25763 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:35.457005 28362 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.523273 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1289) took 1330 ms. Trace:
W20260709 12:10:35.524130 25691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1280) took 1336 ms (client timeout 1556 ms). Trace:
W20260709 12:10:35.526868 25691 rpcz_store.cc:269] 0709 12:10:34.187604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.187763 (+   159us) service_pool.cc:224] Handling call
0709 12:10:35.523974 (+1336211us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400328a54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:35.524077 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463172992}
I20260709 12:10:35.524947 25693 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:35.526067 25690 rpcz_store.cc:276] 0709 12:10:34.192693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.226753 (+ 34060us) service_pool.cc:224] Handling call
0709 12:10:35.523043 (+1296290us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54003e3fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:35.523194 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670988032}
I20260709 12:10:35.531821 25761 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:35.536557 25763 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:35.455495 28398 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.537050 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:35.504786 28416 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:35.536545 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:35.505115 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:35.525588 28457 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:35.547668 28420 ts_tablet_manager.cc:1929] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:10:35.554975 25614 raft_consensus.cc:606] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:35.543901 28398 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:35.555961 25759 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:35.580520 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:35.559528 25768 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:35.560659 28416 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.581843 25766 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:35.582885 25768 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:35.584615 25768 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.563220 25761 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:35.567307 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 224242us
I20260709 12:10:35.568244 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:35.571303 25760 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:35.571400 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 189188us
I20260709 12:10:35.595363 25768 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:35.572563 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 205374us
I20260709 12:10:35.604744 25761 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.570892 28362 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:35.657641 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48553.3us
I20260709 12:10:35.660135 25768 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:35.602913 28420 log.cc:1199] T 39e6df07fdde400cbbefc675d486ab4a P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/39e6df07fdde400cbbefc675d486ab4a
W20260709 12:10:35.666706 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 292967us
I20260709 12:10:35.663812 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:35.686754 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.604182 28394 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:35.656785 28434 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.715919 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:35.665655 28409 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.719393 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.725530 25766 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:35.724408 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62925.5us
I20260709 12:10:35.741444 28427 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:35.751327 28482 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.980s	user 0.004s	sys 0.002s
I20260709 12:10:35.753509 28420 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39676 (request call id 62) took 2956 ms. Trace:
W20260709 12:10:35.762279 25687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1287) took 1571 ms (client timeout 1863 ms). Trace:
I20260709 12:10:35.762614 25689 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:35.762779 25687 rpcz_store.cc:269] 0709 12:10:34.192016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.202838 (+ 10822us) service_pool.cc:224] Handling call
0709 12:10:35.762043 (+1559205us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400194bd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:35.762191 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624217984}
I20260709 12:10:35.754017 28420 rpcz_store.cc:276] 0709 12:10:32.839217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.843527 (+  4310us) service_pool.cc:224] Handling call
0709 12:10:33.045747 (+202220us) ts_tablet_manager.cc:1151] Deleting tablet 39e6df07fdde400cbbefc675d486ab4a
0709 12:10:33.056052 (+ 10305us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:35.031245 (+1975193us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54003b7c54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d63362 00007fbdb674e34c 00007fbdb7d7160a 00007fbdb7da22d0 00007fbdb7d8883d 00007fbdb7d887e9 00007fbdb7d88779 00007fbdb7d88741 00007fbdb7d8796d 0000000000388634
0709 12:10:35.119259 (+ 88014us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:35.547494 (+428235us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:35.753366 (+205872us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":651156,"spinlock_wait_cycles":1586683136,"tablet-delete.queue_time_us":185125,"thread_start_us":60690,"threads_started":1}
W20260709 12:10:35.776110 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89493.7us
I20260709 12:10:35.720453 28514 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:35.667598 28496 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:10:35.726850 28469 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.785202 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1457) took 1301 ms. Trace:
I20260709 12:10:35.791282 25767 rpcz_store.cc:276] 0709 12:10:34.483610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.483740 (+   130us) service_pool.cc:224] Handling call
0709 12:10:34.484178 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.484619 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.484649 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.485180 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.523010 (+ 37830us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:34.523050 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.523121 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.750425 (+1227304us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:35.776489 (+ 26064us) raft_consensus.cc:1685] finished
0709 12:10:35.776513 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.785132 (+  8619us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":107364608,"thread_start_us":37421,"threads_started":1,"wal-append.queue_time_us":137733}
I20260709 12:10:35.785772 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:35.793562 25612 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:35.793923 25612 raft_consensus.cc:614] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:35.794845 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.797768 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 206839us
I20260709 12:10:35.783943 28401 raft_consensus.cc:2764] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:10:35.784123 28508 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:10:35.722146 28434 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.776175 28513 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.799293 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.799757 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 39e6df07fdde400cbbefc675d486ab4a (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:10:35.801235 28339 consensus_queue.cc:1059] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 12:10:35.879034 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 80525.9us
W20260709 12:10:35.888928 25502 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89127.9us
I20260709 12:10:35.889429 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:35.788486 28514 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.799861 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:35.883155 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 105284us
I20260709 12:10:35.883745 28519 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:35.883870 28394 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.730051 28457 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.727916 28409 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:35.891894 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:35.879825 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:35.794615 28469 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:35.919190 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:35.883760 28416 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:35.902637 28401 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:35.922243 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 126299us
I20260709 12:10:35.927042 28339 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.905503 28514 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.922327 28518 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:35.921926 28424 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.925683 28516 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.923200 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:35.933928 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 214652us
I20260709 12:10:35.964450 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.968926 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.920750 28478 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:10:35.948210 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.922832 28469 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.915421 28513 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:35.964221 28458 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:35.977398 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:35.978547 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55446.9us
I20260709 12:10:35.915674 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.985283 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:35.995743 25692 raft_consensus.cc:606] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:35.994681 25657 leader_election.cc:400] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
W20260709 12:10:36.017633 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 102018us
W20260709 12:10:36.024972 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47683.9us
I20260709 12:10:36.025748 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:36.027168 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.981148 28496 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.985750 28339 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.976052 28527 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.012455 26334 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 3.
I20260709 12:10:36.024466 28418 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.047372 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:35.965888 28516 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.023373 28424 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:36.053170 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.047396 28427 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.040611 28528 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.072046 28516 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.073132 28362 raft_consensus.cc:3055] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.073565 28362 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:36.053478 28376 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:36.032027 28531 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:10:36.077913 28428 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.011719 28458 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.047492 28464 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:36.079833 28409 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:36.080210 28458 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.052230 28339 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:36.067973 28334 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:36.053395 28527 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.082142 28339 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.084003 25657 leader_election.cc:400] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:36.084487 25657 leader_election.cc:403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.085153 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.085558 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.090665 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.093488 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.093633 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.096892 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.097417 25732 leader_election.cc:400] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:10:36.097812 25732 leader_election.cc:403] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.100531 25732 leader_election.cc:400] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 7.
I20260709 12:10:36.100858 25732 leader_election.cc:403] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.102483 28428 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
W20260709 12:10:36.103331 28534 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:10:36.104678 25759 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.104947 28428 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.074594 28362 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:36.106524 28401 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.106633 28362 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.107748 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1291) took 1112 ms. Trace:
I20260709 12:10:36.108119 25693 rpcz_store.cc:276] 0709 12:10:34.995711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.995878 (+   167us) service_pool.cc:224] Handling call
0709 12:10:35.524594 (+528716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.528397 (+  3803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.107546 (+579149us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54003e3fd0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:36.107687 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205194496}
I20260709 12:10:36.110231 28344 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:36.110775 25764 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.110631 28334 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.111442 28527 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:36.111522 28334 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.111941 28527 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.112370 28527 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:36.112514 28334 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.113906 28334 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.110065 28427 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:36.096503 28516 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.117592 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:36.118323 25617 raft_consensus.cc:606] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:36.120435 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.091756 28404 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:36.130448 28515 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.131271 28515 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.101955 28486 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.069070 28434 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:36.133385 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet dcdef7196c6a445c945bb47541d7d3ac: Illegal state: Replica c781e437472a42e2a6162b67b1c7bbbd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:36.118207 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:36.144055 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.137447 28460 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:36.145833 28519 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:36.137890 28416 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:36.138000 28418 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:36.132633 28515 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:36.141181 28462 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:36.095050 28528 consensus_queue.cc:1059] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:10:36.133823 28424 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:36.195839 28338 consensus_queue.cc:1059] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:36.197175 28376 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.197403 28416 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:36.197656 28376 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.197892 28416 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.182353 28530 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.194677 28528 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.198787 28515 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:36.140825 28401 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:36.177024 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.208215 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.183327 28404 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.213189 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.214007 28531 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:36.214756 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 114355us
I20260709 12:10:36.215480 28339 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.215601 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:36.215945 28525 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.337s	user 0.009s	sys 0.003s
I20260709 12:10:36.216130 28339 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:36.217146 28339 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.218431 28409 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.202644 28528 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:36.219031 28409 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:36.219748 28528 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.221107 28528 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.220607 28409 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.206480 28515 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.218461 28416 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.223616 28515 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:36.224737 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet e4e477d5c41447338e4490daf6af0473: Illegal state: Replica c781e437472a42e2a6162b67b1c7bbbd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:36.224995 28515 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.209144 28404 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.228186 28404 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.228667 28401 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.224084 28416 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.231419 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:36.236316 28427 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.238875 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:36.235947 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.241581 25764 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:36.239912 25616 raft_consensus.cc:606] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:36.198935 28376 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.243333 28427 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:36.245136 28427 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.233197 28531 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.252434 28400 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:36.270788 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.249614 28496 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:36.274588 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.281801 25657 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:36.283569 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.281873 28384 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:36.286576 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:36.273131 28357 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.273686 28531 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:36.292629 28516 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:36.286628 28530 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.291775 28540 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.286963 28400 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:36.301370 28428 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 5. Current term is 7.
I20260709 12:10:36.299006 28357 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.303143 28161 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.324096 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.310909 28530 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:36.310700 28516 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:36.307808 28540 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.337481 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:36.319370 28161 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.350366 28536 raft_consensus.cc:993] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:36.353229 28469 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.354895 28394 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.355309 28161 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.360329 25761 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.371482 25765 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:36.361476 25763 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:36.362648 25764 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.374094 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:36.379911 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.379954 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.395922 25762 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:36.381031 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.384603 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.398069 25764 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:36.399107 26334 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:10:36.400465 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.591s (SENT)
I20260709 12:10:36.400949 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.402503 28338 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.403625 28469 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:36.394080 25616 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:36.360425 28376 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.409924 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:36.439499 25763 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:36.441807 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:36.444737 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 106422us
I20260709 12:10:36.328361 28531 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.375648 28394 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.436133 28400 raft_consensus.cc:697] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:36.458428 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.459267 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:36.449407 28516 raft_consensus.cc:1081] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:36.469732 28357 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:36.475368 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.476528 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.479035 28550 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.479770 28550 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.480707 28550 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.479683 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.455286 28434 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:36.482729 25692 raft_consensus.cc:1240] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.484573 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.485941 25685 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:36.486364 25685 pending_rounds.cc:85] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 5
I20260709 12:10:36.486546 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.487325 25692 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:36.455529 28374 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:36.488329 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.489674 28540 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:36.392304 28530 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:36.491153 28543 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:36.491539 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.490618 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.486589 25685 pending_rounds.cc:107] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:36.498699 25685 raft_consensus.cc:2889] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.498842 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.500602 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.501732 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.503197 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.504197 25686 raft_consensus.cc:2368] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7.
I20260709 12:10:36.503207 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.501185 25693 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:36.506906 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.507174 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.507684 25693 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:36.507759 25687 raft_consensus.cc:2376] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7. Re-sending same reply.
I20260709 12:10:36.509137 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.509914 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.510754 25693 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:36.511638 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.512238 25686 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.446570 28404 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.477447 28554 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:36.528409 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.526314 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.525761 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.525871 25686 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:36.521477 28536 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.530457 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.531131 25692 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:36.529979 25691 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 5: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:36.523609 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.533545 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.536306 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.498687 28344 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:36.540128 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:36.543947 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.548421 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.549539 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.550616 25694 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:36.552802 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.554383 28344 raft_consensus.cc:993] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:36.554958 28344 raft_consensus.cc:1081] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:36.525667 28374 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:36.532357 28549 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.556756 28549 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.558876 25763 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.560159 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.561343 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.562247 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:36.562424 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:36.565506 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.566046 25766 raft_consensus.cc:2410] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:36.544287 28460 raft_consensus.cc:993] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:36.569394 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:36.571600 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.571923 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.562487 28528 consensus_queue.cc:1059] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:10:36.573174 28557 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:36.573331 28496 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.574133 25732 leader_election.cc:400] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7.
I20260709 12:10:36.574383 28548 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.574534 25732 leader_election.cc:403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.575138 28548 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.575829 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.575785 28400 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:36.577574 28548 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.574146 28496 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.579656 28549 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.580719 28357 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.544099 28536 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.579578 28496 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Leader election lost for term 6. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7.
I20260709 12:10:36.549676 28338 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:36.590736 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.591617 25693 raft_consensus.cc:2376] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:10:36.600677 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.564985 28428 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:36.605464 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:36.610977 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.608045 25693 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.606325 25692 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.571961 28469 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.564751 28540 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.569705 28458 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:36.624768 25612 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.605379 28351 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.615566 28434 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.640218 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.657464 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:36.658125 25693 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:36.646767 25691 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:36.661527 25694 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:36.594238 28516 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.663630 25657 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.609241 28428 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.612548 28374 raft_consensus.cc:1081] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:36.672747 25693 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:10:36.683239 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89371.6us
I20260709 12:10:36.684892 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:36.655257 28514 consensus_meta.cc:287] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.006s
I20260709 12:10:36.612708 28334 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 12:10:36.736796 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 161016us
I20260709 12:10:36.739553 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.682750 28428 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:36.689626 28339 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.680086 28469 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:36.747910 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63087.9us
I20260709 12:10:36.654654 28486 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:36.689479 28458 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.688369 28362 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:36.682893 28351 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.696478 28379 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 12:10:36.742295 28527 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.008s
I20260709 12:10:36.777446 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.758343 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.680761 28516 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.693473 28418 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 12:10:36.792204 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 95246.2us
I20260709 12:10:36.706509 28460 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:10:36.758562 28536 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.775478 28357 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:36.786553 28515 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.561s	user 0.015s	sys 0.000s
I20260709 12:10:36.816046 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:36.696949 28514 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.758167 28344 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:36.779583 28488 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:36.853259 28458 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:36.863261 28563 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:10:36.864764 28564 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:10:36.853546 28351 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.855748 28516 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.781185 28339 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.859562 28550 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.876411 25688 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:36.866611 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.782888 28469 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:36.873616 28560 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:10:36.875131 28339 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:36.875412 28416 consensus_meta.cc:287] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.002s
I20260709 12:10:36.818475 28404 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:36.889876 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73942.7us
I20260709 12:10:36.810678 28527 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.815495 28374 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:10:36.898398 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45437.3us
I20260709 12:10:36.869138 28398 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.901451 28580 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.907189 28469 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:36.902118 28527 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:36.900607 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.899748 28519 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:36.913780 28519 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:36.914206 28519 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:36.878199 28434 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:36.911813 28550 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:36.912833 28398 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:36.906353 25689 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:36.925084 28374 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.895951 28362 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.945899 25611 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:36.902093 28514 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:36.941244 28416 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:10:36.968868 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 276796us
I20260709 12:10:36.962316 28513 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.974202 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:36.947312 28362 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.000526 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:37.002060 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.033612 25693 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:37.007354 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.023020 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1942) took 1224 ms. Trace:
I20260709 12:10:37.022749 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:37.058624 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 300351us
I20260709 12:10:37.050141 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.059579 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:37.059778 25759 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:37.045733 25612 rpcz_store.cc:276] 0709 12:10:35.798776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.799625 (+   849us) service_pool.cc:224] Handling call
0709 12:10:35.799977 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.636625 (+836648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.022650 (+386025us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b540021d754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:37.022928 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896326656}
I20260709 12:10:36.973723 28513 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:36.989120 28551 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:37.087539 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.005462 28544 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.670s	user 0.006s	sys 0.000s
I20260709 12:10:37.115754 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.078537 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.084307 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:37.006247 28576 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:37.113093 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:37.001960 28458 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.077877 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.025254 28362 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:37.129823 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 67929.1us
I20260709 12:10:37.129323 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.058513 28384 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.006654 28374 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.996467 28518 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 12:10:37.134009 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.136150 25762 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.012030 28394 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.125854 25766 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:36.997071 28428 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.001770 28351 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
W20260709 12:10:37.154351 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 94849.8us
I20260709 12:10:37.170715 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:37.005532 28398 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.126296 28469 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.120579 28426 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.157315 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:10:37.153656 25764 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:37.164165 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 125467us
I20260709 12:10:37.174727 25759 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:37.149467 25768 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:37.175370 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:37.175292 25759 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.176110 25764 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:37.177254 25764 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.179774 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:37.077423 28464 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:37.149528 28374 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.168165 28357 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.167948 28409 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.190949 28566 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:37.155911 28384 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:37.138422 28460 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:37.164999 28540 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.199769 25762 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:37.164390 28601 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:37.208153 28566 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.211261 28601 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.212788 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.204124 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:37.215091 28600 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.215201 28428 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.215574 28600 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.204196 28516 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.194747 28486 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.213352 28566 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.216408 28516 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.216849 28516 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.216609 28486 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:37.217622 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.147406 28519 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.219588 28486 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.220772 28519 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.215982 28600 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.205961 28409 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.224802 28409 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.215782 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:37.166553 28513 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.213644 28601 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.194271 28374 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.195178 28398 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:37.248203 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 48503.7us
I20260709 12:10:37.178447 28469 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.252681 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:37.250687 25764 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.234099 28566 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.203629 28357 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.255496 25759 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.235476 28428 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:37.295233 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44857.2us
I20260709 12:10:37.294087 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:37.298115 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 183839us
I20260709 12:10:37.256174 28515 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:37.305246 28462 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:37.306391 25764 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:37.307116 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 229406us
W20260709 12:10:37.316272 28596 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:37.306205 28515 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:37.317745 28464 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:37.319120 25759 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.294744 28540 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:37.257187 28514 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:37.322515 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.297051 28527 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:37.297586 28513 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.329370 25764 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 8.
I20260709 12:10:37.330788 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.330988 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.332248 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:37.295405 28566 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.332647 25610 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:37.323810 28464 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.339423 25766 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.347084 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.303370 28428 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.351480 25614 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:37.356850 25766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:37.357713 25766 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:37.300825 28351 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:37.362447 25766 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.344074 28566 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.326897 28462 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.378379 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.378857 28462 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.361125 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.384084 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.370546 28357 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.370990 28409 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:37.372063 28549 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:37.372262 28384 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:10:37.386617 25611 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.395115 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.355373 28613 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.401691 25658 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.347160 28614 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:37.405022 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:37.404886 28398 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.410244 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.409475 28550 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:37.417281 28469 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.410983 28161 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.418625 28614 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.345088 28527 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.427920 28586 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 12:10:37.443092 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 245618us
I20260709 12:10:37.428723 28554 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:37.429777 28428 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.399057 28516 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.403481 28409 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.343901 28514 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.435557 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:37.436062 28464 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.437783 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.443431 25760 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:37.399317 28549 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:37.444551 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:37.423805 28611 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:37.401546 28462 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:37.402037 28357 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:37.451388 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41126 (request call id 186) took 1082 ms. Trace:
I20260709 12:10:37.458465 28580 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.458698 28554 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.459223 28554 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.459707 28554 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.459249 28548 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:37.460338 25768 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:37.422086 28614 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.457777 25767 rpcz_store.cc:276] 0709 12:10:36.369444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.369617 (+   173us) service_pool.cc:224] Handling call
0709 12:10:36.370014 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.370867 (+   853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.370901 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.373698 (+  2797us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.442508 (+1068810us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800359560. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1
0709 12:10:37.442708 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.442750 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.442832 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.442904 (+    72us) raft_consensus.cc:1685] finished
0709 12:10:37.442916 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.451303 (+  8387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9271,"raft.queue_time_us":1172,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":16981,"spinlock_wait_cycles":4818176,"thread_start_us":61498,"threads_started":1,"wal-append.queue_time_us":119825}
W20260709 12:10:37.461405 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 146189us
I20260709 12:10:37.468751 25766 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.364970 28515 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.472002 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.489615 26303 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:37.449592 28586 consensus_queue.cc:1243] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:37.476331 25768 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:37.455447 28426 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.501791 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:37.508234 25768 pending_rounds.cc:85] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 2
W20260709 12:10:37.502241 25732 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.120s (SENT)
I20260709 12:10:37.504971 25766 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.508664 25768 pending_rounds.cc:107] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:37.509008 25768 raft_consensus.cc:2889] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.508879 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:37.505028 25759 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:37.510708 25768 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:37.510993 25759 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:37.512946 25759 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:37.511942 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.520092 25768 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:10:37.523588 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:37.496706 28492 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:37.471212 28516 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.522624 28580 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.455034 28374 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.490321 28398 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
W20260709 12:10:37.609902 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 138016us
I20260709 12:10:37.655025 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.487428 28462 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.585580 28492 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.663941 28492 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.562551 28615 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:37.498558 28357 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.665688 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:37.666385 28357 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:37.654021 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.590338 28486 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.667068 28161 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.667402 28486 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.667754 28161 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:37.662449 28514 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.668926 28161 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.671420 28546 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.680112 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1329) took 1066 ms. Trace:
I20260709 12:10:37.680766 25688 rpcz_store.cc:276] 0709 12:10:36.614198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.614338 (+   140us) service_pool.cc:224] Handling call
0709 12:10:36.614795 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.876837 (+262042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.679653 (+802816us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000aad54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:37.680011 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601107328}
I20260709 12:10:37.489730 28600 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.667892 28486 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.671545 28409 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.689267 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1319) took 1099 ms. Trace:
I20260709 12:10:37.690774 25516 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.601809 28580 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:36.341945 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:37.692557 25516 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 5 to 6, leader changed from <none> to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 6 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.689741 25694 rpcz_store.cc:276] 0709 12:10:36.589440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.589595 (+   155us) service_pool.cc:224] Handling call
0709 12:10:36.661157 (+ 71562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.661918 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.689041 (+1027123us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54003c41d0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:37.689191 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111008128}
I20260709 12:10:37.720582 28409 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.694299 28516 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:37.719310 28580 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.720516 28612 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.772455 28619 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:37.760354 28409 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:37.782311 25689 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.783303 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1343) took 1133 ms. Trace:
I20260709 12:10:37.783732 25689 rpcz_store.cc:276] 0709 12:10:36.649565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.936963 (+287398us) service_pool.cc:224] Handling call
0709 12:10:36.937399 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.782111 (+844712us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5400079f20. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd2dc0 00007fbdb2d5d1c0 00007fbdb2d5e231 00007fbdb2d5ad8f 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c
0709 12:10:37.782919 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.783199 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6646016}
I20260709 12:10:37.740453 28374 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.786846 28612 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.789497 28612 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:37.750479 28594 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.792233 28594 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.792495 28566 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.794224 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1657) took 1253 ms. Trace:
I20260709 12:10:37.810873 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1655) took 1271 ms. Trace:
I20260709 12:10:37.829296 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:37.848342 25760 rpcz_store.cc:276] 0709 12:10:36.539400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.539568 (+   168us) service_pool.cc:224] Handling call
0709 12:10:37.443153 (+903585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.454738 (+ 11585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.810623 (+355885us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540003af50. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:37.810794 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077235968}
I20260709 12:10:37.853305 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:37.856520 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.858083 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.843955 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:37.861692 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.846626 28620 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
W20260709 12:10:37.847201 28618 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260709 12:10:37.868486 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.870543 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:37.864351 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:37.865887 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.848132 25763 rpcz_store.cc:276] 0709 12:10:36.540522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.562106 (+ 21584us) service_pool.cc:224] Handling call
0709 12:10:36.564254 (+  2148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.564699 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.564731 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.587543 (+ 22812us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.767313 (+179770us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:37.793309 (+1025996us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b1800429d60. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb67533c7 00007fbdb2d659a7 00007fbdb2d750bf
0709 12:10:37.793476 (+   167us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.793731 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.793809 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.793871 (+    62us) raft_consensus.cc:1685] finished
0709 12:10:37.793987 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.794144 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1674,"prepare.queue_time_us":35422,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4087,"raft.queue_time_us":32035,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":9707,"spinlock_wait_cycles":64904960,"thread_start_us":179601,"threads_started":2,"wal-append.queue_time_us":290257}
I20260709 12:10:37.874756 25760 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:37.885461 25760 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:37.861099 28623 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.198s	user 0.000s	sys 0.004s
I20260709 12:10:37.808657 28594 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.797340 28462 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:37.822867 28540 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.895628 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 200064us
I20260709 12:10:37.898710 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:37.862520 28605 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.900892 25615 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:37.899766 25616 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:10:37.883570 28603 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:37.883600 28374 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.854985 28554 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:38.000686 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 53713.8us
I20260709 12:10:37.888249 28612 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:37.899816 28600 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:38.000264 28513 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.002s
I20260709 12:10:37.944854 28424 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.127573 25610 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.908772 28540 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.040292 28374 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:37.999518 28605 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:38.119333 28536 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:38.065515 28612 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:38.204669 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82185.3us
I20260709 12:10:38.123202 28424 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.126792 28594 consensus_queue.cc:1059] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:10:38.238106 28578 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.323643 26305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.044s	sys 0.048s
W20260709 12:10:38.324183 26305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.044s	sys 0.048s
I20260709 12:10:38.325287 28605 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.326607 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:38.327361 25760 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 3.
I20260709 12:10:38.329249 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:38.330924 28515 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.335952 28496 raft_consensus.cc:3055] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:38.336042 28540 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.336526 28496 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:38.337865 28486 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.002s
I20260709 12:10:38.338610 28486 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:38.341387 28486 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 8 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:10:38.345330 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1513) took 1155 ms. Trace:
I20260709 12:10:38.345752 25764 rpcz_store.cc:276] 0709 12:10:37.189469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.507562 (+318093us) service_pool.cc:224] Handling call
0709 12:10:37.507899 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.508269 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.508297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.523035 (+ 14738us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.669548 (+146513us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4800120258. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:10:37.865328 (+195780us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:37.865393 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.865481 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.344922 (+479441us) raft_consensus.cc:1685] finished
0709 12:10:38.344950 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.345236 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":1156,"raft.run_wall_time_us":150288,"spinlock_wait_cycles":80754048,"thread_start_us":208782,"threads_started":1,"wal-append.queue_time_us":742034}
I20260709 12:10:38.355126 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:38.355840 25764 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.349900 28633 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.370332 25565 placement_policy_util.cc:248] tablet 39e6df07fdde400cbbefc675d486ab4a: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 12:10:38.342033 28566 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.317260 28457 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:10:38.381433 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 350237us
W20260709 12:10:38.379109 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.357270 28540 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.362097 28428 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.383374 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.075s	sys 0.125s
I20260709 12:10:38.337631 28496 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.362334 28384 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:38.391072 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.076s	sys 0.126s
I20260709 12:10:38.391811 25764 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 8.
I20260709 12:10:38.397104 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:38.351629 28578 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:38.390147 28492 consensus_meta.cc:287] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.726s	user 0.003s	sys 0.011s
I20260709 12:10:38.383302 28592 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:38.443619 28496 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.447644 28549 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.448973 28549 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.457206 28409 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:38.410104 28486 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.461978 28486 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:38.463099 28486 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:38.405190 28607 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:38.468905 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.377032 28633 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.407831 28384 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:38.469317 26304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.019s	sys 0.045s
W20260709 12:10:38.479817 26304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.020s	sys 0.045s
I20260709 12:10:38.478323 28594 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:38.482918 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1499) took 1526 ms. Trace:
I20260709 12:10:38.483626 25765 rpcz_store.cc:276] 0709 12:10:36.956419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.154372 (+197953us) service_pool.cc:224] Handling call
0709 12:10:37.156708 (+  2336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.382524 (+225816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.382573 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.402007 (+ 19434us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.518952 (+116945us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.518990 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.467264 (+948274us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400165654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:38.467320 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.467381 (+    61us) raft_consensus.cc:1685] finished
0709 12:10:38.467399 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.482810 (+ 15411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45106,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":335808768,"thread_start_us":165813,"threads_started":2,"wal-append.queue_time_us":333845}
I20260709 12:10:38.389638 28457 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.407315 28428 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.407907 28540 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.486534 28384 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:38.499580 28580 consensus_meta.cc:287] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.700s	user 0.013s	sys 0.003s
I20260709 12:10:38.443478 28492 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:38.476078 28592 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.482046 28594 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.503589 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:10:38.515600 28630 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.202s	user 0.004s	sys 0.000s
I20260709 12:10:38.480728 28554 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.483639 28607 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.497363 28517 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 12:10:38.556773 28559 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:10:38.518311 28374 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.572990 26334 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:38.554733 28612 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:38.600823 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.588845 28462 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:38.605419 28462 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:38.636001 28540 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:38.636855 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 321659us
I20260709 12:10:38.643450 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:38.645380 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.654247 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:38.662431 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 1969) took 1297 ms. Trace:
I20260709 12:10:38.663072 25610 rpcz_store.cc:276] 0709 12:10:37.364911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.365034 (+   123us) service_pool.cc:224] Handling call
0709 12:10:37.365339 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.128292 (+762953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.662033 (+533741us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540021d254. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:38.662336 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733146880}
I20260709 12:10:38.638407 28344 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:10:38.684535 28573 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.685861 28161 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.652132 28617 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.660840 28578 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.688500 28161 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.693260 28617 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.693851 28548 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.656150 28517 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:38.698416 25618 raft_consensus.cc:2410] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:38.699074 28592 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.700059 28594 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.691334 28404 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.703696 28621 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 1.021s	user 0.008s	sys 0.014s
I20260709 12:10:38.520030 28580 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:38.729079 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.502s (SENT) [suppressed 30 similar messages]
I20260709 12:10:38.670755 28374 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:10:38.675920 28376 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:38.724874 28338 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:38.724678 28496 raft_consensus.cc:476] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:38.724937 28612 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.725126 28409 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.725725 28633 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.657397 28462 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.728371 28540 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.728554 28566 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.728699 28554 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.743984 28594 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:10:38.747430 28518 consensus_queue.cc:1175] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "04e6206f9e924fb3931891bf3a64b392" responder_term: 6 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:38.737823 28428 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.746380 28409 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.751842 28161 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.752429 28424 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.752761 28409 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.743222 28457 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:38.753346 28638 log.cc:927] Time spent T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 12:10:38.745229 28338 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:38.754192 28639 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:10:38.754419 28580 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.746383 28642 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.755853 28338 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.756871 28617 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.757121 28554 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.746214 28612 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.737897 28492 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.749084 28592 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.733487 28404 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.761886 28592 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.763439 28404 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.749109 28648 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:38.726770 28548 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.749085 28594 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:38.827867 28594 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.826674 28648 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:38.764111 28592 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.768684 28655 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:38.834290 28612 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.749984 28607 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.829233 28594 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:38.711709 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet 7a8225ffb62d4087a3a45c98cc24c581: Illegal state: Replica 04e6206f9e924fb3931891bf3a64b392 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:10:38.872629 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 206017us
W20260709 12:10:38.875484 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 185093us
I20260709 12:10:38.875941 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1332) took 2236 ms. Trace:
I20260709 12:10:38.876487 25692 rpcz_store.cc:276] 0709 12:10:36.639588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.639723 (+   135us) service_pool.cc:224] Handling call
0709 12:10:36.640116 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.647823 (+  7707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.647871 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.838809 (+1190938us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b2c00000448. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:37.839471 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.135414 (+295943us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:38.633136 (+497722us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.683855 (+ 50719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.683984 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.753526 (+ 69542us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:38.875076 (+121550us) raft_consensus.cc:1685] finished
0709 12:10:38.875168 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.875628 (+   460us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61147,"prepare.queue_time_us":591517,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":68882,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":5483,"spinlock_wait_cycles":46282368,"thread_start_us":788503,"threads_started":2,"wal-append.queue_time_us":567214}
W20260709 12:10:38.882755 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.883275 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 154081us
I20260709 12:10:38.889415 25689 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:38.890192 25689 pending_rounds.cc:85] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 4
I20260709 12:10:38.890654 25689 pending_rounds.cc:107] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:38.891089 25689 raft_consensus.cc:2889] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.893978 25694 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:38.748417 28540 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.911634 28540 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.912542 28540 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:38.913640 28540 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.833012 28554 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.759567 28566 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.829226 28548 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.920560 28527 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.921586 28527 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.922394 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:38.922848 28527 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.923761 25762 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.926453 28527 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:38.921877 28566 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:38.981576 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 72954.1us
I20260709 12:10:39.002794 28401 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.004135 28401 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:38.997293 28548 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.006110 28566 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.007107 28548 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.007302 28566 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.011891 25694 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:39.012450 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.016469 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.017544 25688 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:39.017376 28536 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:38.755411 28642 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.030807 28566 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.050575 28614 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.050899 28612 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.051587 25688 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:39.051873 28612 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.051635 28614 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.035187 28554 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.018000 28549 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.055094 28642 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:38.833487 28648 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.072227 28648 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:39.039207 28457 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:39.075966 28592 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.076930 28592 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:39.064495 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 118315us
I20260709 12:10:39.062781 28566 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.090718 28566 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:39.093883 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.097617 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:38.834276 28655 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.107993 28655 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:39.109138 28530 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.110139 28530 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.037590 28390 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:10:39.115229 28390 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.114696 28554 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.115746 28390 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:39.126240 28631 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.919s	user 0.000s	sys 0.002s
I20260709 12:10:39.126636 28404 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.127884 28566 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.127676 28404 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.130931 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1514) took 1941 ms. Trace:
W20260709 12:10:39.131526 25618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 1962) took 1799 ms (client timeout 1784 ms). Trace:
I20260709 12:10:39.132247 28614 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.104427 28536 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.131470 25766 rpcz_store.cc:276] 0709 12:10:37.189777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.509293 (+319516us) service_pool.cc:224] Handling call
0709 12:10:37.509625 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.523806 (+ 14181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.523837 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.560115 (+ 36278us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.067356 (+507241us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:38.067450 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.067558 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.125066 (+1057508us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:39.130323 (+  5257us) raft_consensus.cc:1685] finished
0709 12:10:39.130349 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.130706 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12077,"raft.queue_time_us":14675,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":6535,"spinlock_wait_cycles":179230464,"thread_start_us":297780,"threads_started":1,"wal-append.queue_time_us":540898}
I20260709 12:10:39.138559 28549 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.113811 28530 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:39.132041 25618 rpcz_store.cc:269] 0709 12:10:37.331502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.331905 (+   403us) service_pool.cc:224] Handling call
0709 12:10:39.131005 (+1799100us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400379bd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:39.131229 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3139042560}
W20260709 12:10:39.174830 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.181125 28549 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:39.184609 28659 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.167s	user 0.000s	sys 0.003s
W20260709 12:10:39.173442 28513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.020s
I20260709 12:10:39.131551 28390 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:39.188369 28384 consensus_meta.cc:287] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.663s	user 0.018s	sys 0.004s
I20260709 12:10:39.189227 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.189314 28612 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.181977 25617 raft_consensus.cc:1217] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-7.5]   Dedup: 6.4->[7.5-7.5]
I20260709 12:10:39.190181 28401 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:39.223544 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.223683 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 70255.5us
I20260709 12:10:39.227062 25762 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 9.
I20260709 12:10:39.260564 25617 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:10:39.225617 28551 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.191594 28592 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.275701 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.275861 28384 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.235169 28404 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:39.255597 28513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.018s	sys 0.021s
W20260709 12:10:39.313884 28660 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.195s	user 0.000s	sys 0.008s
W20260709 12:10:39.329484 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.315315 28612 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:39.316598 28551 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.235777 28536 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.314721 28554 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.360864 26337 raft_consensus.cc:2393] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 4: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:39.368829 28554 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.368889 28614 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.395533 28614 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.407271 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:39.441332 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.361861 28612 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.377115 28554 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.485632 28390 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:39.489709 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.486821 28566 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.494719 28566 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.497351 28566 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:39.490160 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 174895us
I20260709 12:10:39.501883 25687 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.503819 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.486485 28548 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.510936 28603 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.511344 25617 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:39.511536 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.511933 28603 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.508445 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.515180 28464 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.515285 28603 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.517972 28384 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.518678 26303 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:10:39.521170 28667 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:10:39.521956 28384 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:39.523008 25618 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:39.523556 28384 raft_consensus.cc:697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:39.525146 28384 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:39.522413 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.531924 28612 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:39.537251 28614 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.539512 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.542650 28464 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.544256 28551 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.531122 28566 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.552806 28566 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.534561 28603 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.550976 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.549628 28554 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.558795 28464 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.569800 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.567530 28603 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.576746 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.563803 28612 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.564049 28614 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.583801 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.586886 25617 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.584702 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.587410 25617 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:39.592000 25617 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.593346 25617 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.594156 28603 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.590813 28614 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.599016 25618 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:39.601419 25611 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:39.587904 28566 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.625154 28464 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:39.629518 25617 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:39.634087 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.618027 28603 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:39.623212 28614 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.616575 28612 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.628582 28566 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:39.653200 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:39.654728 28594 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.763s	user 0.005s	sys 0.011s
I20260709 12:10:39.650151 28603 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.660444 28573 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:39.674515 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:39.676687 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.677646 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.678057 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.680281 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.681293 25691 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:39.682233 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.661175 28603 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.662854 25692 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:39.663873 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.664543 28612 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.666138 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.667399 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.670140 28566 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.641702 28464 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.704511 25612 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.704967 25612 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:39.706188 25612 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.707629 28464 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:39.699119 25687 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:39.708844 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.700264 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:39.703675 28416 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:39.704078 28594 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.707777 25612 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.715312 25610 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:39.703123 25619 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.719630 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.724041 28594 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.726312 28416 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:39.727030 28416 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.729501 28416 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:39.731669 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.733562 25766 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:39.734054 28594 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:39.709081 28648 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:39.734680 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 377444us
I20260709 12:10:39.707650 28462 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.735675 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.737242 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.738724 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.735085 28648 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.738996 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.741017 25688 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:39.741576 28648 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.738807 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.742543 25691 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:39.736275 28612 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.745276 28612 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.746672 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.747972 28612 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.748765 28540 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.752048 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.749941 25619 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:39.753470 28646 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:39.754316 28646 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:39.757076 25612 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
W20260709 12:10:39.757402 28653 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.758s	user 0.007s	sys 0.001s
I20260709 12:10:39.757097 28566 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.758330 28540 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.750765 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:39.759395 28674 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.242s	user 0.004s	sys 0.000s
W20260709 12:10:39.764223 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.776974 25616 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.769367 26337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45784 (request call id 70) took 1280 ms. Trace:
I20260709 12:10:39.771551 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.778496 28416 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:39.771656 28671 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.252s	user 0.003s	sys 0.000s
I20260709 12:10:39.774101 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.771595 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.781533 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.779399 25619 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:39.783501 25619 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
W20260709 12:10:39.784303 28670 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 12:10:39.777771 26337 rpcz_store.cc:276] 0709 12:10:38.489047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.494702 (+  5655us) service_pool.cc:224] Handling call
0709 12:10:39.768989 (+1274287us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400438854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:39.769210 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888675072}
I20260709 12:10:39.778118 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.786595 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.779377 28416 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.787648 25612 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:39.763265 28540 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.789494 28416 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:39.790493 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.791419 25615 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:39.771044 25618 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:39.792042 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:39.792366 28672 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.254s	user 0.001s	sys 0.002s
I20260709 12:10:39.792824 28540 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.793362 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.793560 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.796238 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.797447 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.797925 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.798683 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.794050 25689 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:39.799293 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.800402 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:39.801712 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.802948 25688 raft_consensus.cc:1240] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:39.800405 25691 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.805751 28540 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.806123 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.757300 25692 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:39.757010 28646 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:39.806962 25613 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:39.826169 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.806435 28540 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.837877 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:39.850584 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.854853 25766 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.860203 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.853510 25688 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.861714 25688 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:39.863008 25688 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.864004 25688 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.865197 28566 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.866163 28566 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.868830 28566 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.842517 28390 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.872659 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.876698 25688 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:39.879557 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.879930 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.880415 25610 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:39.880545 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.883307 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.885726 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.890431 25685 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:39.891063 25689 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:39.891945 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.901499 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.903750 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.904529 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.904699 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.906590 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.902671 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.908893 25690 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:39.912235 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:39.916630 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.916687 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.917188 25766 raft_consensus.cc:2468] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 4.
I20260709 12:10:39.917948 25615 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:39.918643 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.916440 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.916452 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:39.923405 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.922664 25690 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:39.925068 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.925854 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.928793 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.929862 25687 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:39.926679 25685 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:39.932173 28677 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.932447 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.932780 28677 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.934818 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.935032 28677 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:39.936564 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.936637 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.937397 25616 raft_consensus.cc:2376] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10. Re-sending same reply.
I20260709 12:10:39.937911 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.938308 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.938519 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:39.939056 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.939918 25619 raft_consensus.cc:2376] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
I20260709 12:10:39.941025 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.950105 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.951846 25691 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:39.951889 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.955422 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.955636 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.956693 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.956840 25693 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:39.957846 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.958546 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.958685 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.959467 25615 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:39.960520 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.960855 25687 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:39.961894 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.962404 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:39.963267 25617 raft_consensus.cc:2376] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11. Re-sending same reply.
I20260709 12:10:39.907764 28640 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:10:39.970957 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.972796 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.962512 25610 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:39.973758 25619 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:39.978103 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.979938 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.982663 25615 raft_consensus.cc:2368] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6.
I20260709 12:10:39.908146 28390 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:39.986394 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.925113 28464 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:40.008236 25613 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:39.988792 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.995985 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.996971 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:39.998245 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:39.999550 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.010521 25618 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 4.
I20260709 12:10:40.010825 25617 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:40.012022 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.009413 25616 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:40.008881 25613 pending_rounds.cc:85] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 3
I20260709 12:10:40.014591 25613 pending_rounds.cc:107] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:40.015010 25613 raft_consensus.cc:2889] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.013427 25619 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:40.021328 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.022550 25615 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:40.022871 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.020613 26303 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:40.029649 28521 raft_consensus.cc:2804] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:40.030299 28521 raft_consensus.cc:697] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:40.031239 28521 consensus_queue.cc:237] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:40.034453 28464 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.037768 28464 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:40.040148 28390 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:40.054173 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.073050 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.074054 25613 raft_consensus.cc:2376] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:40.078018 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:40.082369 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.087931 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.102695 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.118427 28677 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:40.119231 28677 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.070590 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:40.122047 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.124228 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.123018 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.136595 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.137409 25610 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.136897 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:40.139402 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.143325 28684 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:10:40.151571 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:40.153532 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.157150 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.158761 25614 raft_consensus.cc:2410] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:40.171373 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.174593 28540 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:40.177414 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:40.190755 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.193689 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.193794 28581 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:40.194792 25615 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:40.212020 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:40.214032 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.197573 28634 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:40.223539 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.224527 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.214015 28677 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:40.216713 28634 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:40.228474 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet 20c583a2390b4b6d955b01e778798db7: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.232673 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.234508 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:40.235109 25686 raft_consensus.cc:2376] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
W20260709 12:10:40.237617 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.239750 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 47) took 6210 ms. Trace:
I20260709 12:10:40.240280 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.241914 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.244577 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.245206 25685 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:40.246409 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:40.252130 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet 6640372ef1e64554b6b1025b28173499: Illegal state: Replica c781e437472a42e2a6162b67b1c7bbbd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.251034 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.256206 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.261189 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.262049 25617 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:40.268213 28464 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.270473 28464 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.272006 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.272284 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.272758 25615 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:40.272841 28464 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:40.274170 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.275547 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.276854 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.278189 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.278759 25612 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:40.278971 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.279876 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.284054 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.283676 25515 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 7 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.283676 25762 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:40.286382 25766 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:40.285678 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 7 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:40.294147 25658 leader_election.cc:400] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6.
I20260709 12:10:40.294591 25658 leader_election.cc:403] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:40.303354 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.309970 25687 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:40.307435 25658 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:40.306967 28581 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6.
I20260709 12:10:40.311868 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:40.311450 28686 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:10:40.316107 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:40.319267 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 39e6df07fdde400cbbefc675d486ab4a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:39676
I20260709 12:10:40.321336 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.321956 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.317586 25694 raft_consensus.cc:2376] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:40.322985 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.240222 25516 rpcz_store.cc:276] 0709 12:10:34.029386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.036726 (+  7340us) service_pool.cc:224] Handling call
0709 12:10:34.099996 (+ 63270us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:10:40.239486 (+6139490us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.706326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.706940 (+   614us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.706984 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:10:38.707003 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:38.707774 (+   771us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.707835 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.707872 (+    37us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:38.708225 (+   353us) tablet.cc:701] Row locks acquired
0709 12:10:38.708239 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:10:38.708429 (+   190us) write_op.cc:270] Start()
0709 12:10:38.708569 (+   140us) write_op.cc:276] Timestamp: P: 1783599038708362 usec, L: 0
0709 12:10:38.708587 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.742599 (+ 34012us) log.cc:844] Serialized 920 byte log entry
0709 12:10:39.677069 (+934470us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b180009cca0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e522 00007fbdafc707c1
0709 12:10:39.793661 (+116592us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b180009cca0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e522 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:39.861871 (+ 68210us) op_driver.cc:464] REPLICATION: finished
0709 12:10:39.902124 (+ 40253us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdafc510ac 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb6791ef0
0709 12:10:40.217726 (+315602us) write_op.cc:301] APPLY: starting
0709 12:10:40.219593 (+  1867us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:40.223160 (+  3567us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:40.228767 (+  5607us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:40.235740 (+  6973us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:40.236084 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:40.236129 (+    45us) write_op.cc:312] APPLY: finished
0709 12:10:40.236507 (+   378us) log.cc:844] Serialized 28 byte log entry
0709 12:10:40.236739 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:40.236884 (+   145us) write_op.cc:454] Released schema lock
0709 12:10:40.236944 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:40.237466 (+   522us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:40.237495 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":904120,"reported_tablets":2,"spinlock_wait_cycles":11180928,"child_traces":[["op",{"apply.queue_time_us":354346,"apply.run_cpu_time_us":3306,"apply.run_wall_time_us":20803,"num_ops":2,"prepare.queue_time_us":320264,"prepare.run_cpu_time_us":33783,"prepare.run_wall_time_us":354168,"raft.queue_time_us":302337,"raft.run_cpu_time_us":55172,"raft.run_wall_time_us":387524,"replication_time_us":1101527,"spinlock_wait_cycles":61985664,"thread_start_us":971668,"threads_started":4,"wal-append.queue_time_us":337296}]]}
I20260709 12:10:40.327864 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.328120 28581 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.328728 25689 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:40.328877 28581 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.329571 28581 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.329157 25615 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:40.329663 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.330360 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.331427 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.338201 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.324352 28554 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.347139 25762 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:40.347854 28646 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:40.351415 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:40.352437 28646 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:40.352912 28646 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.353331 28646 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:40.341584 28690 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:10:40.358907 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:40.363600 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.302820 28634 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.342939 28640 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:40.344957 28554 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:40.374119 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 59290.3us
I20260709 12:10:40.381305 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.379202 28554 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.393778 25759 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [5.6-8.7]
I20260709 12:10:40.383416 28677 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.405845 28677 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.408233 28677 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:40.402439 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.412921 25763 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.414036 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.402688 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.404734 25515 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 7, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.395030 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 39e6df07fdde400cbbefc675d486ab4a (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:10:40.415611 25686 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:40.409945 28634 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:40.433545 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 73221.8us
I20260709 12:10:40.442437 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.442179 25763 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:40.435187 28677 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:40.450152 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:40.453521 25764 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:40.453299 28581 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.454419 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:40.456228 25517 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 178) took 21381 ms (client timeout 15000 ms). Trace:
I20260709 12:10:40.456352 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:40.457258 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:40.459134 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.458761 25515 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.460580 25515 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 6 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.462795 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.465895 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.467444 25686 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:40.466708 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.469056 25613 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.471179 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.476472 28581 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:40.476910 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.479281 28418 consensus_queue.cc:1059] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:40.477759 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.480257 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:40.478394 25515 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.480387 28418 raft_consensus.cc:3055] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.481594 28418 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:40.466346 28677 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.479568 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.486599 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.487059 25689 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:40.478560 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.481393 25693 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:40.495222 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.495450 25515 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 8 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:40.496929 28554 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:40.498112 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.498400 25694 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:40.456700 25517 rpcz_store.cc:269] 0709 12:10:18.998956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.999255 (+   299us) service_pool.cc:224] Handling call
0709 12:10:20.051175 (+1051920us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:10:40.375312 (+20324137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:34.207055 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:34.314154 (+107099us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:34.316194 (+  2040us) write_op.cc:435] Acquired schema lock
0709 12:10:34.319468 (+  3274us) tablet.cc:662] Decoding operations
0709 12:10:34.651220 (+331752us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:34.674431 (+ 23211us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:34.678037 (+  3606us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:10:34.998903 (+320866us) tablet.cc:701] Row locks acquired
0709 12:10:35.002464 (+  3561us) write_op.cc:260] PREPARE: finished
0709 12:10:35.015230 (+ 12766us) write_op.cc:270] Start()
0709 12:10:35.029166 (+ 13936us) write_op.cc:276] Timestamp: P: 1783599035012639 usec, L: 0
0709 12:10:35.029208 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:10:35.030353 (+  1145us) log.cc:844] Serialized 8364 byte log entry
0709 12:10:35.724240 (+693887us) op_driver.cc:464] REPLICATION: finished
0709 12:10:36.081815 (+357575us) write_op.cc:301] APPLY: starting
0709 12:10:36.081919 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:36.082396 (+   477us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:36.082534 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:36.152303 (+ 69769us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:36.152765 (+   462us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:10:36.152847 (+    82us) write_op.cc:312] APPLY: finished
0709 12:10:36.153473 (+   626us) log.cc:844] Serialized 144 byte log entry
0709 12:10:36.153707 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:36.153989 (+   282us) write_op.cc:454] Released schema lock
0709 12:10:36.154083 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:36.203959 (+ 49876us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:36.211354 (+  7395us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24906,"reported_tablets":55,"spinlock_wait_cycles":695311104,"child_traces":[["op",{"apply.queue_time_us":354052,"apply.run_cpu_time_us":6810,"apply.run_wall_time_us":104305,"num_ops":21,"prepare.queue_time_us":353590,"prepare.run_cpu_time_us":32837,"prepare.run_wall_time_us":977532,"raft.queue_time_us":357392,"raft.run_cpu_time_us":45190,"raft.run_wall_time_us":386777,"replication_time_us":663156,"spinlock_wait_cycles":98560,"thread_start_us":849215,"threads_started":4,"wal-append.queue_time_us":189609,"wal-append.run_cpu_time_us":42333,"wal-append.run_wall_time_us":1942037}]]}
I20260709 12:10:40.503232 25764 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:40.497136 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.505887 25515 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 2 to 7, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.509323 25688 raft_consensus.cc:3055] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:40.509878 25688 raft_consensus.cc:740] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:40.511189 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:40.512662 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52443.9us
I20260709 12:10:40.482956 28418 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:40.525784 25763 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:40.526909 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:40.527734 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.532332 25688 consensus_queue.cc:260] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:40.541496 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.543998 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.544085 25688 raft_consensus.cc:3060] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.546695 25686 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:40.503073 28554 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:40.548151 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.549752 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.546672 25515 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.556522 25613 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 8.
W20260709 12:10:40.559505 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.560411 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.560794 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.561429 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.551330 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:40.566450 28400 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:40.514526 28604 consensus_queue.cc:1059] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:40.569603 25615 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:40.577353 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.571151 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.578727 25686 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:40.581713 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.546944 28677 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:40.587877 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.589915 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.591173 25691 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:40.594671 25515 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.597141 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:40.601138 25686 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.566752 28540 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:40.593935 28464 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:40.608100 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:40.614954 25691 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:40.601828 28418 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:40.622859 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 73241.1us
I20260709 12:10:40.602371 28581 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:40.626432 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 75211us
I20260709 12:10:40.632159 25688 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:40.623294 25515 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 6, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.632731 25688 pending_rounds.cc:85] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 5
I20260709 12:10:40.577872 28400 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.633127 25688 pending_rounds.cc:107] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:40.634931 25688 raft_consensus.cc:2889] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.612630 28464 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:40.654078 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.639518 28464 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.645861 25515 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 7 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:10:40.660398 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.661398 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.658983 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63699.9us
I20260709 12:10:40.657441 28706 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.667198 28706 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.667663 28706 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:40.670506 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.700394 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.703372 28715 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:40.701175 28704 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:10:40.710089 28400 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:40.711413 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:40.691824 28669 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:10:40.718116 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 75058us
I20260709 12:10:40.720335 28715 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.720574 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.720826 28715 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:40.721628 28717 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.722074 28717 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:40.722472 28717 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.722563 28715 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.722685 28709 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:40.724066 28709 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:40.725195 28709 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.728276 28685 raft_consensus.cc:3055] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.729656 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.637136 28677 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.737242 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.747072 25515 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 6, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 6 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:40.746351 25761 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:10:40.751919 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58240.4us
W20260709 12:10:40.754030 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.756531 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.732506 28685 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:40.759584 25515 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 7 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:40.762873 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.765086 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.766820 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.768518 25761 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:40.768473 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.769268 25613 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:40.795059 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.802500 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.805397 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.805737 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.806771 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:40.807279 25617 raft_consensus.cc:2376] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:40.805507 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.809945 25611 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:40.810770 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.812438 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.753177 28390 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:40.815864 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:40.816041 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.816578 25612 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:40.816737 25765 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:40.816874 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.817703 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.818217 25762 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:40.804504 28715 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.824685 28719 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:40.825384 28719 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:40.825474 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.826236 25767 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:40.837610 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:40.842329 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.824690 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:40.821339 28721 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 12:10:40.828293 25582 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5b02303361d43d1903c3e943b866b64. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:40.848544 25765 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:40.823035 28722 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.830578 28710 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:40.878079 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 112240us
I20260709 12:10:40.877936 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.891007 25686 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:40.892112 25685 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:40.819406 28646 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:40.893267 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.910552 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 88918.9us
I20260709 12:10:40.919840 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.921222 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.826488 28719 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:40.923657 28723 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.098s	user 0.004s	sys 0.000s
I20260709 12:10:40.923875 28707 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:40.924556 28646 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:40.893005 28464 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.930909 28464 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:40.932137 25619 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:10:40.932662 25619 pending_rounds.cc:85] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 6
I20260709 12:10:40.932982 25619 pending_rounds.cc:107] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:10:40.933257 25619 raft_consensus.cc:2889] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.934424 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.937863 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:40.938714 25761 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:40.940531 25761 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:40.942837 28540 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:40.942678 28707 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:40.943336 28540 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:40.943910 28540 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.944628 28707 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.909168 28717 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:40.881071 28710 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:40.950502 25762 raft_consensus.cc:1217] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-7.5]   Dedup: 6.4->[7.5-7.5]
I20260709 12:10:40.956112 25762 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:10:40.938011 25768 raft_consensus.cc:1240] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:40.957471 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:40.958376 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.962182 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:40.964454 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45302us
W20260709 12:10:40.981231 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.987780 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:40.998168 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 85627.1us
W20260709 12:10:41.001641 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44747.3us
W20260709 12:10:41.001621 25583 leader_election.cc:336] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.508s (SENT)
I20260709 12:10:41.003487 25583 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.004204 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.004347 28390 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:41.006418 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.007826 28711 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.008409 28711 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.008893 28711 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:41.017868 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.018520 28712 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.886596 28722 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.029006 28722 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:41.038789 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.040027 28717 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:41.052495 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51448.8us
W20260709 12:10:41.054955 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.906497 28706 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.060217 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.067296 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.071133 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.078341 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:40.889647 28685 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:41.062340 28708 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.099169 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:41.107355 25583 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.590s (SENT)
I20260709 12:10:41.107950 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.107244 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.108956 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:41.062508 28604 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:41.111539 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.097309 28464 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.117915 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.119665 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.103000 28719 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:41.117874 28464 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.146857 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.148001 25767 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:41.148528 28418 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.149370 28418 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.126528 28719 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:41.156385 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.123792 28712 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:41.157620 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.158960 28706 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.116436 28710 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.166673 28719 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.166708 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:41.139456 28464 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.169046 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.169871 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.171093 25768 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.171795 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.173415 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.138485 28707 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:41.186203 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.191882 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.192620 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.193022 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.193598 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.193615 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72259.7us
I20260709 12:10:41.196792 25763 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:41.197096 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.194216 28707 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.199544 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.202728 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89197.5us
W20260709 12:10:41.212172 25658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.040s	sys 0.031s
W20260709 12:10:41.212707 25658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.040s	sys 0.031s
W20260709 12:10:41.213085 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 578263us
I20260709 12:10:41.217935 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.219516 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:41.218714 25768 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:41.232630 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:41.237725 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 130405us
I20260709 12:10:41.206852 28710 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.242120 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:41.243887 25618 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.245553 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:41.246359 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.242040 25612 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:41.210594 28707 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.250449 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.252579 26340 raft_consensus.cc:1240] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:41.217056 28706 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.257867 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.260113 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.255347 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.267133 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:41.274633 28712 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.252060 28646 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.277645 28646 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.280211 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:41.280859 25614 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:41.251731 28581 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.282709 28581 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.285228 28733 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:10:41.290055 28731 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
W20260709 12:10:41.293004 28727 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 12:10:41.236918 28554 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.268745 25760 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:41.305550 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.258855 28706 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.310832 28706 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:41.311422 28728 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:10:41.315059 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.316094 25618 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:41.320272 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:41.319206 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 80401us
W20260709 12:10:41.321602 25583 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.667s (SENT)
I20260709 12:10:41.322050 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.280877 28646 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:41.334436 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.333915 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:41.304752 28708 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.273705 28540 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.345455 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.327355 28634 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.340559 28708 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:41.369302 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49125.1us
I20260709 12:10:41.371273 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:41.369010 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:41.314725 28554 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.342952 28722 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:41.373371 25761 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:41.374905 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:41.346583 28646 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.346452 28737 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.371501 28634 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.375075 28722 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.378136 28581 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.427785 25582 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.411481 28748 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.424412 28722 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:41.445817 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 121729us
I20260709 12:10:41.387586 28646 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.468166 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 91435.7us
I20260709 12:10:41.480593 28750 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:41.481766 28750 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.482589 28750 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.418978 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:41.496606 25618 raft_consensus.cc:606] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:41.497213 25618 raft_consensus.cc:614] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:41.508315 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.507712 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 186121us
I20260709 12:10:41.499349 28754 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.513805 28754 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.505764 28715 consensus_meta.cc:287] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.011s
I20260709 12:10:41.498373 28634 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.524756 25614 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
W20260709 12:10:41.533159 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.529505 28736 log.cc:927] Time spent T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.339s	user 0.002s	sys 0.003s
I20260709 12:10:41.460954 28748 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.530666 25657 connection.cc:256] RPC call timeout handler was delayed by -1.2397344789999352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:10:41.544955 28685 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.499902 28711 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.559345 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.561460 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.565580 25764 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:41.576097 28540 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.576895 28554 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.593717 28711 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.593794 28646 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:41.614367 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.571460 28677 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:41.534960 28634 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:41.594656 28756 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:41.598557 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.601146 28748 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:41.601779 28746 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:10:41.617098 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 189407us
I20260709 12:10:41.630906 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.635597 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:41.636914 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.638880 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:41.641903 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.643180 28715 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.643795 28715 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.643545 28706 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.644336 28715 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.645141 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:41.645787 25619 raft_consensus.cc:606] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:41.646147 25619 raft_consensus.cc:614] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.646207 28706 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.646795 28748 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.644604 28707 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:41.648561 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50133.4us
I20260709 12:10:41.651365 28751 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.639714 28714 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.650959 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:41.653458 25619 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:41.653846 25619 raft_consensus.cc:614] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:41.638000 28390 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.654438 28390 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.654886 28390 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.650199 28707 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.656536 28719 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.658207 25765 raft_consensus.cc:2368] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:41.659302 28754 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.660861 28734 raft_consensus.cc:2764] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:10:41.629999 28646 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:41.662693 28646 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:41.663771 28646 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.664942 28390 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.667514 28390 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.671999 28722 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.651170 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:41.686379 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46105.7us
I20260709 12:10:41.688321 28756 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:41.690148 28719 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.692293 28756 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:41.692745 28390 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.693177 28390 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:41.695441 28740 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.696049 28740 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:41.694132 28390 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.698405 28740 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:41.698566 28390 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.701383 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62586.8us
I20260709 12:10:41.702641 28706 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:41.703830 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.703388 25516 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.704324 28554 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.704969 28677 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:41.704553 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53503.3us
I20260709 12:10:41.705171 25516 catalog_manager.cc:5697] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.706663 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.706990 25516 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.707728 28677 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.708772 25516 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.708958 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.710810 28677 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:41.713311 28464 consensus_meta.cc:287] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.005s
I20260709 12:10:41.713784 28464 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.715128 25613 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:41.714547 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.716872 28677 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:41.717326 28554 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.719192 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.719316 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.720232 28554 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.720435 28677 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.722414 25657 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.723246 28554 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:41.724921 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.725967 28677 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.726930 26337 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:41.727281 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.729312 28677 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.730072 28677 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:41.730651 28677 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.687490 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:41.737054 28390 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:41.736970 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49592.8us
I20260709 12:10:41.737676 28390 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:41.738171 28390 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.739755 28754 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:41.741142 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.742904 28710 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.745178 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:41.747506 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 50583.4us
I20260709 12:10:41.748235 28710 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:41.751243 28677 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.750116 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.760406 28710 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.626750 28708 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.761873 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 180) took 11117 ms. Trace:
I20260709 12:10:41.760550 28390 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.763208 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.765416 28677 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.788846 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:41.767720 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.715969 28464 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.776738 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.786372 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:41.793691 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.792194 25767 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:41.790686 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.793316 25761 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:41.794067 25765 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:41.796352 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71976.5us
I20260709 12:10:41.796543 28540 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.796897 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:41.797188 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.797667 25759 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:41.798231 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.799227 28708 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:41.799840 28708 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.800493 28708 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.802557 28751 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.800122 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.803436 28751 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:41.803336 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.803696 28540 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.804308 28744 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.805064 25764 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:41.805828 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.806097 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.806664 28744 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.819481 25765 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:41.796491 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:41.825277 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.782845 25515 rpcz_store.cc:276] 0709 12:10:30.655057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.657438 (+  2381us) service_pool.cc:224] Handling call
0709 12:10:30.719647 (+ 62209us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:10:41.761758 (+11042111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:41.133611 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:41.134702 (+  1091us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:41.134787 (+    85us) write_op.cc:435] Acquired schema lock
0709 12:10:41.134810 (+    23us) tablet.cc:662] Decoding operations
0709 12:10:41.147512 (+ 12702us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:41.147596 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:41.147628 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:10:41.148958 (+  1330us) tablet.cc:701] Row locks acquired
0709 12:10:41.149008 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:10:41.149220 (+   212us) write_op.cc:270] Start()
0709 12:10:41.149415 (+   195us) write_op.cc:276] Timestamp: P: 1783599041149144 usec, L: 0
0709 12:10:41.149437 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:41.150222 (+   785us) log.cc:844] Serialized 6018 byte log entry
0709 12:10:41.275884 (+125662us) op_driver.cc:464] REPLICATION: finished
0709 12:10:41.446574 (+170690us) write_op.cc:301] APPLY: starting
0709 12:10:41.459283 (+ 12709us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:41.534351 (+ 75068us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:41.551843 (+ 17492us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:41.558333 (+  6490us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:41.558608 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:10:41.558654 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:41.559052 (+   398us) log.cc:844] Serialized 106 byte log entry
0709 12:10:41.559242 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:41.559609 (+   367us) write_op.cc:454] Released schema lock
0709 12:10:41.559674 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:41.560362 (+   688us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:41.560409 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5999,"reported_tablets":57,"spinlock_wait_cycles":19466112,"child_traces":[["op",{"apply.queue_time_us":147342,"apply.run_cpu_time_us":5476,"apply.run_wall_time_us":122982,"num_ops":15,"prepare.queue_time_us":189656,"prepare.run_cpu_time_us":6348,"prepare.run_wall_time_us":23751,"replication_time_us":126261,"thread_start_us":220371,"threads_started":2}]]}
I20260709 12:10:41.854085 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.789134 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:41.780613 28384 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:10:41.867372 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61615.7us
I20260709 12:10:41.807072 28540 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:41.877733 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.891430 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.878149 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.824558 28722 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.901285 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:41.876967 28759 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:41.862932 28464 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:41.900718 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 431389us
I20260709 12:10:41.891209 28710 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.911339 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:41.909207 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.891391 28677 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.909773 28464 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.917269 28717 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.917764 28717 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.918133 28717 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.919445 28464 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:41.919787 25658 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:41.921480 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.924149 28719 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:41.924787 28719 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:41.926915 28708 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:41.927500 28708 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:41.929507 28700 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.930845 28554 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.931950 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.903777 28706 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.932972 28712 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:41.952719 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.935088 28762 log.cc:927] Time spent T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:10:41.963650 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:41.963860 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52627.5us
I20260709 12:10:41.904335 28744 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.930136 28700 raft_consensus.cc:697] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:41.867638 28715 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.983280 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:41.983417 25613 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:41.984113 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.984551 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:41.991138 25610 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:41.968816 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:41.993882 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:41.969535 28754 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.995756 28700 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:42.004781 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:41.988903 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:41.972975 28748 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.987768 28634 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.986279 28756 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:42.010406 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:42.011540 25765 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:42.004763 28754 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:41.991374 28708 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:41.999258 28581 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:42.000473 28677 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:42.024788 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 200486us
I20260709 12:10:41.980150 28712 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:42.000998 28714 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:42.004347 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:42.034155 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:42.045533 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.046247 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54336.1us
I20260709 12:10:42.046207 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.031138 28708 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:42.041070 28750 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.009s
I20260709 12:10:42.052562 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:42.054298 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.032673 28390 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.039049 28634 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:42.035821 28734 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.020498 28756 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.037839 28581 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:42.069327 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:42.067833 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.070843 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.068193 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:42.051710 28540 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:42.048316 28719 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:42.078173 25613 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:42.080657 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:42.080742 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:42.083875 25610 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:42.081040 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:42.085901 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60795798854e400987349043af926b8a"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:42.088788 25686 raft_consensus.cc:606] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:42.086349 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.036893 28714 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.089159 25686 raft_consensus.cc:614] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.044831 28747 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:42.076615 28740 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:42.094674 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:42.082450 28540 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:42.099928 28540 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:42.069511 28753 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.087019 28767 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.112402 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.093907 28706 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.059937 28750 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:42.127383 28761 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 12:10:42.131989 28634 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:42.135880 28715 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.138882 28712 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:42.142288 28737 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.144096 28714 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:42.147140 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52521.6us
I20260709 12:10:42.166121 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:42.151907 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:42.153439 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 46202.8us
W20260709 12:10:42.162133 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 173352us
I20260709 12:10:42.167325 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.169260 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.145458 28710 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.123456 28708 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.192411 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.118922 28581 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.199875 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.205603 28464 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:42.210798 25759 raft_consensus.cc:1275] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:42.213864 28771 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:42.214648 28771 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.215147 28771 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.164677 28737 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:42.193662 28634 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.189713 28706 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.230705 25610 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:42.231904 25611 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:42.163533 28740 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:10:42.274153 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 48) took 1795 ms. Trace:
W20260709 12:10:42.280902 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 81112.2us
I20260709 12:10:42.219415 28712 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:42.284276 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.220052 28554 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:42.311429 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 86768.9us
I20260709 12:10:42.210786 28784 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.319947 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:42.325265 25610 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:42.325915 25610 raft_consensus.cc:614] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:42.312077 28783 ts_tablet_manager.cc:933] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:10:42.232728 28754 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.277628 25516 rpcz_store.cc:276] 0709 12:10:40.478946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.481782 (+  2836us) service_pool.cc:224] Handling call
0709 12:10:42.274027 (+1792245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:41.883233 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:41.884016 (+   783us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:41.884075 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:41.884101 (+    26us) tablet.cc:662] Decoding operations
0709 12:10:41.885090 (+   989us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:41.885205 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:41.885232 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:41.885799 (+   567us) tablet.cc:701] Row locks acquired
0709 12:10:41.885827 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:10:41.886060 (+   233us) write_op.cc:270] Start()
0709 12:10:41.886237 (+   177us) write_op.cc:276] Timestamp: P: 1783599041885997 usec, L: 0
0709 12:10:41.886306 (+    69us) op_driver.cc:348] REPLICATION: starting
0709 12:10:41.887289 (+   983us) log.cc:844] Serialized 1693 byte log entry
0709 12:10:41.966793 (+ 79504us) op_driver.cc:464] REPLICATION: finished
0709 12:10:41.967313 (+   520us) write_op.cc:301] APPLY: starting
0709 12:10:41.967452 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:41.967708 (+   256us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:41.967848 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:42.014319 (+ 46471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:42.030337 (+ 16018us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:42.036058 (+  5721us) write_op.cc:312] APPLY: finished
0709 12:10:42.055953 (+ 19895us) log.cc:844] Serialized 40 byte log entry
0709 12:10:42.077827 (+ 21874us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:42.083253 (+  5426us) write_op.cc:454] Released schema lock
0709 12:10:42.088897 (+  5644us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:42.138391 (+ 49494us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:42.138445 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21513,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":173,"apply.run_cpu_time_us":3863,"apply.run_wall_time_us":143721,"num_ops":4,"prepare.queue_time_us":161628,"prepare.run_cpu_time_us":4498,"prepare.run_wall_time_us":7630,"replication_time_us":80254,"thread_start_us":134305,"threads_started":1}]]}
I20260709 12:10:42.266517 28464 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:42.268155 28634 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:42.339104 25611 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:42.334915 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:42.341180 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:42.344981 25760 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:42.342664 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:42.341579 25610 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:42.346915 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:42.347918 25767 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:42.347874 25614 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:42.349043 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:42.351063 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:42.351927 25759 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:42.349146 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:42.342676 25613 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:42.354116 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.358709 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:42.359709 25762 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.361554 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:42.374451 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:42.317065 28712 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:42.376336 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:42.377673 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:42.378058 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58783.7us
W20260709 12:10:42.380566 25732 leader_election.cc:336] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.766s (SENT)
I20260709 12:10:42.382174 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.286727 28521 consensus_queue.cc:1048] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:10:42.381353 25613 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:42.343850 25761 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:10:42.380750 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:42.385854 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:42.387542 25615 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.339890 28767 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.333949 28719 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:42.393914 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:42.348847 28756 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.383332 28712 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:42.337186 28717 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.411286 25614 raft_consensus.cc:606] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:42.418465 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.428833 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 46530.9us
I20260709 12:10:42.385390 28554 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:42.339247 28781 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.284s
I20260709 12:10:42.331470 28737 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.445273 25611 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
W20260709 12:10:42.453096 25583 connection.cc:256] RPC call timeout handler was delayed by -1.2076184990000911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 12:10:42.455783 25767 raft_consensus.cc:2368] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
W20260709 12:10:42.459777 25583 connection.cc:256] RPC call timeout handler was delayed by -1.0729562940000505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 12:10:42.460352 25583 connection.cc:256] RPC call timeout handler was delayed by -1.0597128229999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260709 12:10:42.430596 28796 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:42.475692 25583 connection.cc:256] RPC call timeout handler was delayed by -1.0161578999998255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 12:10:42.469846 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:42.436599 28797 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.393091 28767 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.386636 28464 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.458731 28753 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.479969 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:42.480674 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:42.492609 25759 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.457067 28750 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.484218 25762 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:42.495630 28790 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:10:42.496754 28789 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:42.488690 28797 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.502444 28791 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:42.508739 28767 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.473093 28758 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.485744 28796 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.511699 25617 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:42.513571 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:42.411656 28634 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.525624 28717 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:42.553058 25615 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:10:42.554669 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 174132us
I20260709 12:10:42.585076 28734 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:42.600173 28788 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.329s	user 0.003s	sys 0.003s
W20260709 12:10:42.601006 25583 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.524s (SENT)
W20260709 12:10:42.661329 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60397.4us
W20260709 12:10:42.662366 25583 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.564s (SENT)
I20260709 12:10:42.662839 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.488317 28646 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:42.638890 28797 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:42.674544 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 390397us
I20260709 12:10:42.656433 28734 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.692261 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:42.671028 28634 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.698426 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:42.671568 28791 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.669438 28800 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:42.704191 25583 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.586s (SENT)
I20260709 12:10:42.700978 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.709542 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.711928 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.713454 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.700299 28464 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.701246 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:42.651643 28758 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.673183 28753 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:42.741541 28803 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:42.745692 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 76762.2us
W20260709 12:10:42.745836 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 278222us
I20260709 12:10:42.747023 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:42.748643 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:42.733199 28540 consensus_meta.cc:287] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.633s	user 0.012s	sys 0.003s
W20260709 12:10:42.749396 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64395.6us
I20260709 12:10:42.749884 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:42.746650 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:42.733361 28581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.021s
I20260709 12:10:42.706538 28719 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:42.732479 28418 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:42.715459 28791 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.741946 28795 consensus_queue.cc:1059] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:10:42.775529 25582 leader_election.cc:400] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:42.780771 25582 leader_election.cc:403] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:42.765481 28751 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.957s	user 0.009s	sys 0.012s
I20260709 12:10:42.707665 28783 tablet_copy_client.cc:323] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
W20260709 12:10:42.751959 28581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.009s	sys 0.021s
W20260709 12:10:42.775018 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49659.4us
I20260709 12:10:42.760232 28710 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:42.752982 28803 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:42.759935 28717 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:42.763509 28748 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:42.789631 25583 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.732s (SENT)
I20260709 12:10:42.776188 28418 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.778430 28747 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:42.762938 28754 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:42.793648 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.722749 28800 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:42.800907 28805 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:42.761523 28540 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.783216 28781 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.803746 25764 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:42.787742 28751 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:42.582067 28769 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:10:42.793592 28714 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.795432 28418 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:42.816540 28706 consensus_meta.cc:287] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.001s
I20260709 12:10:42.817226 28706 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.818166 28802 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.791256 28710 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:42.793370 28748 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:42.814744 25583 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.742s (SENT)
I20260709 12:10:42.805023 28717 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:42.823598 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.814018 28747 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:42.838477 25583 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.053s (SENT)
I20260709 12:10:42.839254 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:42.814297 28767 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.808336 28754 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.826135 28710 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:42.823650 28748 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:42.810441 28798 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 12:10:42.845954 28750 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:42.864406 28801 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:10:42.888617 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 123910us
I20260709 12:10:42.892134 28540 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:42.889740 28706 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.894841 28706 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.896067 28717 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.897053 28706 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:42.900218 28700 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:42.900676 28700 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:42.897094 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.905750 25759 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:10:42.906608 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 187257us
I20260709 12:10:42.901571 28700 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.908735 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:42.888542 28796 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.922412 28777 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.922583 28767 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.923231 28767 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.931041 28791 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.931890 28747 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.926070 28767 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.956486 28754 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:42.957214 28418 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.960326 28708 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:10:42.961077 28771 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.008s
I20260709 12:10:42.956833 28800 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:42.966053 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 57438.2us
W20260709 12:10:42.969589 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 194567us
W20260709 12:10:42.972107 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71961.5us
W20260709 12:10:42.920408 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 127939us
I20260709 12:10:42.973893 25657 leader_election.cc:400] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:42.974483 25657 leader_election.cc:403] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:42.967301 28796 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.983297 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:42.991958 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:42.992728 25762 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:42.966813 28708 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:42.999287 28706 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:43.000861 28418 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.003326 28793 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:43.003839 28793 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:43.004755 28793 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.005522 28802 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.006529 28793 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.007753 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.008570 25767 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:10:42.999943 28712 consensus_meta.cc:287] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 12:10:43.009821 28712 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:42.995806 28581 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:43.011041 25763 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:42.971138 28700 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:43.018512 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44776.9us
I20260709 12:10:43.018232 28744 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:43.018476 28764 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.022895 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.022789 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.024212 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.024793 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.025827 25613 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:43.026809 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:43.027700 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:43.028566 25619 raft_consensus.cc:2410] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:43.029336 25687 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:43.029397 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.030395 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.030872 25612 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.031139 25687 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:43.032198 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.033514 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.034670 28581 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:43.035140 25687 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:43.036443 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.037101 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.037326 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.037946 25690 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:43.030388 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:43.039099 28816 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.039335 25616 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:43.039914 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.039661 28816 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.040520 25692 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:43.021306 28744 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:43.035112 28581 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:43.041996 28816 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.042030 28744 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.042491 28581 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.043301 28744 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.043998 28581 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.047478 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.052829 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.015120 28758 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:43.024015 28554 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.002s
I20260709 12:10:43.016471 28802 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:43.059827 25693 raft_consensus.cc:2410] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:10:42.972455 28771 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.060468 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.066977 25688 raft_consensus.cc:2376] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:10:43.065157 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:43.067008 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:43.016681 28712 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:43.071776 25615 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:43.071828 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.075237 25688 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:43.069465 28646 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.083513 28646 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.085484 28797 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.086767 28802 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.091692 28797 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.093688 28714 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:43.097191 28710 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:43.098799 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.099717 25688 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:43.100093 28748 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.078367 28708 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.077087 28803 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.085989 28646 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.070344 28554 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:43.102885 28803 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.115561 28803 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.115751 28748 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.116711 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.121754 28771 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.126847 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:43.127732 28710 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:43.077329 28792 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:10:43.133451 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.134799 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.135167 25687 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:10:43.109921 25658 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:43.136132 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.136760 25688 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:43.108459 28708 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.140622 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.140759 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.140964 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.143857 25685 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:43.152570 28734 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.153863 25759 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.154574 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:43.169366 28734 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:43.143951 28554 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:43.172358 28554 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.172423 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.172858 28554 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.173843 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.176304 25686 raft_consensus.cc:2410] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:43.181030 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.197635 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.198506 25693 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:43.199468 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.200158 25692 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:43.204442 25618 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:43.206037 25658 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:43.211122 25759 raft_consensus.cc:1240] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:43.208350 28819 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.214197 28819 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.216609 28819 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:43.224016 28792 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:43.223850 28739 consensus_queue.cc:1059] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:43.224733 28792 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:43.226874 28685 raft_consensus.cc:3055] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:43.202332 28764 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7.
I20260709 12:10:43.227478 28685 raft_consensus.cc:740] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:43.229532 28737 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.230388 25685 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:43.228770 28685 consensus_queue.cc:260] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:43.232331 28685 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.235000 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.236363 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.226107 25687 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:43.243287 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.296643 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.297441 25613 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:43.297636 25618 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:43.275373 28769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59334 (request call id 6) took 3001 ms. Trace:
I20260709 12:10:43.306994 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.225736 28792 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.308550 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.309304 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:43.312563 25612 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:43.320559 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.320966 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet d5b02303361d43d1903c3e943b866b64 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:10:43.321614 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet d5b02303361d43d1903c3e943b866b64 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-d5b02303361d43d1903c3e943b866b64
I20260709 12:10:43.321897 25690 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:43.327143 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.334095 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.343355 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:43.344805 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.345831 25690 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:43.342518 25582 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:43.348364 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:43.352802 28771 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:43.353343 28771 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:43.353739 28771 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.358705 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:43.385123 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.384867 25687 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:43.386451 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.389853 25691 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:43.393396 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.394774 25687 raft_consensus.cc:2410] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:43.395898 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:43.397612 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.398486 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.399338 25687 raft_consensus.cc:2376] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:10:43.402175 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.361109 28714 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.407881 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.409013 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:43.411931 25689 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:43.413087 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.349526 28819 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:43.308440 28769 rpcz_store.cc:276] 0709 12:10:40.275515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.281601 (+  6086us) service_pool.cc:224] Handling call
0709 12:10:40.343015 (+ 61414us) log.cc:844] Serialized 513 byte log entry
0709 12:10:40.400634 (+ 57619us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b540006f2a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd4142 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634 0000000000388479 00007fbdafc6e475
0709 12:10:40.401677 (+  1043us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540006f2a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd4142 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634 0000000000388479 00007fbdafc6e475
0709 12:10:43.274686 (+2873009us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1925,"raft.queue_time_us":4161,"raft.run_cpu_time_us":6223,"raft.run_wall_time_us":113469,"spinlock_wait_cycles":39051904}
W20260709 12:10:43.416378 28831 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
W20260709 12:10:43.424575 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.428051 28734 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.414637 28715 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:43.414606 28714 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:43.450425 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:43.451170 25688 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:10:43.455029 28832 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:10:43.463860 28828 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:10:43.444209 28715 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.464468 28715 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:43.468637 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.469411 25687 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:43.470602 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.470793 25686 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:10:43.716145 25732 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.511s (SENT)
I20260709 12:10:43.472455 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:43.493850 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.557866 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65718.5us
I20260709 12:10:43.577533 25692 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:10:43.665510 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.799080 25688 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:43.799398 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:43.446201 28700 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.488550 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:43.804529 25759 raft_consensus.cc:2410] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:43.502694 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.800101 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:43.799703 25694 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.808208 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:43.839411 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.817806 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:43.847326 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:43.848039 25759 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.647115 28819 raft_consensus.cc:993] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:43.807507 28717 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:43.774150 28838 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:10:43.852182 25615 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:43.449266 28734 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.564967 28706 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:43.564769 28802 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:43.807281 28739 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.589231 28758 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:43.882761 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.883659 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.884148 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:43.884788 25763 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.884971 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.885682 25768 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:43.556286 28722 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.308s
I20260709 12:10:43.579962 28747 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.288s
I20260709 12:10:43.477306 28803 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.892119 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.659471 28554 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.895329 28418 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:43.838680 28700 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.881830 28715 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.899056 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.951107 25761 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:43.901906 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:43.903132 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 187048us
W20260709 12:10:43.953367 25732 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.514s (SENT)
I20260709 12:10:43.954007 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:43.903861 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:43.907424 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.911475 25759 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:43.841921 28785 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:10:43.960049 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.587s (SENT) [suppressed 70 similar messages]
W20260709 12:10:43.956713 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.957993 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.962210 25759 raft_consensus.cc:2410] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:43.485714 28714 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.963953 25693 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:43.966943 25690 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:43.866330 28717 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.968154 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:43.951540 28708 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.969696 25759 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:43.972759 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:43.973016 25732 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.640s (SENT)
I20260709 12:10:43.973716 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:43.971906 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:43.974810 25759 raft_consensus.cc:2393] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:43.889359 28706 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:43.888340 28739 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:43.978365 25759 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:43.949677 28418 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:43.887938 28802 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:43.969857 28737 consensus_meta.cc:287] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.740s	user 0.016s	sys 0.000s
I20260709 12:10:43.902829 28758 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:43.988222 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:43.979961 25759 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.989135 25768 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:43.991027 25759 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.975093 28581 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.983034 28771 consensus_meta.cc:287] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.629s	user 0.005s	sys 0.009s
I20260709 12:10:43.990329 25764 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:43.974640 28842 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:43.964720 28843 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:44.028587 28715 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.013840 28708 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.031530 28708 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.034230 28708 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.040118 28739 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.044498 25762 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:10:44.013643 26334 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:44.047534 28846 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.048607 28846 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.049219 28846 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.050247 28758 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:44.050556 28845 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:44.014081 28842 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:44.051348 28845 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.052462 25767 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:44.053193 28842 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:44.053745 28845 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:43.998076 28737 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.058941 28737 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.059342 28737 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:44.060230 28737 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.060864 28734 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.061452 28737 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.001428 28771 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.062331 28717 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.002853 28581 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.063870 25767 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.064254 28771 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.065589 28581 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.053758 28842 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.014654 28844 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.066674 28842 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.067186 28842 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.067332 25762 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:44.067082 28844 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.009258 28418 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.071012 25762 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.073186 25694 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:44.075318 25612 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.077105 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:44.077746 25616 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.077104 25763 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:44.074579 25759 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:44.080670 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.083585 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.069944 28844 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.071295 28843 raft_consensus.cc:1081] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:10:44.103422 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 130456us
I20260709 12:10:44.107573 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:44.113698 28803 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.114557 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.118698 28554 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.117475 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.075227 28845 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:44.123521 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47824.3us
I20260709 12:10:44.047535 28706 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.101305 28734 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:44.131062 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4541833099999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
W20260709 12:10:44.135046 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3794833099998414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 12:10:44.135398 25657 connection.cc:256] RPC call timeout handler was delayed by -1.233683309999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:10:44.131559 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 227782us
I20260709 12:10:44.135963 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.136479 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.129669 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:44.140816 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.153198 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.096079 25610 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:44.147238 25686 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:44.154606 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:44.155922 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:44.147524 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 329913us
I20260709 12:10:44.148782 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.150943 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:44.159175 25692 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:44.145246 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.159948 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.160962 25686 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:44.161741 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.162626 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.163657 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.164342 25686 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:44.165083 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.166605 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.166826 28769 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:44.167413 25687 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:44.168514 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.169548 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.170097 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.170065 28817 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.171015 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.171228 28769 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:44.171669 28769 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.171612 25583 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.172115 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.172174 28769 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:44.172819 28817 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.173308 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.173673 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.174312 25687 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:44.174860 28714 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.170938 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:44.175625 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.180298 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:44.166170 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.182755 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.182891 25693 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:44.183653 25686 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:44.184253 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.185714 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.122860 28845 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.188367 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:44.196210 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.188406 25687 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:44.190433 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.197341 25689 raft_consensus.cc:2410] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:44.198472 25689 raft_consensus.cc:1217] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Deduplicated request from leader. Original: 7.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:10:44.198959 25689 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:44.200052 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.200408 25689 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.149755 28554 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.214985 25616 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:44.194165 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.144855 28700 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.191572 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.217489 25693 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:44.160161 28708 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.201894 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.194983 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:44.217589 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.212958 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.235790 25765 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.236294 25692 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:44.220144 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:44.221297 25694 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:44.222249 25691 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:44.158471 28717 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:44.224027 28802 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.216413 28744 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:44.226565 28858 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.182632 28722 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:44.144673 28844 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:44.230382 28554 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.181718 28769 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.158653 28390 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.222469 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:44.214003 28819 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:44.274041 28785 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:44.274580 28785 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:44.275553 28744 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.275435 28785 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.275960 28744 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:44.276750 28785 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.277678 28846 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.277994 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:44.203632 28843 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:10:44.260499 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.266559 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49094.3us
I20260709 12:10:44.279865 28554 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.280777 25629 tablet_copy_source_session.cc:215] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:44.276870 28744 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.282112 28744 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.283144 28845 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.238718 28708 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.283828 28708 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.286502 28851 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.262872 28717 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.290582 25767 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:44.292045 25629 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:59338 (request call id 181) took 1084 ms. Trace:
I20260709 12:10:44.292596 28769 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.272200 28390 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.183596 28734 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:44.297631 25686 raft_consensus.cc:2376] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6. Re-sending same reply.
I20260709 12:10:44.297394 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:44.300239 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 106706us
I20260709 12:10:44.306185 25658 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:44.244711 28854 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.290118 28717 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:44.318485 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 146777us
I20260709 12:10:44.320820 25765 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:44.281220 25513 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 5 to 9, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 9 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:44.303664 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:44.327883 25760 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:44.328395 25760 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.325888 25688 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:44.326797 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 115428us
I20260709 12:10:44.319416 28792 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:44.333436 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52924.4us
I20260709 12:10:44.292474 25629 rpcz_store.cc:276] 0709 12:10:43.266754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.309998 (+ 43244us) service_pool.cc:224] Handling call
0709 12:10:44.027964 (+717966us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540037a5d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d653f7 00007fbdb7cfb036 00007fbdb7d04a3e 00007fbdaf5c827b 00007fbdb7d049ba 00007fbdb7cffacc 00007fbdb7cfac7b 00007fbdb7cef8d1 00007fbdb6da34b4 00007fbdb6da3442
0709 12:10:44.280625 (+252661us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540037a5d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb7cfb1bb 00007fbdb7d04a3e 00007fbdaf5c827b 00007fbdb7d049ba 00007fbdb7cffacc 00007fbdb7cfac7b 00007fbdb7cef8d1 00007fbdb6da34b4 00007fbdb6da3442
0709 12:10:44.291967 (+ 11342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379594880}
W20260709 12:10:44.340247 25732 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.750s (SENT)
I20260709 12:10:44.342054 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:44.342716 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:44.343276 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.344172 25759 raft_consensus.cc:2410] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:44.321944 28722 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:44.319728 28734 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.349709 25619 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:44.350912 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:44.351524 25616 raft_consensus.cc:606] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.351888 25616 raft_consensus.cc:614] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:44.346820 28850 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:10:44.349905 28734 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.355921 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:44.359038 28803 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.359858 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.360649 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.362453 25616 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.368299 25513 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 1 to 7, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 7 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:44.374522 28792 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:44.323117 28842 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.333259 28843 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:44.390686 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44755.4us
I20260709 12:10:44.386436 25760 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:44.415019 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.415207 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:44.416127 25686 raft_consensus.cc:606] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.394797 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.395426 28860 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.395301 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.397297 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:44.382321 28851 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.398129 28855 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.398463 28737 raft_consensus.cc:2764] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:44.400784 28792 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.401993 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.421183 25613 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:44.403195 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.403468 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.403914 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.404132 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.424794 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.405982 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.398020 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.425638 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.416620 25686 raft_consensus.cc:614] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:44.405171 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.353982 28845 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:44.428702 28685 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.429059 25614 raft_consensus.cc:2393] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:44.429265 28685 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:44.430373 25614 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:10:44.425024 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.427052 28739 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.426290 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.439570 25760 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.441792 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.447501 25615 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:44.424808 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.387185 28803 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.452443 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:44.454444 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.414149 28802 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 12:10:44.471741 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47040us
I20260709 12:10:44.473155 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.474207 28734 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.474798 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.420182 28867 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:44.492908 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.477248 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.444258 28859 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:44.392781 28722 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.456054 28737 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.518761 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.475888 28734 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.525229 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.457613 28685 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.476300 28845 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.510015 28819 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.528059 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:44.529420 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 75168.7us
I20260709 12:10:44.545277 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.472245 28769 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:44.550410 28706 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:44.529665 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:44.551383 25614 raft_consensus.cc:606] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.529048 28867 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.538414 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.539234 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:44.554003 25686 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.539645 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.533207 28844 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.521250 28717 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:44.438624 28855 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.420544 28860 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.557163 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.551263 28706 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:44.559267 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89787.7us
W20260709 12:10:44.530606 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.558802 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.562783 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:44.563424 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.516390 28859 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:44.552799 28747 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.586419 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.584349 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.591799 25686 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
W20260709 12:10:44.578831 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.560875 28865 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:44.608374 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60514.2us
I20260709 12:10:44.609293 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.610123 28844 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.611413 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.612185 28844 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.613641 25694 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:44.614423 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.592852 28859 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.619748 25768 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:44.591013 28854 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.618932 28844 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.621774 28842 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.686453 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
W20260709 12:10:44.687143 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 100791us
I20260709 12:10:44.623795 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.624588 28418 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.509333 28843 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:44.630224 28870 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:44.561640 28764 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.566282 28813 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.687278 25619 raft_consensus.cc:606] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:44.688390 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64661.6us
I20260709 12:10:44.688989 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.650612 28554 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.639127 28734 consensus_queue.cc:1059] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:44.653539 28876 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:10:44.693354 28869 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:44.696741 25619 raft_consensus.cc:614] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:44.697733 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.703675 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.707309 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:44.705271 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 125801us
I20260709 12:10:44.647495 28880 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:44.691627 28881 raft_consensus.cc:2764] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:44.747154 28390 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.721632 28887 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:44.702046 28844 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:10:44.748453 28887 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.724195 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:44.706535 28802 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:44.726671 28783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b02303361d43d1903c3e943b866b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:44.701267 28842 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:44.749008 28887 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.709372 28848 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.708710 28764 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:44.621189 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 63713.2us
I20260709 12:10:44.733072 28734 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:44.735386 28708 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.731568 28850 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:44.786926 28850 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.787544 28850 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.790566 25767 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:44.741117 28855 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.742548 28849 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.746776 28860 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:44.795581 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56332.7us
I20260709 12:10:44.754503 28769 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:44.760592 28792 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:44.761293 28889 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:44.772938 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75178.1us
I20260709 12:10:44.775496 25583 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.791716 25691 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:10:44.770095 28899 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:44.779587 28764 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:44.815167 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61138.7us
I20260709 12:10:44.809556 28792 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.852167 25613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:44.852952 25613 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:44.808770 28889 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:44.857553 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:44.858206 25613 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:44.816150 28764 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:44.858529 25613 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:44.858734 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:44.859454 25618 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:44.855657 28900 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:44.859438 25613 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:44.864334 25613 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.868541 28860 raft_consensus.cc:993] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:44.868700 28813 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:44.869326 28813 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.802475 28849 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.870663 28854 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:44.853837 28792 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:44.874534 25610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1353) took 2524 ms (client timeout 2241 ms). Trace:
I20260709 12:10:44.874768 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:44.880089 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:44.875108 25610 rpcz_store.cc:269] 0709 12:10:42.351450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.361194 (+  9744us) service_pool.cc:224] Handling call
0709 12:10:44.874328 (+2513134us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003a6e54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:44.874451 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3750702336}
I20260709 12:10:44.822134 28850 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.805948 28859 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.812070 28717 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 12:10:44.891621 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 116250us
I20260709 12:10:44.892930 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:44.905411 25613 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:44.891148 28855 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.852109 28843 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:44.875298 28900 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:44.874178 28817 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:44.874311 28708 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:44.913453 25618 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:44.884913 28758 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.895924 28860 raft_consensus.cc:1081] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:44.912861 28855 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.912742 28867 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:44.931188 28899 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.923593 28893 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:44.980856 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 161065us
I20260709 12:10:44.991551 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:44.992988 28554 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.993088 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:44.966549 28889 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.995318 28889 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.005044 28803 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.006388 28847 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.007087 28847 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:45.008337 28847 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:44.925621 28901 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.932669 28855 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:44.955996 28817 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:44.925773 28758 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:45.018244 25612 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.017143 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:44.986395 28892 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:10:45.018939 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.013708 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.020609 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.021948 25618 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:45.022327 25619 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:45.014665 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:44.894356 28769 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.023483 25615 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:44.981195 28867 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:44.919534 28843 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.026988 28905 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.027130 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.023206 28771 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.029351 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.010057 28847 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.041371 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.014102 28901 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:45.051453 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.058712 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:45.056073 28744 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.062708 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.063517 25610 raft_consensus.cc:2376] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8. Re-sending same reply.
I20260709 12:10:45.059792 28850 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:45.064757 28848 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:45.065418 28848 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.065812 28848 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:45.064955 28895 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:10:45.074683 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:45.011404 28899 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.049310 28849 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.112309 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.116605 28902 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.117257 28902 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.117688 28902 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.106737 28700 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.121276 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.122285 25610 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:45.099040 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.070145 28885 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.129606 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:45.078873 28758 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.122352 28849 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:45.127071 28887 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:45.145968 28886 log.cc:927] Time spent T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:10:45.151713 28899 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.152789 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:45.134838 28885 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:45.218619 28758 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.188263 28849 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.221774 28849 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.114778 28817 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.138226 28859 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.190495 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:45.233953 25764 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.191691 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.191882 25765 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:45.192793 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:45.193331 28857 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.038s	sys 0.017s
W20260709 12:10:45.193399 28864 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.000s	sys 0.011s
I20260709 12:10:45.133230 28813 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.155123 25766 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 10.
I20260709 12:10:45.039616 28900 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.202325 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:45.258659 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56419.8us
I20260709 12:10:45.260044 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:45.260174 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
W20260709 12:10:45.205853 28906 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:10:45.209089 28893 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.142189 28855 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:45.228029 28901 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:45.179047 28898 log.cc:927] Time spent T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:10:45.110952 28867 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.237128 25761 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:45.310895 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:45.253988 28864 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.001s	sys 0.011s
W20260709 12:10:45.319572 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 190024us
W20260709 12:10:45.249068 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.251693 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51887us
I20260709 12:10:45.193951 28858 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:45.261097 25759 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:10:45.250182 28857 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.039s	sys 0.017s
I20260709 12:10:45.270983 28901 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.267424 28844 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:45.358083 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.359493 25617 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
W20260709 12:10:45.360252 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.360095 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:45.356632 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 257972us
I20260709 12:10:45.355836 25759 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.365317 28700 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.274796 28855 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:45.363564 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.374822 28848 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.321504 28843 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.388715 25764 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:45.382934 28855 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.408828 26303 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.314571 28847 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:10:45.389717 28554 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:45.408352 28891 raft_consensus.cc:993] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:45.322144 28881 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:45.423133 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 62053.6us
I20260709 12:10:45.387905 28844 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:45.441542 25582 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:45.445266 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:45.437019 25759 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.428486 28891 raft_consensus.cc:1081] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:45.422595 28685 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:45.460732 25759 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:45.461503 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:45.460867 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 97464.3us
I20260709 12:10:45.430769 28881 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:45.465378 28872 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:10:45.466367 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.466754 28848 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.467284 25688 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:45.467517 28885 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.468382 28915 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.468936 28915 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.469269 28915 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:45.469852 28764 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.003s
I20260709 12:10:45.470351 28905 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.471107 25694 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:45.470831 28905 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.473160 28905 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:45.478003 28792 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.605s	user 0.013s	sys 0.002s
I20260709 12:10:45.478561 28792 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.480504 25619 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:45.466554 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:45.485548 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.423957 28554 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.488313 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.488552 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.489339 25613 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.490049 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:45.490960 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.492162 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.492878 25687 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:45.493678 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.494496 25617 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:45.495568 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.491127 25686 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:45.501318 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.503432 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.503559 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.504459 25687 raft_consensus.cc:2368] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11.
I20260709 12:10:45.505616 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:45.506392 25687 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.457837 28418 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.517148 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:45.518325 25613 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:45.519958 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.522178 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.522838 25692 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:45.461166 28685 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.528903 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:45.461529 28706 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:45.530314 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.535210 25685 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:10:45.535993 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.520654 25766 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:45.533411 25687 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:45.533607 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.537230 25688 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:45.534201 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:45.538530 25690 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:45.541159 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.541989 25759 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:45.542774 25765 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.543293 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.544765 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.545265 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.545746 25761 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:45.479554 28844 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:45.547607 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.545663 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.551683 25765 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:45.548381 25759 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:45.549981 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:45.553236 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.553735 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.554405 25615 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:45.554804 25615 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:45.554468 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:45.555699 25759 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:45.557103 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:45.557412 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.557711 25762 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.556706 25765 pending_rounds.cc:85] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 5
I20260709 12:10:45.559029 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:45.555649 25615 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.559978 25615 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.560415 25765 pending_rounds.cc:107] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:10:45.559284 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.560997 25765 raft_consensus.cc:2889] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.557047 25759 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.562487 25766 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:10:45.563035 25766 pending_rounds.cc:85] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 4
I20260709 12:10:45.563408 25766 pending_rounds.cc:107] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:45.563656 25766 raft_consensus.cc:2889] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.565533 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.567881 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:45.558326 28905 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:45.539562 28685 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.484125 28764 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.582913 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:45.559935 28891 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:45.547180 28706 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.577939 28792 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:45.603233 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.602790 25759 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.584472 28734 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:45.605782 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:45.608453 25615 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:45.599682 25762 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:45.613216 25693 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:45.604009 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86957.6us
I20260709 12:10:45.623030 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:45.625941 28706 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:45.626611 28706 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:45.585784 28418 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:45.632725 25759 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:45.585014 28905 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:45.579023 28846 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:10:45.580745 28858 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:45.615968 28722 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:45.615741 28857 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:45.620289 28708 raft_consensus.cc:2764] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:45.584254 28881 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.657492 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.642365 28882 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:45.618954 28902 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.620272 28855 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:45.668263 28919 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:10:45.663640 28905 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:45.669512 28921 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:45.669935 28915 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.663739 28418 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:45.717139 28918 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.137s	user 0.000s	sys 0.003s
I20260709 12:10:45.673866 28685 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:45.678915 28764 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.680047 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.720016 25615 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:45.681914 28792 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.720726 28792 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.646433 28857 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:45.717180 28915 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.652017 28878 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:45.693179 28554 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.618273 28891 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:45.690953 28900 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.742451 28855 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.725627 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.743530 25615 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.722474 28857 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.746941 28783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60616 (request call id 132) took 3753 ms. Trace:
I20260709 12:10:45.727414 25767 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:45.747409 28783 rpcz_store.cc:276] 0709 12:10:41.999170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.004127 (+  4957us) service_pool.cc:224] Handling call
0709 12:10:42.337440 (+333313us) ts_tablet_manager.cc:934] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
0709 12:10:44.422917 (+2085477us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:45.498522 (+1075605us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:45.521356 (+ 22834us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:45.714933 (+193577us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:45.746362 (+ 31429us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:45.746771 (+   409us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:45.746847 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":40921,"tablet-copy.queue_time_us":176192,"thread_start_us":190002,"threads_started":2}
I20260709 12:10:45.728710 28685 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.749257 28902 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.685278 28882 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.750648 28882 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.751343 28792 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:45.732620 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.752489 25618 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:10:45.712420 28864 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:45.739555 28891 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:45.759872 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 154221us
I20260709 12:10:45.768610 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:45.771036 25615 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:45.780860 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:45.783784 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.784749 25614 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.783890 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:45.753715 28878 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:45.799192 25760 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:45.792783 25688 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:45.792798 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:45.800907 25767 raft_consensus.cc:2393] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:45.794574 25732 leader_election.cc:400] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11.
I20260709 12:10:45.794617 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:45.801973 25732 leader_election.cc:403] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:45.807432 25615 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:45.754760 28783 tablet_copy_client.cc:806] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:45.817209 28878 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:45.812453 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:45.853235 25618 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 11.
I20260709 12:10:45.762775 28864 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:45.820377 28771 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.840441 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 59673.6us
I20260709 12:10:45.792053 28554 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.841792 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47374.4us
I20260709 12:10:45.799451 28893 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:45.837469 28867 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:45.869120 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.268299 28858 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.952280 28783 tablet_copy_client.cc:670] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:45.867581 28901 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.343937 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:46.108927 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.918787 28846 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11.
W20260709 12:10:46.283443 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 407663us
W20260709 12:10:46.283850 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 660869us
W20260709 12:10:46.284375 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.285771 25614 consensus_meta.cc:287] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.500s	user 0.023s	sys 0.037s
I20260709 12:10:45.849956 28929 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.292709 28854 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:46.284192 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 415787us
I20260709 12:10:46.292734 28891 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:46.266716 28856 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.267457 28900 consensus_meta.cc:287] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.008s
W20260709 12:10:46.336033 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.336994 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:46.339674 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:46.341207 25693 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:10:46.325721 28882 consensus_meta.cc:287] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.555s	user 0.004s	sys 0.013s
I20260709 12:10:46.304209 28915 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:46.345284 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:46.335719 26337 raft_consensus.cc:2368] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:46.410998 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:46.411366 25687 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:46.382786 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:46.342427 28905 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.344336 28769 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.416141 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:46.438300 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:46.382112 28924 log.cc:927] Time spent T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.699s	user 0.002s	sys 0.000s
I20260709 12:10:46.383731 25614 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:10:46.388144 28920 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.819s	user 0.001s	sys 0.002s
I20260709 12:10:46.341562 28889 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:46.438959 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:46.484488 25687 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:46.474207 25690 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:46.474536 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:46.439443 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:46.477448 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:46.478617 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:46.490046 25760 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.479632 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:46.491367 25762 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:46.491536 25761 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:46.492728 25759 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.498427 25685 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:46.500609 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:46.503480 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:46.383185 28865 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.485481 28769 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.549186 28865 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.550848 28769 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.552157 28865 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.555146 25691 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:46.547894 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:46.516628 28889 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.457018 28708 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.518049 28843 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:46.518471 28846 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.331574 28864 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:46.519622 28857 consensus_meta.cc:287] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.773s	user 0.016s	sys 0.002s
I20260709 12:10:46.457677 28915 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.458313 28764 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.420491 28882 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.358606 28858 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.484302 28905 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.439321 28901 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:46.416704 28881 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:46.415092 28854 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.532415 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1459) took 1026 ms. Trace:
I20260709 12:10:46.586167 28865 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:46.587710 28857 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:46.593055 28938 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 12:10:46.591993 25689 rpcz_store.cc:276] 0709 12:10:45.505868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.506021 (+   153us) service_pool.cc:224] Handling call
0709 12:10:45.506404 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.506847 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.506890 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.507416 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.576801 (+ 69385us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.576868 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.576983 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.381499 (+804516us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:46.532018 (+150519us) raft_consensus.cc:1685] finished
0709 12:10:46.532047 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.532334 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4016,"spinlock_wait_cycles":5815552,"thread_start_us":57006,"threads_started":1,"wal-append.queue_time_us":140716}
I20260709 12:10:46.421891 28856 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.595535 28882 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.595811 28856 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.590329 28864 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:46.598721 28905 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.341413 28554 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.600841 28854 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.601306 28554 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.335417 28771 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.601560 28881 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.603618 28771 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:46.540081 25731 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:46.604017 28881 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.604274 28857 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:46.604343 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 64443.9us
I20260709 12:10:46.389824 28847 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.546166 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1458) took 1040 ms. Trace:
I20260709 12:10:46.547794 25685 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.589411 25760 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:46.604740 25690 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:46.608247 25689 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:46.609668 25759 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:46.624434 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:46.588088 28764 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:46.608916 25686 rpcz_store.cc:276] 0709 12:10:45.505563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.507306 (+  1743us) service_pool.cc:224] Handling call
0709 12:10:45.507617 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.507991 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.508030 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.508503 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.702863 (+194360us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b18002abb00. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1 00007fbdb2d16a0f
0709 12:10:45.855275 (+152412us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.943167 (+ 87892us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.340837 (+397670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.340942 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.545803 (+204861us) raft_consensus.cc:1685] finished
0709 12:10:46.545925 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.546089 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60507,"prepare.queue_time_us":87607,"prepare.run_cpu_time_us":9584,"prepare.run_wall_time_us":287167,"raft.queue_time_us":103017,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":33022,"spinlock_wait_cycles":15424896,"thread_start_us":152077,"threads_started":1,"wal-append.queue_time_us":976385}
W20260709 12:10:46.658432 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.659380 25689 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:10:46.633311 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1443) took 1146 ms. Trace:
I20260709 12:10:46.662786 25691 rpcz_store.cc:276] 0709 12:10:45.465394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.466286 (+   892us) service_pool.cc:224] Handling call
0709 12:10:46.611626 (+1145340us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400328054. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:46.611780 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307480320}
I20260709 12:10:46.667932 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:46.718158 28867 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:46.670676 25686 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:46.671849 25693 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:46.672470 25688 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:46.676004 28844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.006s	sys 0.001s
W20260709 12:10:46.682622 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 296942us
I20260709 12:10:46.686424 25685 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:46.686733 25691 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:46.738196 25687 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.612201 28857 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.586848 28708 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.586753 28843 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.665228 28764 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.664346 28915 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.674074 28554 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:46.613174 28847 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.700313 28914 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:46.721798 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1766) took 1166 ms. Trace:
W20260709 12:10:46.759584 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 249057us
I20260709 12:10:46.713819 28942 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:46.706125 28941 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.725903 28858 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.721464 28881 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:46.731775 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 386661us
I20260709 12:10:46.752373 28885 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:46.746814 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 79009.9us
I20260709 12:10:46.747459 26304 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:10:46.737732 28844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.007s	sys 0.002s
I20260709 12:10:46.760666 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:46.761150 25582 leader_election.cc:400] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515) with higher term. Message: Invalid argument: T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:46.787367 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:46.753922 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 342011us
I20260709 12:10:46.759375 25765 rpcz_store.cc:276] 0709 12:10:45.555483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.556201 (+   718us) service_pool.cc:224] Handling call
0709 12:10:45.556504 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.572353 (+ 15849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.572383 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.572846 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.892104 (+319258us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:46.282616 (+390512us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.721389 (+438773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.721479 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.721531 (+    52us) raft_consensus.cc:1685] finished
0709 12:10:46.721550 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.721716 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5743,"prepare.queue_time_us":382390,"prepare.run_cpu_time_us":5696,"prepare.run_wall_time_us":6522,"raft.queue_time_us":61248,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":21896,"thread_start_us":717153,"threads_started":2,"wal-append.queue_time_us":796518}
I20260709 12:10:46.785327 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:46.784655 25764 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:46.586158 28846 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.787773 25582 leader_election.cc:403] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:46.722532 28901 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.788496 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:46.794226 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.797053 25618 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:46.797508 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:46.798115 25614 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:46.798424 25614 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:46.758870 28769 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:46.746915 28867 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:46.806309 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:46.815747 25760 raft_consensus.cc:3060] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:46.752168 28857 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.792254 28945 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:46.786216 28889 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.785499 28942 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.789927 28858 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.799279 25614 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.791191 28384 raft_consensus.cc:2804] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:46.837724 25614 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.790467 28941 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.852489 28941 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.853832 28941 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:46.855571 28708 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.858935 28846 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.861548 28942 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.863842 28847 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:46.868081 28843 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:46.870718 28858 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.802654 28722 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:46.873971 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:46.811407 28943 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:46.808683 28856 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515) with higher term. Message: Invalid argument: T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:46.873667 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.791216 28881 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:46.881161 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.884863 25615 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:46.809448 28844 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.888852 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.889361 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.889688 25616 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:46.889981 25615 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:46.882575 25619 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:46.892689 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.892993 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.893340 25618 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:46.893100 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.900215 25762 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:46.765487 28914 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.907346 25766 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:46.909612 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.834654 28878 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.885406 28946 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
W20260709 12:10:46.921314 28944 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:10:46.923301 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 137950us
W20260709 12:10:46.923710 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 136432us
I20260709 12:10:46.924146 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:46.924512 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:46.914567 25614 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:46.830083 25760 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 11.
I20260709 12:10:46.904314 28384 raft_consensus.cc:697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:46.932439 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.933205 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.933116 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.934132 25616 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:46.937673 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.935024 25767 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:10:46.906790 28844 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.835534 28769 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.940495 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.911672 28941 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:46.943404 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.946728 26340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60620 (request call id 90) took 1175 ms. Trace:
I20260709 12:10:46.836364 28945 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:46.950139 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 130373us
I20260709 12:10:46.931507 28887 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:46.933089 28915 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.929392 28854 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:46.932699 28792 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:46.948905 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 121850us
W20260709 12:10:46.964385 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.964903 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:46.967928 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:46.973249 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45711.6us
I20260709 12:10:46.974388 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:46.971865 25768 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:46.957731 26340 rpcz_store.cc:276] 0709 12:10:45.763107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.763270 (+   163us) service_pool.cc:224] Handling call
0709 12:10:45.803832 (+ 40562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.845533 (+ 41701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.845579 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.867639 (+ 22060us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.716764 (+849125us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:46.912234 (+195470us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.912531 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.912635 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.920658 (+  8023us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:46.931718 (+ 11060us) raft_consensus.cc:1685] finished
0709 12:10:46.938507 (+  6789us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.938701 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41154,"raft.queue_time_us":60417,"raft.run_cpu_time_us":11350,"raft.run_wall_time_us":418763,"spinlock_wait_cycles":3378688,"thread_start_us":594482,"threads_started":2,"wal-append.queue_time_us":798596}
I20260709 12:10:46.926774 28878 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:46.987123 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:46.985069 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:46.988277 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:46.985934 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:46.988948 25762 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:46.988903 25768 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
W20260709 12:10:46.997972 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 107296us
W20260709 12:10:46.999639 25732 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.587s (SENT)
I20260709 12:10:47.000273 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:46.946688 28554 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:10:47.034711 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47689.9us
I20260709 12:10:46.986064 28887 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:47.008553 28902 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:10:47.090021 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53778us
I20260709 12:10:47.091180 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.091240 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:47.078011 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 68855.5us
W20260709 12:10:47.088131 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52883.3us
I20260709 12:10:47.097448 25768 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:47.098467 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:47.032961 28847 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:47.036262 28905 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.139964 28955 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.088299 28857 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.078625 28947 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:10:47.177172 28864 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.001s
I20260709 12:10:47.177457 28947 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.178756 28887 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.034873 28900 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 12:10:47.180073 28878 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.181020 28947 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.173724 28951 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:47.093209 28956 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:47.181941 28902 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:47.182327 28956 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:47.184841 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.187153 28953 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.187734 28953 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:47.188145 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.190317 25619 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:47.035107 28384 consensus_queue.cc:237] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:47.128043 28941 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.174505 28769 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:47.268000 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 69813.9us
I20260709 12:10:47.166611 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:47.279438 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 180218us
W20260709 12:10:47.285073 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 191209us
I20260709 12:10:47.289602 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.284080 28792 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:10:47.299049 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 132735us
W20260709 12:10:47.294435 28764 consensus_meta.cc:287] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.000s
I20260709 12:10:47.279263 28889 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:47.306654 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:47.298002 28905 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:47.307559 28769 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:47.314541 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:47.301492 28844 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.304185 28858 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.316766 28858 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:47.317227 28858 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.310382 28764 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.317515 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:47.320068 28764 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.313774 28792 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.320360 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:47.322309 28956 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.315451 28769 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:47.322976 28769 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:47.324138 28769 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.325727 28769 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:47.326458 28864 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:47.327452 28864 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:47.327811 28864 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:47.328689 28952 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.652s	user 0.006s	sys 0.011s
I20260709 12:10:47.323012 28956 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.320636 28764 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.337188 28764 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.338866 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:47.342592 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.343559 25611 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:47.328740 28864 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.347184 28864 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.350603 28967 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:47.351351 28967 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:47.320930 28708 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.352823 28708 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.353214 28708 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.353912 28967 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.317613 28858 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:47.368898 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.320828 28945 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:47.374836 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.375387 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.362442 28956 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:47.376296 25760 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:47.376659 28956 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.336192 28857 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:47.379097 28857 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.379475 28857 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:47.332048 28905 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.335798 28844 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.359233 28846 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.390718 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.395825 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.403228 25617 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:47.410681 28764 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.414845 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.387856 28905 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.455168 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.433131 28929 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:47.463821 25613 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:47.409757 28844 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.473278 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:47.412725 28846 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.433388 28882 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:47.475486 28942 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:47.476819 28722 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:47.505586 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.465292 28978 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.507220 28978 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.508496 28700 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:47.509141 28700 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.509688 28978 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.474407 28901 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.510625 28901 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.512789 28901 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.486179 28771 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.515264 28771 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.516522 28914 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.517383 28771 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.488090 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.518713 28708 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.519635 28881 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:47.519891 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.521045 28708 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.471603 28929 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.486467 28915 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.523236 28929 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.523316 28915 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.525113 28915 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.490859 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.491817 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.494287 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:47.527330 25691 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:47.527452 25689 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.528537 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:47.470177 28792 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.494568 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.530396 28792 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.531255 25688 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:47.532176 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.475157 28979 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.490332 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.499414 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:47.533128 25685 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:47.533464 25763 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 6: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:47.500633 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.508541 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.535672 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.535997 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.471247 28856 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:47.536060 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.533174 25693 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:47.521138 25690 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:47.536926 25614 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:47.526526 25686 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:47.537420 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.490592 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.536953 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.538091 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.538584 25694 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:47.538916 25686 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:47.540560 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.541535 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.543300 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.489390 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.546402 25687 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:47.547336 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.536343 25613 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:47.551874 25689 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:47.553026 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.503909 28865 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:47.598830 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:47.598862 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.657995 25692 raft_consensus.cc:2376] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9. Re-sending same reply.
I20260709 12:10:47.659533 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.598520 28972 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.660378 25692 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:47.554994 28902 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:47.612470 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.661986 25685 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:47.659770 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.664126 25687 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
W20260709 12:10:47.659729 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 122394us
I20260709 12:10:47.661602 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.665633 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.666249 25692 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:47.667548 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:47.667915 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 194790us
I20260709 12:10:47.669180 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.667618 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.485581 28846 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.672098 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.675709 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.677134 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.587792 28900 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.587656 28978 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:47.678851 25685 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:47.645016 28984 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.586829 28945 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.681238 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.586855 28979 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.492542 28956 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.684139 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.699468 25759 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:47.685665 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.476199 28852 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 12:10:47.691097 25764 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:47.683414 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:47.690764 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 229751us
I20260709 12:10:47.703558 25760 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:47.687781 28864 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.692406 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.676728 28554 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.685793 28978 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.709329 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.710156 25613 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:47.671418 28972 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.691978 28984 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.670462 28865 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.709880 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:47.700491 25767 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:47.711550 25689 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:47.729035 28708 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.747473 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:47.749460 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:47.750288 28929 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:47.747481 28708 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.752293 28708 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.708662 28771 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:47.755990 28984 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.756592 28984 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.715734 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.716359 25761 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:47.717135 28978 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.720583 28700 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.723048 28858 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.723795 28979 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:47.704701 28854 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.723s	user 0.014s	sys 0.000s
I20260709 12:10:47.770044 28858 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.770102 28854 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:47.772563 28844 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.721546 28905 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.776895 28905 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.743968 28857 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.759509 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.765576 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.766523 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:47.780020 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.781073 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:47.782888 25767 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:47.784442 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.784794 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.785629 25759 raft_consensus.cc:2393] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:47.785985 25765 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:47.786196 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.787298 25768 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:47.786595 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.788787 25691 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:47.789729 28882 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.790131 28882 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:47.790506 28882 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.791635 25688 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:47.792449 25766 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.791786 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:47.793131 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.794008 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.737435 28864 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:47.780333 28769 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:47.707720 28856 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:10:47.800343 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.804673 28771 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.791126 28878 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.798866 28843 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.805897 28700 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.815670 28783 tablet_copy_client.cc:538] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:47.814353 28953 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.818972 28708 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.823388 28852 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:47.853430 28852 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.853914 28852 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.840334 28878 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:47.824925 28865 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.784875 28945 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:47.856935 28945 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.857194 28878 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.804047 28942 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:47.858057 28942 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.806833 28947 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:47.835008 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.839334 25766 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:47.808602 28769 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:47.833811 28771 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.857348 28945 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:47.806142 28905 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:47.841609 28554 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.849550 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:47.863335 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69391.7us
W20260709 12:10:47.844034 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.869258 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:47.866575 28885 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:47.861797 28942 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:47.852432 28700 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:47.861347 28947 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.863631 28865 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.863926 28769 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.874891 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.875216 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.876652 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.865343 28771 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.878126 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.890136 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.891057 25614 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:47.892194 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.893666 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:47.879551 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.880549 25610 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:47.897115 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:47.880263 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.884613 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.885851 25766 raft_consensus.cc:1275] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:47.866223 28867 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:47.886736 25613 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:10:47.869524 28554 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.887123 25617 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:47.879226 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.897943 25610 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:47.922448 28951 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:47.922719 28554 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.923134 28951 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.874740 28857 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.899806 25614 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.916743 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:47.916939 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:47.917393 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46638.1us
I20260709 12:10:47.899253 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:47.876010 28885 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.882630 28865 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.883606 28947 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:47.889724 28996 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.938987 25614 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:47.945014 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.945407 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.946143 25759 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:47.946352 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:47.946683 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.948954 25768 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:47.924551 28995 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:47.948357 28996 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.949573 25763 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:47.924137 28854 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:47.951928 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:47.952117 28700 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.991039 28914 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:47.992039 28914 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.994956 28995 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:48.008025 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.009389 25690 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:47.952806 28882 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.950742 28956 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:47.954679 28885 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.940172 28878 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:47.956620 28951 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.919085 28864 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.934222 28922 consensus_queue.cc:1048] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:10:47.934401 28978 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.061724 25619 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:47.969309 25610 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:10:48.061969 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:47.975041 28996 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:47.976835 28854 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:47.979079 28783 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:10:47.969048 25766 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:47.988564 28901 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.016410 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.030962 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.055848 28900 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.077970 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.078750 25691 raft_consensus.cc:2376] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10. Re-sending same reply.
I20260709 12:10:48.079479 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.079967 25691 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:48.080637 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.081019 25691 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:48.081542 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.081871 25691 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.032223 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.082710 25686 raft_consensus.cc:2376] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7. Re-sending same reply.
I20260709 12:10:48.083350 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.083918 25692 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:48.035619 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:47.935806 28865 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.099968 25691 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:48.085297 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.084651 25694 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:48.101035 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.070607 28914 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.118129 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:48.112912 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 57635.7us
I20260709 12:10:48.125659 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.062944 28771 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.131700 28950 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:48.075555 28995 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.138764 28999 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:48.135610 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:48.142779 28978 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.107151 28900 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.143450 28852 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.062091 28945 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.145413 28900 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.146340 28708 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.147688 28945 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.151546 28854 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.153465 25618 raft_consensus.cc:2368] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:48.159839 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:48.160625 25610 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.193116 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.192965 28744 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:48.099290 28901 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.207264 25615 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:48.161118 28856 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.209267 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:48.210677 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.214109 25610 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.211619 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:48.132201 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:48.223951 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.226171 25686 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:48.206615 28852 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.213780 28856 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:48.233625 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:48.206758 28744 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.237440 28905 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:48.238224 28929 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:48.256023 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:48.258834 25610 raft_consensus.cc:606] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.257454 28905 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.270763 28905 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.252442 28856 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.253943 28900 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:48.290628 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:48.291307 25616 raft_consensus.cc:606] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:48.248109 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 118986us
I20260709 12:10:48.293671 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.288982 25686 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:10:48.279186 28900 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.282614 28882 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.302954 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:48.308176 28979 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:48.309549 29008 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:48.315503 29011 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.319157 28901 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.337493 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.280917 28865 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.303390 28900 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:48.297887 28854 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:10:48.331956 29008 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:48.299059 28769 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.300750 28947 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:48.356843 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54032.2us
I20260709 12:10:48.357692 25689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:48.345691 28996 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.360172 25689 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.360891 25689 raft_consensus.cc:614] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:48.361554 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:48.385345 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.390821 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.394415 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.397310 25768 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:48.400542 25766 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:48.357095 29008 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.340242 29011 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.419266 25611 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:48.419389 25613 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:48.387609 28915 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:48.458539 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 115521us
I20260709 12:10:48.351877 29006 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:10:48.403133 28978 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:48.466547 28942 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 12:10:48.474098 28867 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.482761 28867 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.485383 28867 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.490046 28769 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.492522 29011 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.458074 28857 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.464993 28945 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.471537 28978 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.469516 28708 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.475854 28744 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.476222 28847 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:48.496313 29014 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:48.525038 25619 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:48.499915 28978 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.513811 28881 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.527279 28881 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.508247 28867 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.498221 28929 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.512701 28708 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.522485 28792 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.529488 28881 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.496788 28942 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.509159 29011 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:48.499541 28857 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.508069 28945 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.535482 28852 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:48.519928 28847 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.541240 28867 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.533007 29020 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:48.592492 29020 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.595394 28901 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:48.595871 28901 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:48.596799 28901 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.593036 29020 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:48.600404 28901 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:48.561004 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:48.564868 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:48.604053 25615 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.567623 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:48.568010 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:48.606022 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45093.3us
I20260709 12:10:48.607878 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:48.554776 28554 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.003s
I20260709 12:10:48.562002 29024 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:48.574002 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:48.620662 25765 raft_consensus.cc:2368] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13.
I20260709 12:10:48.625886 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.637233 29025 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:48.638008 29025 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.638497 29025 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:48.652070 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:48.653048 25768 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.654227 25761 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:10:48.572418 28882 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.660028 25615 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:48.535521 28864 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.664254 29029 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:48.665302 28708 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.665781 29029 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.665867 28708 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.550211 28929 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.692162 28929 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.667300 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.664142 28864 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.622397 28744 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.693279 25766 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:48.693385 28744 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.685827 28978 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.695741 28744 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.696161 28978 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:48.676961 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 69170.1us
I20260709 12:10:48.681509 28867 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.683599 28847 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.676543 28970 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:48.667951 28882 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:48.686488 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 295824us
I20260709 12:10:48.666834 28865 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.687525 28945 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.688926 28900 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.634193 28554 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.703792 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:48.656769 28792 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.727984 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.729480 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:48.687232 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.712108 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:48.650544 29024 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.734174 25693 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:48.734194 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:48.715438 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:48.738670 25766 raft_consensus.cc:2368] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:48.738529 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:48.736023 29008 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.740505 28771 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.741887 29008 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.743260 29025 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.744478 28882 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.745843 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.736599 28847 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.746762 25731 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.749199 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.755034 25732 leader_election.cc:400] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:48.755336 25694 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:48.755436 25732 leader_election.cc:403] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:48.759516 25688 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:10:48.761189 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.761857 25689 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.719753 28857 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.746150 29025 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.748780 28945 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:48.771361 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.747916 28942 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.746193 28864 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:48.747680 28905 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.744535 29028 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.713932 28970 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.787652 25613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debca0eda6c649e38d13858860f6a245"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:48.788352 25613 raft_consensus.cc:606] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:48.788825 29028 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:48.769454 29011 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:48.780037 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:48.754355 28847 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.757694 28867 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:48.781906 25688 raft_consensus.cc:2368] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:48.756633 28922 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.730507 28792 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.790849 29028 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.791846 28554 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.792155 28947 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.778419 28881 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.833943 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.794090 28769 raft_consensus.cc:993] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:48.795351 29004 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:48.852931 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:48.795549 29020 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.806782 25689 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:48.809505 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:48.860072 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 50654.6us
I20260709 12:10:48.823498 28847 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.861557 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.823232 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1477) took 1328 ms. Trace:
I20260709 12:10:48.824223 25685 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:48.797367 29024 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.780520 29029 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:48.830639 25768 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:48.850979 25762 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:48.694365 28708 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:48.835978 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:48.861083 25616 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:48.825320 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:48.873255 25611 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:48.862140 25692 rpcz_store.cc:276] 0709 12:10:47.494785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.667192 (+172407us) service_pool.cc:224] Handling call
0709 12:10:48.822923 (+1155731us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400265f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:48.823157 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955057536}
W20260709 12:10:48.874429 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 119546us
I20260709 12:10:48.865454 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:48.866859 28900 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.854342 29011 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:48.831269 28945 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:48.840260 28771 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:48.844559 28970 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:48.849259 28867 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:48.882390 28856 consensus_meta.cc:287] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.600s	user 0.017s	sys 0.000s
I20260709 12:10:48.866043 28769 raft_consensus.cc:1081] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:48.853370 29004 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:48.861557 28956 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.894068 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.868865 28929 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:48.867553 28996 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:48.899626 25618 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:48.867714 28881 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.935256 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:48.903823 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 117004us
I20260709 12:10:48.895496 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:48.938910 25762 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:48.911417 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.940060 25618 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:48.941708 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.943199 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.943704 25688 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:48.944464 25759 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:48.928206 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.933087 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.888991 28864 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:48.937005 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:48.952373 25689 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:48.937095 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:48.952668 25692 raft_consensus.cc:2368] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:48.953001 25764 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:48.955513 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 49) took 5923 ms. Trace:
I20260709 12:10:48.955936 25516 rpcz_store.cc:276] 0709 12:10:43.032182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.032378 (+   196us) service_pool.cc:224] Handling call
0709 12:10:48.955427 (+5923049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":420320,"reported_tablets":3}
I20260709 12:10:48.958449 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:49.015199 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.016067 25618 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:48.947062 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:48.951126 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.062628 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:49.074986 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 123076us
I20260709 12:10:48.906809 28945 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:48.931447 28857 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.103534 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.107276 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:48.951862 29025 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.902246 28771 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:49.109875 29010 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.703s	user 0.002s	sys 0.002s
I20260709 12:10:48.951788 28864 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:48.908629 28856 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:49.130928 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 144204us
W20260709 12:10:49.128222 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 181279us
I20260709 12:10:49.140779 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.142302 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:49.142645 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.143028 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.143494 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.156021 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:49.143832 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.157456 25614 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:49.158340 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:49.158430 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:49.159296 25614 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:49.159988 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.100929 28881 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.160907 25614 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:49.156359 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:49.148053 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:49.156008 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.162871 25613 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:49.077770 29019 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:49.119563 28744 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.176792 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.156383 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:49.178442 25762 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:49.099889 29006 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:49.156469 28867 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.184801 29006 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:49.186398 28856 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.154335 28864 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.186892 28708 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.185514 28945 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.128737 29004 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.182077 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:49.127539 29011 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.177112 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:49.187145 25619 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:49.437144 28847 consensus_meta.cc:287] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.001s
I20260709 12:10:49.155954 28769 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:49.450848 28847 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.451443 28769 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.452297 25764 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.372854 28771 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:49.284523 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 405573us
I20260709 12:10:49.454396 28769 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:49.191368 29037 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:10:49.329100 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:49.465101 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:49.256374 28889 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.210s
I20260709 12:10:49.185562 29006 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:49.187990 29019 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:49.199519 28744 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.456243 28950 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:49.460143 28865 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:49.460309 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 278293us
W20260709 12:10:49.194734 28901 consensus_meta.cc:287] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.594s	user 0.015s	sys 0.002s
I20260709 12:10:49.460767 28979 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.461370 29020 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.148597 28857 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.187662 28978 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.275s
W20260709 12:10:49.372820 29042 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:10:49.463699 28996 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:49.187651 28792 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.466516 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:49.405916 28783 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:10:49.278641 29035 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.275238 25658 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:49.306505 28864 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.450845 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:49.516435 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 241359us
W20260709 12:10:49.516530 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 65753.4us
I20260709 12:10:49.517508 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:49.517668 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:49.470655 28708 raft_consensus.cc:476] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:49.471657 29028 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:49.476195 25582 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:49.521644 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45580.1us
I20260709 12:10:49.485594 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.524278 28744 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.524565 28905 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.465444 25762 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.489257 29019 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:49.526932 29019 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.527997 29019 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.493495 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:49.496546 28979 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.516794 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:49.434477 29040 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:10:49.257191 29027 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.531366 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.533380 25767 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:49.530320 28979 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.519929 28900 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:49.532500 28769 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:49.519706 29029 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.500974 29006 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.523469 29035 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.539063 29006 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.515849 28996 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:49.538996 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.540140 25767 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:49.540560 29035 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.541079 28996 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:49.541121 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.543037 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:49.543870 25767 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.545261 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:49.513985 29025 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.495615 28950 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:49.496608 28865 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:49.520126 28901 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:49.558591 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81313.7us
I20260709 12:10:49.532434 28792 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:49.530473 28970 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.533099 28708 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:49.508803 28857 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.545429 29054 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.530751 29028 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:49.572046 28970 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.564687 29025 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.587800 29028 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:49.587989 29025 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.577732 29054 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.590931 29054 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.592258 29004 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.592407 28970 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.586086 28979 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:49.581856 29013 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 1.247s	user 0.002s	sys 0.015s
I20260709 12:10:49.595880 28979 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:49.636663 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 113487us
I20260709 12:10:49.640882 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:49.642697 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1430) took 1079 ms. Trace:
I20260709 12:10:49.643185 25619 rpcz_store.cc:276] 0709 12:10:48.563351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.563497 (+   146us) service_pool.cc:224] Handling call
0709 12:10:48.566439 (+  2942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.450289 (+883850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.641738 (+191449us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400418f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:49.642247 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427048704}
W20260709 12:10:49.647213 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 153616us
W20260709 12:10:49.648533 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.650451 25582 leader_election.cc:400] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:49.556373 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1508) took 1536 ms. Trace:
I20260709 12:10:49.650990 25582 leader_election.cc:403] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:49.651803 25685 rpcz_store.cc:276] 0709 12:10:48.014465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.014653 (+   188us) service_pool.cc:224] Handling call
0709 12:10:48.823879 (+809226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.862405 (+ 38526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.551139 (+688734us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400265f50. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:49.551302 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763585920}
I20260709 12:10:49.652673 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:49.654363 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:49.655273 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:49.661238 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:49.663264 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:49.666682 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:49.668982 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:49.648324 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 103000us
I20260709 12:10:49.669727 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:49.676118 25694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1498) took 1483 ms (client timeout 1560 ms). Trace:
W20260709 12:10:49.676819 25694 rpcz_store.cc:269] 0709 12:10:48.192274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.192822 (+   548us) service_pool.cc:224] Handling call
0709 12:10:49.675504 (+1482682us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54003b8654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:49.675823 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290519296}
I20260709 12:10:49.683555 25762 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:49.684868 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:49.686405 25760 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:10:49.697528 28847 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.701009 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:49.701054 28857 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.712800 28865 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:49.713863 28792 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.710024 25763 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:49.716553 28905 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.717350 28900 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:49.718086 28970 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:49.719177 28817 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.753273 28817 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:49.753715 28817 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.754768 28995 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.755297 28995 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:49.755741 28995 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.697568 28864 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.761300 28996 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:49.761945 28996 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:49.762424 28996 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:49.742383 28878 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:49.743891 28889 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.741226 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:49.738080 28978 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:49.575878 28708 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:49.743216 28744 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.746667 28905 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.747453 28771 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.748437 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.752637 28947 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:49.746088 28792 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.763094 28900 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:49.793176 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 108714us
I20260709 12:10:49.792976 28708 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.794464 28905 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.795292 25763 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:49.796617 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.797681 28901 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:49.798805 28889 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.790586 28792 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:49.802069 25765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1798) took 1857 ms (client timeout 1863 ms). Trace:
W20260709 12:10:49.802651 25765 rpcz_store.cc:269] 0709 12:10:47.944701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.944828 (+   127us) service_pool.cc:224] Handling call
0709 12:10:49.801576 (+1856748us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540024b8d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:49.801831 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512728960}
I20260709 12:10:49.805595 28856 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:49.806447 28950 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:49.807255 28950 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:49.808121 28843 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.809023 28843 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.813306 28970 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.791234 28900 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:49.796686 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:49.794415 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:49.801903 28889 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.816761 28947 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:49.813866 28970 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:49.835175 28856 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.835253 29019 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.837432 29019 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.837930 28857 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.838778 28857 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.839398 28843 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.840185 29019 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.841145 28857 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.842036 28847 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.842451 28945 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.815027 28882 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.815496 28901 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:49.852157 29028 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:49.852741 29028 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:49.854876 29006 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:49.855340 29006 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:49.856485 29006 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.834100 28970 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.858839 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.841843 29054 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.886530 29054 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.889161 29054 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.889274 28783 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:49.892289 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.893874 25764 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.858497 28978 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:49.847812 28882 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.895766 28947 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.896737 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.897162 25583 leader_election.cc:400] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8.
I20260709 12:10:49.897409 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.897420 28847 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.898454 28945 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:49.899857 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.893935 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:49.858176 29006 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:49.815721 28950 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:49.876973 28889 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:49.906026 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:49.917346 28950 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:49.918200 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 54707.4us
I20260709 12:10:49.910207 28847 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:49.923724 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1741) took 1057 ms. Trace:
I20260709 12:10:49.945009 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:49.945164 25768 rpcz_store.cc:276] 0709 12:10:48.869403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.869692 (+   289us) service_pool.cc:224] Handling call
0709 12:10:48.870631 (+   939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.904740 (+ 34109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.904896 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.904965 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:48.905022 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.923149 (+1018127us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b5400150754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:49.923243 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.923511 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77738752}
I20260709 12:10:49.946002 28847 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.947803 25768 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:10:49.948362 25768 pending_rounds.cc:85] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 5
W20260709 12:10:49.929121 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 134971us
I20260709 12:10:49.906817 28882 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.952256 25768 pending_rounds.cc:107] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:10:49.953162 25768 raft_consensus.cc:2889] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.936909 28945 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.913110 28905 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:49.944659 28783 tablet_bootstrap.cc:492] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:10:49.928777 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.949747 25613 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:49.926055 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41126 (request call id 238) took 1118 ms. Trace:
I20260709 12:10:49.959720 25765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:49.960573 25765 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:49.960353 25766 rpcz_store.cc:276] 0709 12:10:48.807497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.816099 (+  8602us) service_pool.cc:224] Handling call
0709 12:10:48.852609 (+ 36510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.862629 (+ 10020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.862683 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.862748 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.862797 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.925568 (+1062771us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b54002b9dd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:49.925640 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.925861 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22397312}
I20260709 12:10:49.931382 28978 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.961462 25765 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.879703 29028 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.966862 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:49.968146 25759 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:49.970021 29028 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.945925 25763 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.933350 28856 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:49.987394 28889 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:49.988034 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 43513.3us
I20260709 12:10:49.988368 28945 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:49.954761 28905 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.989152 25658 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:49.984580 28783 ts_tablet_manager.cc:1403] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 2.003s	user 0.047s	sys 0.042s
I20260709 12:10:49.984632 28847 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.007458 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.018910 28979 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.019771 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:50.020751 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.021508 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.019797 28979 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.995647 28856 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:10:50.022358 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.023422 28856 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:50.023844 28856 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:50.024359 28979 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.024969 28856 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:49.988300 28889 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.031942 28905 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.032735 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.033541 25617 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:50.035272 25611 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:10:50.036850 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.036689 28970 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.037801 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.012401 28865 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:50.040014 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.040817 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.041360 28889 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.020840 25694 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:50.043263 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52453.3us
I20260709 12:10:50.045691 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:50.047233 25767 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.006s
I20260709 12:10:50.047952 25767 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:50.048560 25614 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:50.040915 25619 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.060209 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.055575 28995 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.064704 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.065644 28995 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.071645 28783 raft_consensus.cc:359] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:50.072547 28792 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.075075 28792 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.077726 28970 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.078238 28817 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.080202 28856 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:50.079905 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.560s (SENT) [suppressed 12 similar messages]
I20260709 12:10:50.082559 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.072897 28783 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:10:50.099193 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.098681 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.103793 25763 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:50.107867 25764 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:50.112708 28554 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.109745 28783 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:50.115176 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.116722 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.117442 28783 ts_tablet_manager.cc:1434] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.003s
I20260709 12:10:50.123458 25514 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.124987 25694 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:50.127637 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.133706 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.134773 25685 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:50.125900 25514 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:50.140815 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 95237.1us
I20260709 12:10:50.143028 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.143051 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.143169 28817 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.150574 25694 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:50.151129 25617 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:10:50.143107 28900 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.153841 28900 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.136620 25514 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.160825 25765 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.158565 29006 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.164245 25761 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.164471 25615 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:10:50.168779 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89247.4us
I20260709 12:10:50.169082 25694 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:50.169862 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 103149us
I20260709 12:10:50.164292 29006 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.178077 28901 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.181070 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.182006 28929 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:50.181931 25765 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:50.182591 28996 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.182775 28929 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:50.183275 29062 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:50.184639 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1748) took 1003 ms. Trace:
I20260709 12:10:50.185554 28929 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:50.185006 25762 rpcz_store.cc:276] 0709 12:10:49.181398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.687222 (+505824us) service_pool.cc:224] Handling call
0709 12:10:49.687961 (+   739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.688763 (+   802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.688800 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.689514 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.831577 (+142063us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:49.831620 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.833867 (+  2247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.184392 (+350525us) raft_consensus.cc:1685] finished
0709 12:10:50.184416 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.184569 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22273,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"thread_start_us":141529,"threads_started":1,"wal-append.queue_time_us":225451}
I20260709 12:10:50.189983 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.187757 25658 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:50.204245 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.182686 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:50.208940 25767 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:50.204444 25692 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:50.209256 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.207996 25514 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 9, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 9 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.210628 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.221345 25619 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:50.224339 28882 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.224882 25658 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:50.225922 28554 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.226472 28889 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.187951 28900 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:50.227129 25766 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:50.228160 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:50.230647 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:50.233210 29068 log.cc:927] Time spent T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:10:50.207930 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:50.237591 28900 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:50.238634 28900 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.188971 29006 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.245249 28900 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.247248 28996 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.251663 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.253183 28792 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:50.255115 25692 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:50.257097 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:50.258744 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.260104 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.255640 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.261078 28901 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.264808 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.265085 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.267092 28882 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.267959 25766 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:50.275583 25693 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.279578 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.280879 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.282004 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.282723 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.283743 25692 raft_consensus.cc:2410] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:10:50.276381 28792 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.286847 25514 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.288807 28792 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:50.289525 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.289163 25514 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 7, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.290623 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.291184 25514 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 5, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.290729 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.293363 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.292933 25514 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.294497 25688 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:50.294690 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.306903 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.297187 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.309157 28882 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:50.309746 25687 raft_consensus.cc:2410] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:10:50.309888 28882 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:50.298046 28929 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:50.310945 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:50.312626 28769 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:50.310817 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.298933 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:50.299782 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.305166 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.289341 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.314627 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:50.315177 25690 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:50.294981 25514 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.316025 28769 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.323468 25694 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 5.
I20260709 12:10:50.321887 25693 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:50.325062 28769 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:50.316190 28882 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:50.330754 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.330084 25689 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:50.343613 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.344920 25693 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:50.345800 28929 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.344960 25690 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:50.350432 25687 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:50.350605 25691 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:50.351521 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:50.360949 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62176.6us
I20260709 12:10:50.363886 25732 leader_election.cc:400] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:50.366843 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.369374 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.365453 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:50.370114 25612 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:50.375103 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.376070 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.378049 25693 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:10:50.392392 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.392434 25688 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:10:50.393460 25693 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:10:50.393765 25614 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:50.397384 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.402189 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.420001 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.422058 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.425536 25615 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:50.413908 28847 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.414417 28792 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.429858 28792 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:50.432631 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.432308 28792 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.438408 29011 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:50.439258 29011 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.442788 29011 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.447971 28847 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:50.452922 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:50.452713 28847 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.454536 28882 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.454941 28995 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.455428 28847 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:50.455525 28995 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:50.449324 25514 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 9, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:50.456667 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.457223 25514 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.468065 25514 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.470587 25689 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:50.471628 29011 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.474020 28847 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:50.474689 28847 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.457226 28995 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.469733 25514 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 9, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 9 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.481156 25514 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 10, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:10:50.466069 25513 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 176) took 19786 ms (client timeout 15000 ms). Trace:
I20260709 12:10:50.484930 25693 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:10:50.487254 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:50.483259 25513 rpcz_store.cc:269] 0709 12:10:30.679062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.679376 (+   314us) service_pool.cc:224] Handling call
0709 12:10:30.738901 (+ 59525us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:10:50.465756 (+19726855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:45.113624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:45.143967 (+ 30343us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:45.144026 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:45.144045 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:45.144491 (+   446us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:45.144581 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:45.157860 (+ 13279us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:45.186470 (+ 28610us) tablet.cc:701] Row locks acquired
0709 12:10:45.186493 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:10:45.186670 (+   177us) write_op.cc:270] Start()
0709 12:10:45.186813 (+   143us) write_op.cc:276] Timestamp: P: 1783599045186614 usec, L: 0
0709 12:10:45.186837 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:45.319198 (+132361us) log.cc:844] Serialized 934 byte log entry
0709 12:10:46.382755 (+1063557us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:46.961501 (+578746us) op_driver.cc:464] REPLICATION: finished
0709 12:10:47.342842 (+381341us) write_op.cc:301] APPLY: starting
0709 12:10:47.342941 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:47.343066 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:47.343085 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:47.343478 (+   393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:47.343682 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:47.343730 (+    48us) write_op.cc:312] APPLY: finished
0709 12:10:47.343931 (+   201us) log.cc:844] Serialized 28 byte log entry
0709 12:10:47.344116 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:47.344219 (+   103us) write_op.cc:454] Released schema lock
0709 12:10:47.344262 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:47.344721 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:47.344749 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1170018,"reported_tablets":57,"spinlock_wait_cycles":23528704,"child_traces":[["op",{"apply.queue_time_us":373776,"apply.run_cpu_time_us":1857,"apply.run_wall_time_us":1857,"num_ops":2,"prepare.queue_time_us":159683,"prepare.run_cpu_time_us":10292,"prepare.run_wall_time_us":323038,"raft.queue_time_us":383519,"raft.run_cpu_time_us":50203,"raft.run_wall_time_us":341679,"replication_time_us":1753029,"spinlock_wait_cycles":30679808,"thread_start_us":769354,"threads_started":4,"wal-append.queue_time_us":173552,"wal-append.run_cpu_time_us":65425,"wal-append.run_wall_time_us":2833824}]]}
I20260709 12:10:50.492873 25514 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 7, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.499034 25514 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.500739 25514 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 9, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.502457 25514 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.504652 25514 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.507377 25514 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.511022 25514 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.514024 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.484709 28847 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:50.514820 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.519153 25690 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:50.515527 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.520468 28769 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.522343 25514 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.523977 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.526338 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.527487 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.536921 28817 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.543792 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.545415 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:50.545667 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.546921 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:50.553121 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55822.3us
I20260709 12:10:50.558315 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:50.558923 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 193623us
I20260709 12:10:50.569113 26337 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Advancing to term 10
I20260709 12:10:50.578302 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:50.580996 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:50.583093 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.584643 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.586084 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:50.587675 28847 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:50.644366 28847 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:50.644750 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.588812 25613 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:50.588168 28929 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.646590 28929 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.647375 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.648985 28929 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:50.598019 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.651571 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.641620 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:50.644718 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.599465 25688 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:50.655439 25612 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.655874 25613 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.657305 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.658243 25611 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:10:50.664685 29011 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:50.668345 29011 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.634322 28817 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:50.675606 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:50.680243 25762 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:50.681710 25514 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.696777 25514 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 6, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 6 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.708804 25612 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:50.715418 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.653208 28882 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:50.727970 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.729360 25514 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:50.728781 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:50.733069 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:50.678449 28947 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:50.736008 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:50.738179 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 61248.1us
I20260709 12:10:50.739408 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.741817 25762 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:50.750517 25763 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:50.760730 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:50.716497 28996 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:50.770016 25514 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:50.746217 28817 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.789389 28792 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.795552 28817 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.793915 28792 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:50.803112 28792 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.806893 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.808713 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.813685 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:50.802116 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:50.792615 28771 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:10:50.826328 28847 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:50.822117 29011 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:50.849237 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.825343 28900 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:10:50.912302 29006 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.912863 29006 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:50.887535 28996 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:50.890367 28769 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.916510 28996 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:50.913776 29006 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.922135 28554 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.940233 25763 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
W20260709 12:10:50.944607 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 198704us
W20260709 12:10:50.948223 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.958304 28792 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:50.961201 28792 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:50.961864 28792 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.943116 28554 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.974483 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 160913us
W20260709 12:10:50.992466 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 100621us
W20260709 12:10:50.996923 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 245306us
I20260709 12:10:50.975256 28554 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.018843 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.024901 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:51.028903 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.034379 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:51.036649 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 164080us
I20260709 12:10:51.036888 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:51.042848 25761 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:51.020460 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:51.004999 28792 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.049919 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:51.061197 25765 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.045354 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.062696 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.065162 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-d5b02303361d43d1903c3e943b866b64 received from {username='slave'} at 127.0.0.1:59338
W20260709 12:10:51.065482 29081 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:51.065872 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-d5b02303361d43d1903c3e943b866b64 on tablet d5b02303361d43d1903c3e943b866b64 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:51.042692 28900 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:51.072412 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 64140.8us
I20260709 12:10:51.074966 25657 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:10:51.082188 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51698.7us
I20260709 12:10:51.019171 28996 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.076872 28900 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.107333 25765 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:10:51.108649 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.113147 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:51.123771 29006 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.107661 29080 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:10:51.086130 29088 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:51.105975 28996 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.128381 28847 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:51.129711 28792 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.129835 28901 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.134037 28847 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.149664 28847 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.138872 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.140697 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:51.127077 29095 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.141458 29090 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:51.141759 25613 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:51.142216 28995 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.142355 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.142917 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:51.143040 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.143640 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.144588 25617 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:10:51.141502 28999 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:51.146497 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.163692 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:51.173280 28995 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.175685 28995 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.179323 25616 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:51.170178 29088 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.178448 29006 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.184266 28929 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:51.181241 28947 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:10:51.143044 28901 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:10:51.189205 28900 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.190366 28995 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:51.190753 28900 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.184444 29006 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.193953 29006 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.170855 28999 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.169783 29095 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.177665 28554 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.202605 29090 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.203253 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.204102 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:51.205150 28901 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:51.205852 29098 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.215039 28817 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:51.215186 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:51.216446 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.222216 25611 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:10:51.236088 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 161251us
I20260709 12:10:51.237334 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.212283 28901 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.242576 28901 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:51.242681 28771 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:51.213446 28792 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:51.246606 25611 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:51.240096 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.212111 29098 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.239849 25616 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.249917 25619 raft_consensus.cc:2410] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:51.239811 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:51.243851 25614 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:51.210237 29090 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.240645 28817 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.257433 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.257342 29090 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.258404 25759 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:51.258855 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.260039 29103 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.261153 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.261642 29103 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:51.262223 29103 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.263207 29103 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.268414 29097 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:51.269395 29097 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:51.259059 28771 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.277478 29104 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.277979 29104 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.278050 29098 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.279253 29098 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.279337 29104 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.280395 29095 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.281169 29095 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:51.281746 25612 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:51.284061 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:51.286816 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71714.2us
I20260709 12:10:51.281620 29095 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:51.255818 28817 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.297554 28554 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.298516 29011 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:51.298943 29011 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.299889 29011 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.287635 28792 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.301435 29011 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.282341 28999 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.302443 28792 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.303843 28999 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.305326 28817 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.307823 29090 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.310492 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 153938us
I20260709 12:10:51.289011 28995 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:51.300251 28847 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.316207 28995 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:51.338449 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71198.6us
I20260709 12:10:51.346681 25612 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.346745 29104 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.350906 29093 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.351570 29093 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.353976 29093 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.336380 28771 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.333364 29006 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:51.358410 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:51.358968 29095 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.339555 28995 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.359478 28901 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:51.359957 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.361370 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 102653us
I20260709 12:10:51.362540 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:51.364108 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.374961 29006 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.375489 29006 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.380096 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.382222 29110 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.382963 29110 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.387099 29110 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.392822 28901 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.394737 28847 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.395926 29006 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.399657 29082 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:51.400372 29082 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:51.402963 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.404848 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:51.406844 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.363273 29103 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:51.414238 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:51.414902 25619 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:51.419088 29095 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.424139 28769 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:51.426512 28817 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.428081 25612 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:51.433995 28817 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.408955 29006 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.411931 28847 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:51.407379 29082 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:51.434922 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 56552us
I20260709 12:10:51.407764 28947 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.435551 29113 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.436600 28901 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.436843 25619 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:10:51.449265 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.458969 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:51.472056 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.476991 29111 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:51.477705 29111 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.480147 29111 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.461447 28900 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:51.492897 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.468310 29103 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:10:51.501080 29101 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.503922 25764 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:51.459240 29113 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.491276 29097 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:51.507570 29103 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.508957 29103 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.515151 28995 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.517752 28995 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:51.518663 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.519843 29097 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.523006 29097 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:51.527326 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.528946 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65462us
W20260709 12:10:51.532482 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56196.6us
I20260709 12:10:51.494513 28900 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.543035 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:51.562911 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 176889us
I20260709 12:10:51.564329 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:51.563691 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.542030 29108 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:10:51.540328 29111 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:51.571115 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.545539 28847 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:51.540009 28856 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:51.575307 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:51.578382 25763 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.576490 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.578567 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.555894 29105 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:51.564029 28817 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.591763 25583 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.575381 29086 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.562566 28771 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:51.614130 25763 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
W20260709 12:10:51.632906 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60400.4us
I20260709 12:10:51.615636 29117 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.591552 28817 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.619392 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.585220 28856 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.623075 29113 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.616250 28929 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:51.590224 29105 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:51.583309 28847 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.583011 29111 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.627297 28947 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.627360 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.577482 28900 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.630646 29093 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.640105 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:51.645062 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54780us
I20260709 12:10:51.651861 25583 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.641276 28929 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:51.662509 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 119560us
I20260709 12:10:51.647490 29082 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.661835 29104 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.674520 29111 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.675493 28847 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.662370 28929 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.654960 28995 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.657348 29086 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:51.684599 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.690662 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.691164 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.696075 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.702847 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.680487 28900 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.705358 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.693497 29006 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:51.704233 29110 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.708581 29113 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:51.708617 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.722615 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.723145 29105 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:51.708750 29126 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:51.725483 29098 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.709513 29110 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.726037 29098 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:51.726624 28817 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.727754 29110 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.728055 28554 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.710403 29006 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.729270 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.729773 29006 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.708207 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.732491 29113 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.732782 28856 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.733088 29113 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:51.710507 29111 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.733825 29111 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:51.701304 29088 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.734169 29113 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.699559 29083 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.734788 29111 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.709739 29117 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:51.727074 29098 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.711886 25583 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:51.743167 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.714725 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.747623 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.756373 25763 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:51.756707 25619 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:51.758236 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.686384 29108 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:51.762954 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.763777 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.763880 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.764557 25612 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:10:51.766476 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 54718.3us
I20260709 12:10:51.766031 28817 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.769143 29090 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.769340 28817 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.769683 29090 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.769712 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:51.770332 29090 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.770483 28817 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.772300 29117 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:51.772701 29117 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.709390 29086 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:51.777311 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:51.768069 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.773061 29117 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:51.755761 28792 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.780372 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.711896 29097 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.759037 29093 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:51.788457 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:51.793658 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:51.794601 29092 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.795035 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.795390 29107 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.796070 29107 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.796500 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.781303 28769 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.779764 28901 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.804085 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.797137 28856 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:51.785595 29095 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.793848 29097 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:51.815436 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.819258 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.809931 29125 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.799970 28847 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.803012 28769 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.802506 29105 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.823377 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.824653 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.812391 29096 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.813436 29006 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:51.810175 29107 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.809733 28901 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.835210 29096 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.822815 28856 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:51.837309 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.827328 28771 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.836084 29103 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.829398 28769 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.827615 28792 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.829100 28996 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.834250 29097 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:51.808943 29093 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:51.875407 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.878350 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.879246 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.850538 28847 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.839093 29083 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:51.884411 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.867583 29107 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.887985 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:51.864820 28929 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.878077 28996 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.888913 29083 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.890710 29105 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.891134 28996 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.891296 28929 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.882108 28847 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.880534 29103 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.892542 28847 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.896266 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.897114 25765 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:10:51.865268 28771 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.899986 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:51.900607 28771 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.901230 28771 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:51.901609 28771 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.901953 28771 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:51.943957 29133 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.901849 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.908083 28847 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.950467 29103 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.951601 29105 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:51.952226 28847 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:51.952239 29126 raft_consensus.cc:1064] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:10:51.914188 25612 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:51.915294 25619 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:51.855118 28856 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.844892 29090 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.956293 29126 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:51.830179 29108 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:51.917099 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:51.934089 29132 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:51.920671 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.921833 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "481bb8b350a240b0a487c38c13791369"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:51.923254 29083 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.844378 28901 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.934444 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.934598 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.938670 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:51.915931 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:51.989899 25616 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:51.961048 25617 raft_consensus.cc:606] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:51.957440 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73086.5us
I20260709 12:10:51.960069 25614 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:51.928084 29093 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.987030 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:51.990768 25617 raft_consensus.cc:614] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:51.989001 25618 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:51.865309 29104 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:51.851135 29096 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:51.998613 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:51.991865 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:51.959625 29090 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.006801 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:51.952258 29105 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:52.012331 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 124379us
I20260709 12:10:51.837873 29006 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:52.021588 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:52.024215 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.024955 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.025068 25685 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:52.026341 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:51.983341 29103 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:52.011492 29125 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.026926 25687 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:52.031009 25617 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:52.038121 25693 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:51.991024 29110 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:52.008181 29093 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.040345 25688 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:52.037187 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.022550 25692 raft_consensus.cc:2376] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:10:52.042358 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:52.038726 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46955.7us
I20260709 12:10:52.014271 28847 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.066411 25694 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:52.050158 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.067950 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.068710 25694 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:52.070617 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.018342 29096 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.016572 28901 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.065023 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.078568 25763 raft_consensus.cc:2368] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:52.076319 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.076458 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:52.079440 25692 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:10:52.042821 28817 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.092549 28817 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.080686 29096 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:52.095639 29096 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.096057 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.097273 25686 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:52.001307 29104 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.042217 29101 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:52.000918 28769 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.094086 29105 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.104602 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.106189 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.077180 29125 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:52.111825 29006 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.081837 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.083333 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.083814 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.088650 29117 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.091583 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.114581 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.076808 25691 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:52.129469 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.118793 25688 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:52.138439 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.119709 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.141433 25694 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:52.151923 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.153825 25689 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:52.157105 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.157702 25691 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:10:52.157398 25763 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:52.158098 25764 raft_consensus.cc:2410] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:52.159385 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.160058 25694 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:52.161077 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:52.161207 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69725.9us
I20260709 12:10:52.162137 25762 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:52.162189 25583 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.164731 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.164891 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.165834 25694 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:52.166078 25691 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:52.166685 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:52.167303 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.167886 25694 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:52.175626 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff1240c7107404994c96234274c5e64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:52.176337 25618 raft_consensus.cc:606] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.176695 25618 raft_consensus.cc:614] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:52.178160 25694 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:10:52.178292 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:52.180154 25688 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.050746 29093 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:52.186684 25691 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:52.198633 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:10:52.196381 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 112707us
I20260709 12:10:52.197638 25693 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:52.193553 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 47778us
I20260709 12:10:52.260864 29093 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.160593 29125 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.328708 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.182564 29086 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:52.298343 29139 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:10:52.201056 28999 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.261690 25762 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:52.311946 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:52.312126 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:52.339047 25690 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.339318 25689 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:52.316684 25694 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:10:52.327608 25687 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
W20260709 12:10:52.321291 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 127866us
I20260709 12:10:52.331910 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.150884 28792 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:52.114614 29110 consensus_queue.cc:1243] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:52.318548 28996 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:52.361207 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.353986 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.354903 25692 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:10:52.355798 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.381829 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.350853 29090 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.314709 28995 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:52.384037 25764 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:52.353704 28847 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.393946 29117 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.394057 28847 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:52.394601 28847 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.394673 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.396036 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.398578 25763 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:52.398736 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.332266 28856 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:52.389524 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.390915 29090 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.360591 28996 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.377286 28817 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.380249 29107 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.335228 28771 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.358614 28769 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.332261 29096 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.438608 25690 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:52.376255 29105 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:52.405400 29011 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.355278 28999 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.436573 28996 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.461405 28999 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.462889 29108 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.383314 28792 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.438818 29113 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:52.489144 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 166579us
W20260709 12:10:52.491683 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 146732us
W20260709 12:10:52.506359 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.509471 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:52.509786 25611 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:52.487143 29111 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.515607 25764 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:10:52.516345 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 317812us
I20260709 12:10:52.516105 25764 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:52.447206 29107 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.520162 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.520542 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.489928 29011 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:52.532975 25657 leader_election.cc:400] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10.
I20260709 12:10:52.524441 25764 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.584977 29104 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.630829 29125 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.520910 29111 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.631418 29125 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.630877 25764 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:52.563419 29011 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:52.526647 29141 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:10:52.602454 29090 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.608170 26337 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:52.609515 29095 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.612841 29098 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:52.619300 29107 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.620383 29096 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.621356 28771 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.622822 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.561059 28996 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.597939 29103 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.626032 28792 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.625852 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.670859 25766 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.627650 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.628439 29153 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.629136 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.672068 25763 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:10:52.644069 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 120117us
I20260709 12:10:52.673982 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:52.645149 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 128006us
I20260709 12:10:52.644688 25762 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:10:52.643832 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 254378us
I20260709 12:10:52.675712 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.653193 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:52.653827 25614 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:52.654665 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:52.656663 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:52.656980 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:52.678457 25611 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.678720 25616 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:52.659665 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.660490 25619 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:10:52.669088 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:10:52.680727 25694 raft_consensus.cc:606] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.677708 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.658924 29098 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:52.662729 29104 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.714545 25657 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.715077 29104 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.716687 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.717710 29104 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.717545 25516 catalog_manager.cc:5697] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:52.688524 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.718040 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.722474 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.700274 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.712297 29150 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:52.661170 29095 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.697898 28771 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:52.732242 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.734504 25611 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:52.719178 29110 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:52.736609 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:52.737897 29125 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:52.736380 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.738059 25766 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:52.728647 28929 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.742431 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.698807 29113 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.745496 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.738034 29095 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:52.721120 29133 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:52.745646 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.686967 28792 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:52.739874 29097 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:52.672989 29103 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.730697 29148 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.741496 29150 consensus_queue.cc:1243] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:52.756707 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.740173 28947 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.750927 29110 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:52.772662 29090 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:52.758037 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:52.775269 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.800804 25762 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:52.752660 29111 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:52.743139 29104 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.723403 29093 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.720883 29126 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:10:52.787552 28999 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.792551 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:52.809737 28999 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.810286 28856 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.810774 28856 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.811131 28856 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.811288 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:52.812008 28999 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.812566 28999 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:52.814452 29150 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.815107 29150 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:52.816063 29150 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.814452 29006 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:52.818990 29006 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:52.819850 29006 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.800348 29101 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:52.802484 28947 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:52.824340 28947 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.794273 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:52.751847 28900 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:52.755941 29156 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.749997 28769 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.720034 29105 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:52.775102 28929 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.848071 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:52.803493 29095 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:52.827956 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 75264.4us
I20260709 12:10:52.832734 25763 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:52.833429 25764 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:10:52.805092 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47149.3us
I20260709 12:10:52.858076 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.762795 28901 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:52.865916 25768 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.866961 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:52.860045 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:52.825731 28856 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.873263 25767 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:10:52.878105 25767 pending_rounds.cc:85] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 6
I20260709 12:10:52.878522 25767 pending_rounds.cc:107] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:10:52.879024 25767 raft_consensus.cc:2889] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.889585 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.849642 28769 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.865590 29126 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.867592 29093 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:52.895373 25619 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:52.864416 28847 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:52.875876 29111 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:52.896872 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:52.905077 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:52.906899 25618 raft_consensus.cc:606] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.907269 25618 raft_consensus.cc:614] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:52.892288 28769 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.881222 29113 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:52.914868 25765 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:52.889273 29108 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:52.908427 29111 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:52.924057 28999 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.929718 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:52.930653 25618 raft_consensus.cc:606] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:52.942020 29169 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:53.015594 29167 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
W20260709 12:10:53.015885 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.075714 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 318293us
I20260709 12:10:52.930742 29111 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.030966 29096 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:52.933069 28999 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.160382 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:53.030313 29086 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.153512 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:53.161139 25619 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:53.179836 25614 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:53.161127 25762 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:10:53.185000 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:53.139335 29093 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.150399 29125 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:53.186549 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 258166us
I20260709 12:10:53.190497 25619 raft_consensus.cc:614] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.195523 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:53.187471 29153 consensus_meta.cc:287] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.008s
I20260709 12:10:53.231841 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:53.234773 29147 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.190809 29096 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:53.236022 29170 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:10:53.191854 29156 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:53.196156 28856 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.180131 29086 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.230834 29153 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.243916 28847 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:53.250196 28996 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.241097 29092 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.249900 28929 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.204743 29093 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.264472 29147 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.253611 29104 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:53.337112 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 77816.9us
I20260709 12:10:53.347174 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:53.348594 28999 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.351018 29172 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.355074 29172 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.355741 29093 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.356169 29105 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.340102 29147 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.356586 29105 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:53.357626 29172 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:53.357547 29105 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.352479 29162 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:53.354198 29168 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:10:53.349347 28792 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:53.360747 28792 consensus_queue.cc:1243] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:53.361546 28769 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.363449 29086 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.343289 28900 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:53.368523 28769 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.352080 29126 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.403525 25616 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.407706 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:53.408463 25759 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.409227 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.369050 29095 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.345132 29092 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.369246 29162 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:53.358860 29105 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.381130 29150 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:53.387377 29098 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.392283 29147 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.399712 25763 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:10:53.401108 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:53.401512 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.402962 25614 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:10:53.438761 25612 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.414463 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.403242 29125 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:53.417069 25618 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:53.439600 25614 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:53.417830 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.440636 25615 raft_consensus.cc:2393] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:53.418159 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.418646 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.404202 29153 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.419600 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:53.420083 25768 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:10:53.391146 28947 consensus_meta.cc:287] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.007s
I20260709 12:10:53.444972 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:53.424258 29162 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:53.403077 29104 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.434891 25760 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.413339 29083 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.520411 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:53.520212 29083 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.521878 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.428602 29090 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.522634 29090 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.421200 29156 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:53.524788 25614 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.525154 29156 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:53.453231 25612 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:10:53.530395 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.531359 29156 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:53.531767 25612 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:53.456168 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.532985 29083 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.524837 29090 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.534017 25610 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:53.448134 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:53.535249 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:53.430061 29150 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:53.458339 28900 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:53.538367 28900 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:53.538019 29150 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.426877 29126 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:53.539407 29150 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.539716 29126 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:53.439109 29152 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.542625 29152 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.431538 29093 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.447408 28769 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.449620 28947 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.497556 29162 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.500317 29098 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.450133 29153 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.514859 25516 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 4 to 5, leader changed from 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 5 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:10:53.516899 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:53.515239 29111 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.469146 25759 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:53.442010 25761 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:53.421339 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 72958.1us
I20260709 12:10:53.526041 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.445466 29125 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.526885 25616 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:53.527055 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:53.548188 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 118624us
I20260709 12:10:53.581566 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:53.582767 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.522648 25615 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:53.535354 25610 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
W20260709 12:10:53.584165 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.556357 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.584311 25610 pending_rounds.cc:85] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 8
I20260709 12:10:53.584935 25610 pending_rounds.cc:107] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:10:53.585206 25610 raft_consensus.cc:2889] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.426565 29092 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.588418 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:53.548038 29126 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:53.589962 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:53.589890 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:53.590801 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.591445 25768 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:53.592168 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:53.592533 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.593075 25768 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:53.593145 25617 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:53.593645 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.593884 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.593323 25761 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:53.594573 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.602559 25763 raft_consensus.cc:2410] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:10:53.595331 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:53.596283 25762 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:53.599112 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.605939 25764 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:53.539402 28900 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.551510 28769 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:53.597424 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 146950us
I20260709 12:10:53.602571 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.603214 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.490314 29104 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.611013 25618 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:53.613541 28996 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:53.611393 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.615013 25766 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:53.615209 29104 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.619211 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:53.620108 25767 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:53.623234 29181 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.618145 25768 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:53.596508 29162 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.630766 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.552261 29093 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.633411 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.634788 29096 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.637147 25687 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.594065 29083 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:53.656221 25692 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:53.644250 28769 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.647182 28947 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.648535 29153 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.612385 29097 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.687479 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.687739 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:53.688828 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.689419 25692 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:10:53.635968 25766 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:53.660758 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:53.691763 25687 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:53.692226 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.662204 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.692907 25616 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:53.694686 25694 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:53.696177 25694 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:53.664986 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.696900 25690 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:10:53.675635 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.624177 29181 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.668926 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:53.690203 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.684145 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.699309 25691 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.700026 25615 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:10:53.681967 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50178.4us
I20260709 12:10:53.701745 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:53.616657 29107 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.712911 25688 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:53.604347 28999 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:10:53.705432 25690 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:10:53.706024 25687 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:53.709605 25618 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:10:53.712878 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.703714 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.720629 25689 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:53.704321 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.703099 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:53.628463 29084 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:53.732920 25658 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:53.733136 29084 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:53.735368 29125 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:53.735680 29084 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:53.739912 29178 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.740576 29178 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.743930 29180 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.744431 29180 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.744807 29180 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.746245 25760 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:53.748116 25612 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:53.749936 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.752143 25612 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:10:53.714919 29097 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.682838 29096 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.682914 29104 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.713173 29152 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.728924 28792 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.729323 25691 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:10:53.814456 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.729453 29107 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.731622 29093 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.625522 28856 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:10:53.763640 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.826937 25617 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:10:53.775290 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73872.6us
W20260709 12:10:53.809855 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.828167 29096 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.811427 25692 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.829962 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.822538 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.830974 29107 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.831035 25615 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:53.823344 28901 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:53.800273 29092 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.836265 25692 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:53.800057 28947 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:10:53.829635 29180 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.819515 29181 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.834981 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.848228 25691 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:53.857503 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.858230 25690 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:53.859979 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.862828 25692 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:53.863241 25692 pending_rounds.cc:85] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 4
I20260709 12:10:53.863580 25692 pending_rounds.cc:107] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:53.863876 25692 raft_consensus.cc:2889] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.871335 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:53.876564 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:53.877416 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.842157 29103 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.882638 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.884753 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.885357 25611 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:53.885857 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.888396 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.891728 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:53.893693 25693 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.833112 28792 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.832176 29104 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:53.902922 29182 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:53.902740 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:53.903223 29096 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:53.889663 29098 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.911746 29152 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.852722 28947 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:53.863266 29172 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:53.918736 25658 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:53.842645 28901 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.855480 29083 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:10:53.950745 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:53.964474 25691 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.946655 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:53.966552 25693 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:53.921378 29096 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.968508 29096 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:53.946858 28947 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:53.942898 29098 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.971321 29098 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.971702 29092 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.972317 29092 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.972755 29092 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.943182 29152 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:53.975164 29152 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:53.975927 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 57297.9us
W20260709 12:10:53.964635 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 68215.1us
W20260709 12:10:53.961750 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.977329 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:53.895319 29178 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.952448 29104 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.982935 29172 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:53.984227 29097 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.985505 29172 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:53.986480 29097 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.987126 29097 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.987658 29097 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.988534 29180 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:53.992442 29111 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.002066 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:54.002851 25693 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:54.003904 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:54.020095 25514 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 179) took 13986 ms (client timeout 15000 ms). Trace:
W20260709 12:10:54.022428 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.020592 25514 rpcz_store.cc:269] 0709 12:10:40.034376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.038601 (+  4225us) service_pool.cc:224] Handling call
0709 12:10:54.019982 (+13981381us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:51.087824 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:51.123628 (+ 35804us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:51.123712 (+    84us) write_op.cc:435] Acquired schema lock
0709 12:10:51.123736 (+    24us) tablet.cc:662] Decoding operations
0709 12:10:51.129319 (+  5583us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:51.129392 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:51.129423 (+    31us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:10:51.308536 (+179113us) tablet.cc:701] Row locks acquired
0709 12:10:51.308584 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:10:51.308831 (+   247us) write_op.cc:270] Start()
0709 12:10:51.309033 (+   202us) write_op.cc:276] Timestamp: P: 1783599051308756 usec, L: 0
0709 12:10:51.309057 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:51.360206 (+ 51149us) log.cc:844] Serialized 10319 byte log entry
0709 12:10:51.671893 (+311687us) op_driver.cc:464] REPLICATION: finished
0709 12:10:51.827011 (+155118us) write_op.cc:301] APPLY: starting
0709 12:10:51.827152 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:51.840167 (+ 13015us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:51.840326 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:51.924501 (+ 84175us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:51.924982 (+   481us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 12:10:51.925032 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:51.925630 (+   598us) log.cc:844] Serialized 175 byte log entry
0709 12:10:51.925869 (+   239us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:51.926164 (+   295us) write_op.cc:454] Released schema lock
0709 12:10:51.980758 (+ 54594us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:52.011656 (+ 30898us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:52.016888 (+  5232us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":294616,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":129821,"apply.run_cpu_time_us":7106,"apply.run_wall_time_us":179051,"num_ops":26,"prepare.queue_time_us":125290,"prepare.run_cpu_time_us":16427,"prepare.run_wall_time_us":326582,"raft.queue_time_us":199841,"raft.run_cpu_time_us":14138,"raft.run_wall_time_us":98034,"replication_time_us":362586,"thread_start_us":293303,"threads_started":4,"wal-append.queue_time_us":102403,"wal-append.run_cpu_time_us":22785,"wal-append.run_wall_time_us":1464889}]]}
I20260709 12:10:53.976558 29152 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.948572 28792 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.038543 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.037616 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:54.039422 25694 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:54.040386 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.041458 25691 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:54.043691 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:54.044198 25691 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.041100 25694 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:10:54.045322 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.048213 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.049168 25689 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:54.032713 29180 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:54.074793 29150 consensus_meta.cc:287] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.001s
I20260709 12:10:54.079267 29180 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.079895 29180 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.081516 25685 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:54.087056 25686 raft_consensus.cc:2410] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:54.103426 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.104488 25611 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:54.110621 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.110945 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.126713 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.077582 29098 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.147426 25612 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:10:54.148155 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 91240.7us
I20260709 12:10:54.156004 25691 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:54.160241 25658 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:54.162020 29111 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.166783 29111 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.168941 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.169621 29111 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.135363 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:54.164273 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.165998 25615 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:54.175213 25611 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:54.081811 29092 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.191646 25658 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:54.195381 25693 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:10:54.146955 29162 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.131536 29172 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.196856 29133 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.210340 29111 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.216435 29162 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.220127 29111 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.224371 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.225195 25688 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:54.205312 29150 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:54.226190 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:54.246397 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:54.234927 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 257159us
I20260709 12:10:54.230978 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:54.233369 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.232363 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.132386 29097 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.254498 25692 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:54.263118 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:54.263373 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.264227 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:54.264792 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.212453 28792 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:54.265264 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:54.271337 25685 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:54.264287 25611 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:54.273051 25694 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:10:54.282079 25761 pending_rounds.cc:85] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 6
I20260709 12:10:54.282570 25761 pending_rounds.cc:107] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:10:54.266480 25689 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.289160 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:54.290331 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.291373 25760 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:54.291697 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.292819 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.295907 25762 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:54.282938 25761 raft_consensus.cc:2889] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.238876 29133 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.316699 25692 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:10:54.219154 29172 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.228669 29083 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:54.235813 28856 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:54.325917 25693 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:54.226562 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.343016 25687 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:54.260344 28817 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:54.274173 28769 raft_consensus.cc:2764] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:10:54.281579 29086 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.276744 29162 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.299052 29151 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.325824 29083 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:54.413833 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 153923us
I20260709 12:10:54.235984 28996 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:54.262872 29156 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:10:54.281345 29148 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
W20260709 12:10:54.436722 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.318537 28792 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:54.428515 29125 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.513841 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.424331 29111 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:54.467190 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 201995us
I20260709 12:10:54.327301 29133 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.437753 29086 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.487125 29083 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.412612 28817 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.410638 28856 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:54.499329 29097 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.500491 29098 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.504782 29092 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:54.507498 29096 consensus_meta.cc:287] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 12:10:54.528703 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.535908 29090 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.523862 28996 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:54.560056 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.447557 29151 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.467231 28769 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:54.509656 29125 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.537405 29086 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.529573 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:54.583974 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.567160 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.559835 29083 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.649072 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.649964 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:54.600457 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.561098 29202 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.596283 29178 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.581338 29092 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:54.645298 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 115846us
W20260709 12:10:54.651067 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84023.3us
I20260709 12:10:54.652601 25765 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:54.647048 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.667129 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.560310 29096 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.562695 29098 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:10:54.656128 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.648530 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.698704 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.699674 25764 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:54.558996 29180 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.675019 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:54.704408 25759 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.705313 25766 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:54.651808 28901 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.688205 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.688771 29162 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.722311 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:54.722441 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.642935 28769 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:54.690706 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:54.693477 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 447193us
I20260709 12:10:54.642602 29151 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.651849 25763 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:54.643178 29125 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.702716 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.734818 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.735446 25617 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.737018 25764 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:54.655097 29152 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:54.687422 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.709674 25611 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:54.664969 29172 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.723445 25612 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:54.724279 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.724182 25759 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:54.725657 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:54.661967 29150 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.744589 25759 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:54.730461 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.752331 25766 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:54.728713 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.745839 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.732628 28901 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.757354 28856 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:54.694801 29178 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.693760 29092 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.755867 25613 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.725553 29162 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:54.758329 29152 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:54.771202 29152 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.776775 28817 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.777539 28769 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:54.779033 29197 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:10:54.751664 29180 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.734355 29156 consensus_queue.cc:1243] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:54.672147 29202 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.660081 28792 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.763180 28901 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.765205 25612 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:54.768061 29092 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.755362 29172 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:54.806123 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 153621us
I20260709 12:10:54.764537 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.746786 29150 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:54.811733 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86180.2us
I20260709 12:10:54.817305 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:54.781782 29162 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:54.818784 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.809724 25617 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:54.812659 29201 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:54.820277 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:54.784540 29111 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.794994 29210 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.829687 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65336us
I20260709 12:10:54.823927 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:54.831631 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.834167 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.836316 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:54.809651 29156 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.849072 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.820840 29150 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.825557 29096 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:54.833580 28947 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:54.864176 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:54.850215 28901 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.850071 29207 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.850135 29090 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.866935 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:54.870214 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:54.871613 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.853541 29180 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.823226 29172 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.872926 29180 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.857492 29107 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.848110 28817 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:54.853534 29209 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.847105 29111 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.876466 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.877878 29180 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.847568 29210 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.891023 29156 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.891935 29156 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.892702 29210 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.878031 29209 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.894534 29156 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.894632 25766 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:54.895581 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.896472 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.916190 25612 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:54.829032 29201 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.898550 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:54.885089 25762 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:54.922787 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.909775 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:54.923686 25614 raft_consensus.cc:2368] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:10:54.924124 25765 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:54.920783 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.924707 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:54.925889 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.926079 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:54.928475 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:54.931351 29156 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.937659 29156 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.940732 29156 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.932379 29210 raft_consensus.cc:476] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:54.862244 28947 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:54.942020 28947 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.933501 29216 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:54.946993 29216 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.950663 29216 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:54.953752 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55269.6us
I20260709 12:10:54.957386 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:54.965885 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:54.968825 25612 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:10:54.959443 28769 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.970474 28817 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:54.958524 28856 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.971712 28817 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.971508 29203 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:54.972069 28856 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:54.972394 28817 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:54.914866 29209 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.975328 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 158111us
I20260709 12:10:54.976949 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:54.983376 25762 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.986596 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:54.963876 29107 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.017820 29220 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:55.039090 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 70887.3us
I20260709 12:10:55.040273 25582 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:54.971623 28769 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.016559 29211 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:55.064635 29201 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:54.958333 29207 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:54.969825 28901 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.032648 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:54.969825 29214 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:10:55.051231 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 91419.1us
I20260709 12:10:55.036273 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.076098 25761 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:10:55.075951 29207 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:55.077083 29156 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.077536 29156 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.077867 29156 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.078452 29207 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:55.062984 29208 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 12:10:55.035039 29216 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:55.051225 29220 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:55.087075 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.086911 25761 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:10:55.089670 29220 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.099272 25657 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.101652 28900 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:10:55.102072 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.102216 28900 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:55.103538 28900 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.104430 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.106325 29151 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.111609 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.113158 25761 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.114866 29111 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.050748 29210 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:55.122534 25762 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
W20260709 12:10:55.121336 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.044248 29086 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.125372 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.083940 29178 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.057580 29107 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.152143 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.157451 25764 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:10:55.138636 29206 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.162729 29206 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.163219 29206 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.126473 29203 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.153597 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.177562 25762 raft_consensus.cc:2393] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:55.179309 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 139111us
I20260709 12:10:55.180076 25613 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
W20260709 12:10:55.182057 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 56781.2us
I20260709 12:10:55.098281 28999 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:10:55.183591 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 106962us
I20260709 12:10:55.184391 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.172137 29096 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.187625 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1627) took 1111 ms. Trace:
I20260709 12:10:55.176959 29203 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.189129 25694 rpcz_store.cc:276] 0709 12:10:54.076361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.301811 (+225450us) service_pool.cc:224] Handling call
0709 12:10:54.302241 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.397426 (+ 95185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.397564 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.400038 (+  2474us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.721650 (+321612us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.721703 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.721799 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.187393 (+465594us) raft_consensus.cc:1685] finished
0709 12:10:55.187420 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.187564 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57928,"raft.queue_time_us":58385,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":320128,"threads_started":1,"wal-append.queue_time_us":417043}
I20260709 12:10:55.181427 29153 raft_consensus.cc:2764] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:10:55.222357 29225 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.179026 28817 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.187389 29133 consensus_meta.cc:287] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.004s
I20260709 12:10:55.226779 29133 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.227475 28817 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.194657 29203 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.201512 29204 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:55.202428 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.231393 29204 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:55.231472 29156 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.202826 29151 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.204140 28769 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:55.232751 29083 consensus_meta.cc:287] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.000s
I20260709 12:10:55.232394 29204 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.182492 28856 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.184787 29172 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.219347 29107 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.233474 29204 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.220904 29086 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:55.229130 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.233724 29092 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.236618 29156 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.238785 29092 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.197551 28947 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:10:55.246073 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 157158us
I20260709 12:10:55.249706 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.250416 25762 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:55.251431 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.247699 29092 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:55.253042 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.271821 25761 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:55.257970 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.245653 29096 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:55.276358 25583 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.279310 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.282238 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.244881 28901 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.242663 29150 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.252755 29133 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.291416 29206 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.275153 28769 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:55.282819 29092 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.320690 25688 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:55.322757 29092 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.299726 29162 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.295143 29200 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.672s	user 0.002s	sys 0.004s
I20260709 12:10:55.324824 29162 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.325174 25762 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:55.326742 29150 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.295754 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.328066 25761 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.328771 29206 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.253288 29151 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.330153 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.285249 29224 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.331000 25764 raft_consensus.cc:2368] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11.
I20260709 12:10:55.296417 29220 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.331975 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.333415 29220 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.333567 28901 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.297058 29231 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.334120 28901 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:55.317894 29107 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:55.335017 29107 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.335222 28901 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.337181 29107 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.339917 25657 leader_election.cc:400] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11.
I20260709 12:10:55.340283 25657 leader_election.cc:403] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.340759 29148 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.341068 29092 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.341149 29148 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:55.342860 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.343541 25616 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:10:55.344491 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.346387 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.346719 29151 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.347590 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.348312 25615 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:10:55.351840 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.352077 28996 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:55.352984 29151 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.356915 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.357817 25619 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:55.358952 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.362385 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:10:55.363675 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.364816 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.297370 29209 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.298480 29125 consensus_meta.cc:287] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.004s
W20260709 12:10:55.372771 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 188457us
I20260709 12:10:55.300710 29207 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:55.302685 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.389804 29210 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.390209 25765 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.391301 29216 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.391986 29209 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.303520 28947 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.392357 29216 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:55.308818 25768 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:55.250015 29090 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.307971 29203 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.393337 29090 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.393690 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.394341 25613 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.389858 29207 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:55.394930 29203 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.248584 29180 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.395506 29125 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.395902 29207 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.396721 25767 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:55.397262 29180 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.397461 25617 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:55.296497 29178 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.390364 29210 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:55.398491 29125 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.398145 29178 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:55.398893 29210 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.399519 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.399714 29178 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.400178 29210 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.334023 25763 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.365059 29219 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:55.393357 29216 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.366729 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.389891 29162 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:55.398777 29151 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:55.403375 29207 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.405318 25615 raft_consensus.cc:2368] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11.
I20260709 12:10:55.403729 29151 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.406747 29090 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:55.407060 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 120558us
I20260709 12:10:55.407367 28947 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.407968 29151 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.410063 28947 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:55.410724 28947 consensus_queue.cc:1243] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:55.411330 29107 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:55.411827 29107 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.413941 29107 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.367370 29201 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:55.418375 29172 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:55.418932 29172 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.421120 29172 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.362138 25761 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:55.296793 29096 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.423992 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.299793 29214 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:55.425014 29214 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:55.374119 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:55.426684 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52678.1us
I20260709 12:10:55.427372 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.428265 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.428648 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.429245 25761 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.414798 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.414990 29180 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:55.367125 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 176276us
I20260709 12:10:55.430466 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.434454 25764 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
W20260709 12:10:55.441666 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.444698 25613 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:55.468673 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.469914 25762 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:55.471731 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.478912 25763 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:55.481666 25765 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:55.438604 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:55.487946 29162 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:10:55.488579 29162 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.489012 29162 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:55.442524 29227 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.489799 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.441875 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:55.491103 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52577us
W20260709 12:10:55.491201 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 54240.4us
I20260709 12:10:55.491649 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:55.491616 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49830us
W20260709 12:10:55.491779 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50093us
I20260709 12:10:55.497959 25689 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:10:55.499097 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.499820 25687 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:55.502692 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.503363 25687 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:55.508272 25761 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:10:55.511395 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:55.511528 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.512518 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.514899 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.425017 29151 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:55.517671 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.431640 29111 raft_consensus.cc:2764] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:55.441350 29211 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.523761 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.520282 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.521064 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.527659 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:55.532437 25691 raft_consensus.cc:2376] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11. Re-sending same reply.
I20260709 12:10:55.527515 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:55.529101 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.534112 25693 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:55.529778 25687 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:10:55.535097 25687 pending_rounds.cc:85] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 5
I20260709 12:10:55.535465 25687 pending_rounds.cc:107] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:10:55.535934 25687 raft_consensus.cc:2889] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:55.491034 29107 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.551029 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.552047 25687 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.531046 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.525060 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.535113 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.543215 25688 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:55.557866 25693 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:10:55.533260 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.565726 25689 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.501482 29219 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.572706 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.507539 29103 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.571278 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.575417 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:55.573976 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.582129 25765 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:55.441335 28769 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:10:55.583017 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.595834 25687 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:55.525593 29125 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.490790 29172 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:10:55.597412 25685 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.593995 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.599501 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.600951 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.601900 25765 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:55.596007 25762 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:10:55.587007 25688 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:55.586200 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.596967 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.604946 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.606086 25687 raft_consensus.cc:2410] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:10:55.606905 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.543525 29211 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:55.618384 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:55.623098 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.616689 29111 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:55.627843 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.629091 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.624181 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.631302 25686 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:55.632133 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.630128 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.634806 25688 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:55.635694 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.636801 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.565518 29151 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:55.583438 29103 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.578564 28817 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.573448 29092 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11.
I20260709 12:10:55.645463 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:55.649549 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:55.593353 29107 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:55.651124 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:55.618453 29086 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:55.655216 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 127634us
I20260709 12:10:55.640240 29211 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.531927 29233 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 12:10:55.621628 29133 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:55.661062 29086 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:55.670686 25693 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:55.573256 29236 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:10:55.645707 29103 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.648694 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:55.707125 25687 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
W20260709 12:10:55.691835 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 164411us
I20260709 12:10:55.714721 25762 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:55.715402 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55872.4us
I20260709 12:10:55.714883 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:55.652736 28817 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.687017 29086 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.723639 25763 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:10:55.725652 25658 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:55.717360 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.720592 29229 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:55.740796 29084 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:55.736086 29090 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.755412 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.765188 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:55.750344 29175 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.753170 29203 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.756609 29092 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.760247 29178 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.722461 29151 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.799818 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 276566us
I20260709 12:10:55.736199 29107 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.828445 29238 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:10:55.794003 29207 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.830102 29207 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:55.752537 29228 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.229s
I20260709 12:10:55.785996 29203 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.810914 29240 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:10:55.822904 29237 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:10:55.758590 29084 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:55.832653 25767 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:55.833926 25689 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:55.803972 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.755066 29229 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.788551 29153 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:10:55.866657 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 62760us
I20260709 12:10:55.867722 25689 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:55.869307 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.877647 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.879899 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:55.796586 29178 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.882287 29202 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:55.882841 29178 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.883761 29236 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:55.884500 29236 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:55.885877 29236 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:55.886482 29204 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.891359 25689 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:10:55.893814 25690 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:10:55.847038 29203 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.894148 29202 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.804781 28769 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:10:55.890568 29210 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.899236 29241 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:55.900372 29243 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:55.900974 29243 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.903275 29248 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:55.904412 29243 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.832235 29172 consensus_queue.cc:1059] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:55.908859 29084 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.910040 28817 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:55.911948 25688 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.913071 29229 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:55.916706 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.926170 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:55.928155 25658 leader_election.cc:400] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11.
I20260709 12:10:55.875697 29240 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:55.831111 29207 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:55.947672 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 67840.3us
I20260709 12:10:55.950809 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.952236 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:55.961117 29214 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.003s
I20260709 12:10:55.962471 29210 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.961671 29214 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.862668 29245 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:10:55.937376 29229 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:55.975745 25766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.009s
W20260709 12:10:55.976207 25766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.009s	sys 0.009s
W20260709 12:10:55.977906 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.983209 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.983940 25613 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:10:55.984483 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.984776 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.986452 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.988096 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.989367 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.989387 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.990235 25616 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:55.991153 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.991878 25613 raft_consensus.cc:2368] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:55.991892 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.992770 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:55.993706 25582 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.994874 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.995895 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1908) took 1065 ms. Trace:
I20260709 12:10:55.981241 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:55.996335 25768 rpcz_store.cc:276] 0709 12:10:54.930143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.231966 (+301823us) service_pool.cc:224] Handling call
0709 12:10:55.232243 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.392920 (+160677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.995650 (+602730us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b54000591d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:55.995833 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175193472}
I20260709 12:10:56.003147 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.004628 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:55.979431 29219 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.007339 29219 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:56.008270 29219 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.009471 29219 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.011612 29153 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.012089 29153 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:56.012923 29153 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.013456 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1880) took 1324 ms. Trace:
I20260709 12:10:55.976850 29156 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.023830 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:56.031193 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.027410 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.027448 25691 pending_rounds.cc:85] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 4
I20260709 12:10:56.036164 25691 pending_rounds.cc:107] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:10:56.036394 25691 raft_consensus.cc:2889] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.046627 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.047080 25618 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:56.048355 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.045939 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.049312 25763 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:10:56.052843 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.054627 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.059162 25764 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
W20260709 12:10:56.063169 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 85587.8us
I20260709 12:10:56.064833 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:56.030026 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:56.068171 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:56.069758 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.070621 25612 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:10:56.072851 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.073979 25617 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:56.013859 25759 rpcz_store.cc:276] 0709 12:10:54.688654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.786850 (+ 98196us) service_pool.cc:224] Handling call
0709 12:10:54.791339 (+  4489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.953489 (+162150us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:54.953852 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.072534 (+118682us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.363484 (+290950us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18003ae160. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafbe8c0a 00007fbdb9328219 00007fbdafc70a40 00007fbdafc6b4e4 00007fbdafc6b455 00007fbdb2d53060 00007fbdb2d65716 00007fbdb2d76287 00007fbdb2d76208
0709 12:10:55.519093 (+155609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.519173 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.519244 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.013181 (+493937us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400319cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:56.013233 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.013389 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281599,"prepare.queue_time_us":809,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":298480,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":20738,"spinlock_wait_cycles":401939584,"thread_start_us":273281,"threads_started":2,"wal-append.queue_time_us":141896}
I20260709 12:10:56.078971 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:56.077952 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45617us
I20260709 12:10:56.081321 29111 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:56.026521 29240 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.093034 29103 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.046567 29231 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.015724 29214 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:56.014238 29153 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.114878 25762 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.101227 29148 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.115715 29148 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.067899 28947 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:56.080880 29211 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.117025 29103 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.118129 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.118968 29211 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:56.098006 25760 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:56.080669 29156 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:10:56.121335 25761 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.079300 29172 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:56.018007 29226 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.122313 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 50) took 6864 ms. Trace:
I20260709 12:10:56.122423 29226 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.069283 29210 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.081959 29206 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:56.000468 29162 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:55.739455 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:56.127828 25694 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:56.128871 29162 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.135219 25685 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:10:56.138720 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 54895.4us
I20260709 12:10:56.169843 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:56.183323 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 137443us
I20260709 12:10:56.168651 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:56.187034 25694 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:56.187064 25582 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.187992 25613 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:56.172307 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:56.123531 25516 rpcz_store.cc:276] 0709 12:10:49.257988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.258184 (+   196us) service_pool.cc:224] Handling call
0709 12:10:56.122172 (+6863988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:53.910515 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:53.911198 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:53.911240 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:10:53.911262 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:53.911719 (+   457us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:53.911808 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:53.911842 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:53.912241 (+   399us) tablet.cc:701] Row locks acquired
0709 12:10:53.912262 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:53.912414 (+   152us) write_op.cc:270] Start()
0709 12:10:53.912547 (+   133us) write_op.cc:276] Timestamp: P: 1783599053912368 usec, L: 0
0709 12:10:53.912578 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:10:53.920362 (+  7784us) log.cc:844] Serialized 924 byte log entry
0709 12:10:54.152036 (+231674us) op_driver.cc:464] REPLICATION: finished
0709 12:10:54.623360 (+471324us) write_op.cc:301] APPLY: starting
0709 12:10:54.626538 (+  3178us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:54.659786 (+ 33248us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:54.708497 (+ 48711us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:54.894599 (+186102us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:54.894805 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:54.894849 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:54.895062 (+   213us) log.cc:844] Serialized 28 byte log entry
0709 12:10:54.917814 (+ 22752us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:54.952127 (+ 34313us) write_op.cc:454] Released schema lock
0709 12:10:54.954668 (+  2541us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:54.955117 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:54.955149 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1256392,"reported_tablets":4,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":406295,"apply.run_cpu_time_us":7212,"apply.run_wall_time_us":363800,"num_ops":2,"prepare.queue_time_us":236452,"prepare.run_cpu_time_us":30877,"prepare.run_wall_time_us":138812,"raft.queue_time_us":78061,"raft.run_cpu_time_us":44123,"raft.run_wall_time_us":164410,"replication_time_us":239286,"thread_start_us":534500,"threads_started":4,"wal-append.queue_time_us":126834,"wal-append.run_cpu_time_us":10843,"wal-append.run_wall_time_us":1947605}]]}
I20260709 12:10:56.189244 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:56.194864 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 117728us
I20260709 12:10:56.195835 25617 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:56.202129 25616 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:56.215250 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.045756 29086 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:56.218164 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45983.3us
I20260709 12:10:56.218909 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:56.219274 25657 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:56.220507 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:56.222518 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:56.223747 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:56.184163 29178 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.228107 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:56.228693 25618 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:56.228821 25611 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:56.208612 29225 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.243264 25732 leader_election.cc:400] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:10:56.244586 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.204093 29090 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.201829 29229 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:56.212287 28947 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:56.296271 25614 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:56.214164 29206 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:10:56.307760 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 63286.7us
I20260709 12:10:56.308832 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:56.298846 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.304090 25611 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:10:56.241238 29093 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.233572 29150 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:56.315960 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89911.5us
I20260709 12:10:56.246387 29231 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:56.328049 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 104371us
I20260709 12:10:56.329893 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:56.332173 25732 leader_election.cc:400] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:10:56.332557 25732 leader_election.cc:403] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:56.294960 29233 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.243314 29178 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.312026 29210 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.316622 29150 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.339107 29107 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:56.339773 29093 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:56.361224 29251 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 12:10:56.361853 29093 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.295974 29225 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.364748 29257 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.365919 29225 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.340477 29233 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:56.310104 29220 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:10:56.333639 29226 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.304997 28999 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:56.338302 29111 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.305315 29229 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:56.366371 26305 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.23.222.190:33735, user_credentials={real_user=slave}} blocked reactor thread for 52651.1us
I20260709 12:10:56.340063 29263 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:56.462790 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 113194us
I20260709 12:10:56.319144 29092 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:56.360371 29150 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.443207 29233 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.321715 29180 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:10:56.345098 29201 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
W20260709 12:10:56.503328 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.350739 29206 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.488857 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:56.495785 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 166388us
I20260709 12:10:56.412668 29107 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:56.504634 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:56.534334 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 79929.9us
I20260709 12:10:56.542248 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:56.557312 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 315607us
I20260709 12:10:56.559077 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:56.536022 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.561875 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.543648 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:56.481447 29263 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:56.569480 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65396.2us
I20260709 12:10:56.572381 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.568975 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:56.516978 29203 consensus_meta.cc:287] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.008s
I20260709 12:10:56.573904 29251 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.573815 29203 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.575179 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.580986 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.516340 29226 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:56.518373 29107 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:56.579066 29203 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.595428 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.605247 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.606289 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.614279 25759 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:56.607124 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:56.615656 25765 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.571612 29201 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:56.572163 29097 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.568864 29210 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:56.620030 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.577282 29242 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:56.625998 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58099.6us
I20260709 12:10:56.578919 29263 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:56.620343 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.542248 28996 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:56.629163 25685 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:10:56.656323 25613 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:56.593662 29251 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:56.592007 29226 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:56.629320 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.492208 28947 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:56.642992 25689 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.664324 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.644490 25690 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.648317 25766 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:56.649786 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:56.640208 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:56.561116 29250 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:56.652980 29111 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.651389 25760 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:56.653916 25611 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:56.670369 25611 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:10:56.670472 25618 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:10:56.670539 25764 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:56.659878 25613 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:56.665736 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.580753 29240 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:10:56.596937 29125 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.660501 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:56.618484 28999 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.608880 28817 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.646760 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:56.686343 25763 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.658331 29203 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:56.672992 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.673384 25766 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:56.660954 29276 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.618574 29086 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.623059 29214 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:56.658563 29219 consensus_meta.cc:287] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.641s	user 0.004s	sys 0.010s
I20260709 12:10:56.681407 25612 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:56.681324 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:56.638396 25765 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:56.660079 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:56.672183 29210 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:56.703267 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 136411us
I20260709 12:10:56.674453 29211 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.676985 29111 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.727162 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:56.713704 29125 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:10:56.807723 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 80676us
I20260709 12:10:56.683118 29092 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:56.684276 29151 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.817409 29178 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.711388 29242 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:56.822774 25763 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
W20260709 12:10:56.823858 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 343714us
I20260709 12:10:56.847158 26303 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:56.850171 29280 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.687544 28999 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.744858 29226 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.718729 29172 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:10:56.825291 29214 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:56.711169 29180 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:10:56.708913 29203 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:10:56.870188 25619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.026s	sys 0.019s
W20260709 12:10:56.900362 25619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.026s	sys 0.019s
W20260709 12:10:56.883296 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 50185.2us
I20260709 12:10:56.813694 29092 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:56.798026 29251 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:10:56.800987 29219 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:10:56.838605 29211 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:56.826458 29220 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:10:56.901566 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 78705.3us
I20260709 12:10:56.865600 29229 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:56.882970 29216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.001s	sys 0.012s
W20260709 12:10:56.882720 29265 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 12:10:56.871205 29214 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:56.929064 25685 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:56.868232 28817 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.966492 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:10:56.924105 29148 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.808s	user 0.015s	sys 0.000s
W20260709 12:10:56.912413 29270 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
W20260709 12:10:56.959700 29216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.001s	sys 0.013s
I20260709 12:10:56.916381 28999 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:56.904237 29092 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.915781 29251 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:10:56.912321 29267 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.561s	user 0.005s	sys 0.000s
I20260709 12:10:56.868888 29210 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:10:56.915278 29290 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:56.990010 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 88137.5us
W20260709 12:10:57.060290 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.010535 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 49707.2us
W20260709 12:10:57.148445 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 216805us
I20260709 12:10:57.151432 29290 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:57.148185 29251 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:57.152061 29226 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.163198 25766 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:57.163301 29290 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.165647 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:57.140841 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:57.159439 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2339) took 1116 ms. Trace:
I20260709 12:10:57.167825 25685 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:57.161643 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:56.990487 25610 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:57.170285 25685 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.167537 25619 rpcz_store.cc:276] 0709 12:10:56.043400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.043549 (+   149us) service_pool.cc:224] Handling call
0709 12:10:56.043873 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.044125 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:56.900834 (+856709us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.150809 (+249975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.159039 (+  8230us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.159104 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.159198 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.159358 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":308169,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":31628,"thread_start_us":1008377,"threads_started":2}
I20260709 12:10:57.035674 29242 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:56.925979 29277 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.956559 29178 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:10:56.981509 29214 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:57.034091 29274 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
I20260709 12:10:57.139635 29229 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.139290 29282 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:57.214777 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54851.8us
I20260709 12:10:57.006870 29273 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:57.214416 29233 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.671s	user 0.001s	sys 0.009s
I20260709 12:10:57.007606 29111 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.210s
I20260709 12:10:56.995069 28817 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.194276 29219 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:57.304848 29111 consensus_queue.cc:1243] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:57.226620 29210 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:10:57.225404 29229 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.303769 29209 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.335589 29289 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.238438 28792 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 12:10:57.319221 29267 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:10:57.342996 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 116949us
I20260709 12:10:57.319548 29203 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:57.202387 29277 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.350477 25613 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:57.350795 29304 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.351349 29289 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:57.357107 29153 consensus_meta.cc:287] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.245s	user 0.011s	sys 0.007s
I20260709 12:10:57.392409 29277 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.393144 29277 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:57.393625 29097 consensus_meta.cc:287] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.002s
I20260709 12:10:57.394133 29097 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.395282 25690 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.378111 29287 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.252727 29233 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:57.228374 29282 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.345567 29210 consensus_queue.cc:1243] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:57.404783 29286 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:57.244720 29273 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.396178 29287 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:57.419247 25615 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.359185 29209 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.407809 29298 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:57.435289 29302 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:10:57.435511 29229 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.435914 29209 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:57.436468 29301 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:57.436987 28817 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:57.437860 29300 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:10:57.412441 29286 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.440819 29286 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.415510 29210 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:10:57.456622 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.443838 29298 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:57.461670 29156 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.403561 29304 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:57.483884 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.471657 29263 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
W20260709 12:10:57.459570 29150 consensus_meta.cc:287] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.937s	user 0.011s	sys 0.004s
I20260709 12:10:57.475116 25617 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:10:57.475888 29156 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:57.477116 29280 consensus_meta.cc:287] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.005s
I20260709 12:10:57.483194 28947 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.484617 29210 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.501295 25613 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:57.478672 28817 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.524749 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.489086 29271 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:57.497272 29216 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.509542 29282 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.510344 29233 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:57.496248 29150 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.513810 29287 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.515009 29298 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.517565 29125 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:10:57.519205 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.496148 29263 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.491204 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.498967 28792 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:57.526592 28817 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.523803 29280 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.525408 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.505601 29304 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.506940 29273 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.532300 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:57.673496 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 141319us
I20260709 12:10:57.541136 29271 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.541957 29092 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.527948 29156 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.544674 29214 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.531876 29210 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.594660 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1648) took 2008 ms. Trace:
I20260709 12:10:57.643290 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.685474 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.622889 28856 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:57.618110 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.688755 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:57.689256 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1664) took 1044 ms. Trace:
I20260709 12:10:57.582453 29111 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.608160 29289 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:57.665069 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 318835us
I20260709 12:10:57.696070 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:57.666370 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 175281us
I20260709 12:10:57.648003 29125 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:10:57.558522 29276 consensus_meta.cc:287] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.813s	user 0.013s	sys 0.000s
I20260709 12:10:57.683362 29298 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.707765 29263 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.528658 28947 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.707778 29276 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.708806 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 2342) took 1627 ms. Trace:
I20260709 12:10:57.710021 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.710621 29319 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:57.525709 29107 consensus_meta.cc:287] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.906s	user 0.009s	sys 0.006s
I20260709 12:10:57.595031 29317 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.679459 25693 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:10:57.582819 29314 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.711577 29107 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.711690 29317 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.712306 29314 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.712786 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1658) took 1071 ms. Trace:
I20260709 12:10:57.713171 25693 rpcz_store.cc:276] 0709 12:10:56.641119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.641300 (+   181us) service_pool.cc:224] Handling call
0709 12:10:56.641652 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.711920 (+1070268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.712528 (+   608us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400327b54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:57.712723 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2386124160}
I20260709 12:10:57.581629 29201 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:57.648003 29290 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.604938 29172 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:10:57.720572 29172 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:57.721549 29172 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.722923 29172 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:57.729858 29210 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.702090 29111 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.731721 29150 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.732339 29111 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.613848 29228 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.686911 25765 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.648669 29216 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:57.733965 29228 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.734802 29216 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.546373 25611 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:57.737313 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:57.684383 25691 rpcz_store.cc:276] 0709 12:10:55.586415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.587178 (+   763us) service_pool.cc:224] Handling call
0709 12:10:56.027215 (+440037us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.165216 (+138001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.165251 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:56.165896 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 12:10:56.317274 (+151378us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:56.340098 (+ 22824us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.354924 (+ 14826us) log.cc:844] Serialized 14 byte log entry
0709 12:10:56.355139 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.355235 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.736730 (+381495us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b180038f440. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db
0709 12:10:56.808168 (+ 71438us) spinlock_profiling.cc:243] Waited 955 us on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:57.399050 (+590882us) raft_consensus.cc:1685] finished
0709 12:10:57.399085 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.566329 (+167244us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b180038f440. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e522 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:57.582870 (+ 16541us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b180038f440. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:10:57.594430 (+ 11560us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54003b9550. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:57.594551 (+   121us) inbound_call.cc:177] Queueing success response
0709 12:10:57.617486 (+ 22935us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b180038f440. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
Metrics: {"mutex_wait_us":253946,"prepare.queue_time_us":129847,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":270628,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":75313,"spinlock_wait_cycles":1077815424,"thread_start_us":151028,"threads_started":1,"wal-append.queue_time_us":184998}
I20260709 12:10:57.692586 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.581467 29211 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.671393 29323 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.672051 29282 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:57.700723 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:57.743575 29276 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:57.688472 28856 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:57.680446 29233 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:57.743566 29282 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:57.676232 29096 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:10:57.746381 29096 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:57.746654 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1515) took 1092 ms. Trace:
I20260709 12:10:57.747949 29214 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.747045 25616 rpcz_store.cc:276] 0709 12:10:56.653833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.653976 (+   143us) service_pool.cc:224] Handling call
0709 12:10:56.654433 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.725483 (+ 71050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.725524 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.515640 (+790116us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b2c000fcb58. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:57.516159 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.668230 (+152071us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.670583 (+  2353us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.670870 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.670946 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.746326 (+ 75380us) raft_consensus.cc:1685] finished
0709 12:10:57.746450 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.746585 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45903,"prepare.queue_time_us":1500,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":88855,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":10179,"spinlock_wait_cycles":56593792,"thread_start_us":176230,"threads_started":2,"wal-append.queue_time_us":184255}
I20260709 12:10:57.748322 29282 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:57.704090 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.748986 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.702719 29231 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.706761 29272 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:57.754197 29272 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:57.707062 29206 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:57.710855 25617 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 5.
I20260709 12:10:57.586201 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:57.714924 25687 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:10:57.709939 28947 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.716874 29107 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.719393 29317 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.709784 25610 rpcz_store.cc:276] 0709 12:10:56.081824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.194933 (+113109us) service_pool.cc:224] Handling call
0709 12:10:57.708578 (+1513645us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54000f7dd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:57.708712 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780689664}
I20260709 12:10:57.764629 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:57.744318 29211 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.745662 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:57.769372 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.770208 25612 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:57.720191 29092 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.702541 29245 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.750909 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.735862 29216 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.785022 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:57.772980 26334 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:10:57.786931 29180 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.788115 29245 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.750087 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.752847 28817 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.753270 29231 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:57.757515 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 56882.5us
I20260709 12:10:57.741598 29090 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.765338 25617 raft_consensus.cc:606] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.758495 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:57.748154 29096 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.798887 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.800292 25610 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:57.697929 29280 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:10:57.778496 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:57.789814 25616 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:57.804864 29177 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.807941 29177 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.808352 29177 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.811487 29211 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.812777 25616 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:10:57.813181 25616 pending_rounds.cc:85] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 5
I20260709 12:10:57.813493 25616 pending_rounds.cc:107] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:10:57.777244 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:57.791056 25611 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:57.790390 25582 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:10:57.790422 29263 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:57.764819 29153 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.799607 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:57.801191 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.741530 29228 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.751147 29201 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.798832 29090 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.804863 29314 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.807459 29317 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.813820 25616 raft_consensus.cc:2889] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.817142 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.792315 29245 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.817516 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:57.820020 25692 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:10:57.776576 29206 consensus_queue.cc:1243] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:57.820060 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:57.844022 29328 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.841948 29305 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.805416 29231 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.820703 25694 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:10:57.825217 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48109.5us
I20260709 12:10:57.827209 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:57.771463 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:57.847827 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:57.829921 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:57.848091 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:57.848423 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.750231 29323 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.828488 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.828883 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:57.766163 29210 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:10:57.806825 29150 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.803031 29226 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.836880 25693 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:57.858026 25768 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:57.858595 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:57.860028 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.860618 25693 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:57.861377 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.819811 28901 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.862406 28901 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.862761 29326 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.863338 29326 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.864136 25768 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:10:57.865163 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:57.844765 29305 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:10:57.848555 25610 raft_consensus.cc:606] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.865875 25768 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:57.866707 25610 raft_consensus.cc:614] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:57.830967 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.839994 25688 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.834318 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:57.867726 25691 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:10:57.868353 25759 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:57.869504 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.844434 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.869774 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:57.801162 29251 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.855695 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:57.871539 25759 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 5.
I20260709 12:10:57.871780 25767 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:10:57.833957 28817 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.856925 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.858719 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.865617 28901 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:57.863359 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:57.849609 25766 raft_consensus.cc:2410] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:57.874244 29326 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:57.881891 25760 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:57.847841 25612 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.883994 25760 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:57.884202 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 105784us
I20260709 12:10:57.872822 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:57.885003 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:57.885177 25759 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.870709 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.870374 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.876966 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.867529 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:57.882299 29210 consensus_queue.cc:1243] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:10:57.889894 25692 raft_consensus.cc:2410] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:57.897148 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.851128 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.844930 29281 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:57.898509 25685 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:57.828248 29233 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:57.888378 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.882616 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:57.874513 29151 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:57.892620 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:57.895761 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 63442.7us
I20260709 12:10:57.901435 25685 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:57.827569 29263 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.905037 25658 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:57.878832 28817 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:57.842489 29317 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:57.911710 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.853044 29272 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.914906 25692 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:10:57.922627 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:57.926083 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:57.926823 25610 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.924243 28817 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.867647 29150 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.926791 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:57.934492 25759 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:57.908625 29282 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.875824 29226 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.907876 29210 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.951032 25763 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:57.903805 29326 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:10:57.946033 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:57.883150 29305 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:57.901948 29209 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:10:57.907512 28769 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:57.966701 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:57.974983 25693 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:57.963963 29298 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.985569 29298 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.986028 29298 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.986332 25612 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:57.987211 25617 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.988199 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debca0eda6c649e38d13858860f6a245"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:57.988901 25612 raft_consensus.cc:606] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.947283 29098 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:58.000156 29098 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:57.947410 29103 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:57.689774 25689 rpcz_store.cc:276] 0709 12:10:56.644419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.675375 (+ 30956us) service_pool.cc:224] Handling call
0709 12:10:56.675671 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.711772 (+ 36101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.711822 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:57.589832 (+878010us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4800241ed8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:10:57.610958 (+ 21126us) spinlock_profiling.cc:243] Waited 952 us on lock 0x7b2c00000448. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1664372 00007fbdb2d96a01 00007fbdb2d5b43a 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2
0709 12:10:57.611844 (+   886us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.672298 (+ 60454us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:57.688350 (+ 16052us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.688791 (+   441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.688901 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.688974 (+    73us) raft_consensus.cc:1685] finished
0709 12:10:57.688995 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.689178 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35639,"prepare.queue_time_us":15895,"raft.queue_time_us":159405,"raft.run_cpu_time_us":2195,"raft.run_wall_time_us":729785,"spinlock_wait_cycles":42907520,"thread_start_us":59817,"threads_started":1,"wal-append.queue_time_us":56872}
I20260709 12:10:57.933863 29314 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:57.945017 29282 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.007545 29282 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.000291 29295 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:58.010222 29295 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.010633 29295 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.000277 29305 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.011029 29226 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.006194 25688 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:58.006036 25616 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:57.886117 29285 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:10:57.844759 29328 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:57.984301 29111 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:58.001391 29098 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.041527 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:10:58.044389 25612 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:10:57.945008 29327 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.045814 25612 raft_consensus.cc:614] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:58.049989 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 234) took 1368 ms. Trace:
I20260709 12:10:58.052024 25618 rpcz_store.cc:276] 0709 12:10:56.681336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.681788 (+   452us) service_pool.cc:224] Handling call
0709 12:10:56.696102 (+ 14314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.698893 (+  2791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.698942 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.699005 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:56.699055 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.049624 (+1350569us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b540016f3d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:58.049699 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.049895 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5714176}
I20260709 12:10:58.059725 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.060467 25612 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:58.060810 28856 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.062448 28856 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.063895 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1600) took 1135 ms. Trace:
I20260709 12:10:58.064735 29328 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.037338 29111 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.064399 25687 rpcz_store.cc:276] 0709 12:10:56.928828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.928947 (+   119us) service_pool.cc:224] Handling call
0709 12:10:56.929221 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.761508 (+832287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.063659 (+302151us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b5400344ed4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:58.063835 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1806485888}
I20260709 12:10:58.077163 29329 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:58.077345 29152 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:10:58.077858 29329 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:58.077913 29152 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:58.081144 29152 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.078186 29298 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.046154 29107 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:10:58.076205 29111 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.083036 29201 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.109965 29152 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:58.068814 29327 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.120447 29090 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.141952 29151 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.144228 29281 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.148375 29290 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:58.156847 29329 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:10:58.183574 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.184391 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.163208 29263 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:58.190786 29331 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:10:58.192144 29207 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.192633 29207 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:58.195482 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1915) took 1592 ms. Trace:
I20260709 12:10:58.200389 29083 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:58.231673 29083 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:58.223361 25762 rpcz_store.cc:276] 0709 12:10:56.602704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.604844 (+  2140us) service_pool.cc:224] Handling call
0709 12:10:56.651114 (+ 46270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.571243 (+920129us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:57.571680 (+   437us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.715300 (+143620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.715353 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.715397 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.195193 (+479796us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540024b3d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:58.195247 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.195415 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6625,"prepare.queue_time_us":842,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":1369,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":33574,"spinlock_wait_cycles":2115249536,"thread_start_us":143208,"threads_started":1,"wal-append.queue_time_us":191132}
I20260709 12:10:58.193521 29207 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.205001 28900 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.185286 29150 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.177402 29151 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.209474 29289 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:58.214947 29096 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.222725 25613 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:58.235059 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1599) took 1306 ms. Trace:
I20260709 12:10:58.246599 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:58.247193 25768 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:58.403090 25768 pending_rounds.cc:85] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 4
I20260709 12:10:58.403692 25768 pending_rounds.cc:107] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:58.404091 25768 raft_consensus.cc:2889] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.260567 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.406925 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:58.408041 25619 raft_consensus.cc:2410] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:58.263250 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:58.287331 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.180843 29201 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:58.296182 25582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.131:44413 timed out after 1.515s (SENT) [suppressed 5 similar messages]
I20260709 12:10:58.315222 29083 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:58.232888 29177 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:58.316095 29207 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.183104 29290 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.178550 29323 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.187124 29317 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.322650 25690 rpcz_store.cc:276] 0709 12:10:56.928508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.929498 (+   990us) service_pool.cc:224] Handling call
0709 12:10:57.140326 (+210828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.395695 (+255369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.234694 (+838999us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400265a54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:58.234968 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585880832}
W20260709 12:10:58.402640 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.408726 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:58.409428 25687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
W20260709 12:10:58.415308 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.415643 25766 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:58.402141 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:58.394096 25762 raft_consensus.cc:2368] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:58.437069 25687 raft_consensus.cc:606] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:58.416410 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 115593us
I20260709 12:10:58.418366 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:58.395941 29334 log.cc:927] Time spent T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:10:58.226344 29281 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.318756 29289 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:58.382390 29151 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:58.349035 29216 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.003s
I20260709 12:10:58.438374 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:58.350437 29096 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.455654 26334 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:10:58.456162 26334 pending_rounds.cc:85] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Aborting all ops after (but not including) 8
I20260709 12:10:58.385720 29111 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.446614 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.423974 29201 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.420866 29329 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:10:58.458359 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49712.2us
I20260709 12:10:58.463405 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:58.469929 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.290419 28900 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.449935 29177 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.475360 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.476269 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:58.485337 25768 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:10:58.474164 29216 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:58.549881 29327 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.549642 29289 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.456405 26334 pending_rounds.cc:107] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.9
I20260709 12:10:58.480912 29279 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.487072 29323 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.542598 29317 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:58.564076 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.485131 29231 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:58.567032 29289 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.570096 25762 raft_consensus.cc:2410] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:58.575914 25613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2363) took 1045 ms. Trace:
I20260709 12:10:58.554405 29216 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.581195 25613 rpcz_store.cc:276] 0709 12:10:57.530973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.676693 (+145720us) service_pool.cc:224] Handling call
0709 12:10:57.677026 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.322238 (+645212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.575650 (+253412us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54000e0bd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:58.575846 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254053120}
I20260709 12:10:58.561741 26334 raft_consensus.cc:2917] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Aborting config change with OpId 10.9: Aborted: Op aborted by new leader
I20260709 12:10:58.566047 29290 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:58.607698 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 311555us
W20260709 12:10:58.626721 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 204066us
I20260709 12:10:58.643622 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.564414 29327 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.562094 29279 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.599835 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58035.6us
I20260709 12:10:58.576023 29201 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.652719 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.647213 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:58.700156 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.713236 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.595557 29231 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.654335 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:58.705520 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.697589 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.715236 25759 raft_consensus.cc:2410] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:58.598167 29317 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:10:58.726079 25582 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:58.726773 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.755699 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:58.788321 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62412.9us
I20260709 12:10:58.599484 29216 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:58.654413 29337 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:10:58.756840 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.789501 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.788105 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.763698 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:58.797708 25688 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:10:58.655005 29338 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
W20260709 12:10:58.654707 29345 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:10:58.817127 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.817427 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.817132 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:58.658952 29279 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.678634 29295 consensus_meta.cc:287] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.003s
W20260709 12:10:58.655076 29332 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
W20260709 12:10:58.689313 29349 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:10:58.654898 29329 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.821391 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:58.649313 29172 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:58.655529 29336 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:10:58.716060 29214 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:58.822275 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:58.796823 29153 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:58.757257 29328 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.655189 29211 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.654959 29220 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.824725 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.852538 25612 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:58.655812 26334 raft_consensus.cc:2889] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.847688 29098 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.824862 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.856295 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:10:58.787959 29305 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.761s	user 0.013s	sys 0.001s
I20260709 12:10:58.856886 25619 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:58.819911 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.788067 28901 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:58.857905 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.859160 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.836177 28900 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.840245 29111 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.645782 29323 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:58.843813 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46454.5us
I20260709 12:10:58.861223 29323 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.813650 29096 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.866034 29178 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:58.853909 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:58.856151 29098 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:58.857571 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.757474 29107 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.862620 29220 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.844606 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.842170 29172 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.863610 29211 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.864081 29271 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.864429 29328 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.864701 29133 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:58.851416 29214 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.655646 29327 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.819700 29201 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:58.843323 29092 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.849965 29276 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:58.850349 29153 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.887029 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1965) took 1026 ms. Trace:
I20260709 12:10:58.973768 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:58.871347 29281 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.854226 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:58.897260 28856 raft_consensus.cc:993] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:58.900686 29241 raft_consensus.cc:993] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:58.909101 29323 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.977468 29276 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.014165 29276 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:58.919584 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.929739 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.015964 28817 consensus_meta.cc:287] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.053s	user 0.014s	sys 0.001s
I20260709 12:10:59.016959 29333 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.016717 28817 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:59.017628 29333 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:58.951638 29107 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.020023 29220 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.847530 29329 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.021584 29220 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.022068 29329 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:58.914698 29347 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
I20260709 12:10:59.021621 29107 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.976434 29233 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:59.022182 29220 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.023689 29233 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.025092 29220 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.875181 29330 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:10:59.026228 29220 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.831624 29295 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.026836 29220 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.029109 29295 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.971645 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.895272 29317 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.035943 29231 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:58.975291 29298 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.967242 29251 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:58.974912 25765 rpcz_store.cc:276] 0709 12:10:57.860142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.864294 (+  4152us) service_pool.cc:224] Handling call
0709 12:10:57.864610 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.884611 (+ 20001us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:57.884642 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.885102 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.009999 (+124897us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4800120258. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7c7bb37 00007fbdb7c7b9ca 00007fbdb7d7326f 00007fbdb7d72f37 00007fbdb7d8755c 00007fbdb7d87508 00007fbdb7d87488 00007fbdb7d87443 00007fbdb7d866ec 00007fbdb6cb0a96
0709 12:10:58.097250 (+ 87251us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.097297 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.097374 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.875659 (+778285us) raft_consensus.cc:1685] finished
0709 12:10:58.875688 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.886909 (+ 11221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18723,"raft.queue_time_us":25796,"raft.run_cpu_time_us":2566,"raft.run_wall_time_us":115471,"spinlock_wait_cycles":10173184,"thread_start_us":211828,"threads_started":1,"wal-append.queue_time_us":293636}
I20260709 12:10:58.979198 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:59.007921 29211 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:59.009838 29343 log.cc:927] Time spent T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.590s	user 0.005s	sys 0.000s
I20260709 12:10:59.010492 29327 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.020105 29333 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.875497 29150 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:59.040934 29098 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.041934 25759 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:10:59.043437 29328 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:58.978883 25767 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:10:59.046084 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 66972.5us
I20260709 12:10:59.047016 25613 raft_consensus.cc:1240] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.056595 25760 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:10:58.902177 29282 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.894s	user 0.006s	sys 0.006s
I20260709 12:10:59.063346 25765 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.081444 25765 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
W20260709 12:10:59.026947 29350 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:10:59.068490 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 205459us
I20260709 12:10:59.062402 29346 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.075227 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:59.089681 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:59.029112 29220 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:59.084645 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 230510us
I20260709 12:10:58.979382 29153 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.063966 29329 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.068452 29330 raft_consensus.cc:1081] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:10:59.063328 29152 consensus_meta.cc:287] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.004s
I20260709 12:10:59.079496 29333 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:10:59.087846 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 212429us
I20260709 12:10:59.093827 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:59.094336 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:59.099578 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:58.984587 29271 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:59.079190 28856 raft_consensus.cc:1081] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:10:59.095052 29083 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.089589 29346 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.091064 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:58.975653 29092 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:59.143661 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49414.7us
I20260709 12:10:59.088900 29328 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.095862 29327 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.107918 25615 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:10:59.138353 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2373) took 1398 ms. Trace:
I20260709 12:10:59.069301 29279 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.086637 29282 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:59.105803 29289 consensus_meta.cc:287] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.006s
I20260709 12:10:59.105021 29329 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.130105 29333 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.130002 29358 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.157115 28947 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.163012 25611 rpcz_store.cc:276] 0709 12:10:57.740227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.816988 (+ 76761us) service_pool.cc:224] Handling call
0709 12:10:57.817276 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.829008 (+ 11732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.829041 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.829546 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.170989 (+341443us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.171036 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.171144 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.008817 (+837673us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:10:59.127586 (+118769us) raft_consensus.cc:1685] finished
0709 12:10:59.127611 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.138224 (+ 10613us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27225,"raft.queue_time_us":14261,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3792,"spinlock_wait_cycles":12331264,"thread_start_us":295598,"threads_started":1,"wal-append.queue_time_us":414410}
I20260709 12:10:59.171976 29327 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:59.172441 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 72971.6us
I20260709 12:10:59.174180 29279 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.174782 29281 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.175043 29214 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:10:59.175366 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.179522 29276 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.180814 29348 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.284s	user 0.004s	sys 0.000s
I20260709 12:10:59.161926 29328 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:59.235814 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.182633 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1955) took 1359 ms. Trace:
W20260709 12:10:59.237142 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 105774us
I20260709 12:10:59.184736 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.168862 29092 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:59.191720 29357 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:10:59.193164 29356 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:59.193531 29125 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:59.155294 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.140050 29220 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.209156 25759 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:10:59.216081 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:10:59.218487 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.220070 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.253214 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:59.204176 29323 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:59.226897 29281 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.146209 29346 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.128278 29271 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:59.238478 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:10:59.237012 25763 rpcz_store.cc:276] 0709 12:10:57.823145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.823418 (+   273us) service_pool.cc:224] Handling call
0709 12:10:57.823711 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.951559 (+127848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.182290 (+1230731us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540024aed4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:59.182551 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291636608}
I20260709 12:10:59.210991 29358 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:10:59.238675 25613 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:59.102300 29228 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 12:10:59.253312 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2376) took 1312 ms. Trace:
I20260709 12:10:59.254964 25614 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.227249 28947 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:59.258050 29281 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.191951 29216 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.240772 29328 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.258986 29323 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:59.266862 29370 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.279850 29323 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:59.245913 29276 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:10:59.281754 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:59.284046 29329 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.285496 29276 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:59.267076 29355 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:10:59.258961 25611 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:59.261030 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45095.7us
I20260709 12:10:59.294589 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:59.297243 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:59.263885 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:59.253536 29220 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.246920 29279 consensus_queue.cc:1059] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:59.261977 29092 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.265377 29156 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.266467 29327 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.310205 29098 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:10:59.311115 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.315514 28817 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:59.316772 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:59.267534 25617 rpcz_store.cc:276] 0709 12:10:57.940446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.941312 (+   866us) service_pool.cc:224] Handling call
0709 12:10:57.987039 (+ 45727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.987567 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.253106 (+1265539us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5400361fd0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:10:59.253246 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104350080}
I20260709 12:10:59.271699 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2389) took 1014 ms. Trace:
I20260709 12:10:59.251873 29172 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.267441 29358 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.291631 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2375) took 1351 ms. Trace:
I20260709 12:10:59.299430 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:59.305908 28901 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.341672 28901 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.306348 29220 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.311429 29209 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.317924 25613 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.333350 25616 rpcz_store.cc:276] 0709 12:10:58.257279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.257625 (+   346us) service_pool.cc:224] Handling call
0709 12:10:58.258137 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.258983 (+   846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.259037 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.299516 (+ 40479us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.874246 (+574730us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:58.874346 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.874443 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.271446 (+397003us) raft_consensus.cc:1685] finished
0709 12:10:59.271469 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.271614 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9951,"raft.queue_time_us":1032,"raft.run_cpu_time_us":761,"raft.run_wall_time_us":50317,"thread_start_us":447906,"threads_started":1,"wal-append.queue_time_us":602990}
I20260709 12:10:59.334331 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:59.313407 25658 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:59.312479 25765 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:59.336390 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:59.313421 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2387) took 1088 ms. Trace:
I20260709 12:10:59.339771 29330 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:59.318046 29216 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.291446 29282 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.333003 25610 rpcz_store.cc:276] 0709 12:10:57.939999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.942293 (+  2294us) service_pool.cc:224] Handling call
0709 12:10:57.942745 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:58.431573 (+488828us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:58.552072 (+120499us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.962400 (+410328us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.975998 (+ 13598us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.976198 (+   200us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.976234 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.976325 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.291371 (+315046us) raft_consensus.cc:1685] finished
0709 12:10:59.291398 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.291549 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60998,"prepare.queue_time_us":123546,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3699,"raft.queue_time_us":40609,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":20488,"thread_start_us":830335,"threads_started":2,"wal-append.queue_time_us":515411}
I20260709 12:10:59.341918 29279 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:10:59.349794 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:10:59.387629 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 74347.6us
I20260709 12:10:59.389477 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1959) took 1553 ms. Trace:
I20260709 12:10:59.389907 25610 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:10:59.355489 25618 rpcz_store.cc:276] 0709 12:10:58.224725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.224899 (+   174us) service_pool.cc:224] Handling call
0709 12:10:58.291260 (+ 66361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.291781 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:58.598142 (+306361us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.893367 (+295225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.894032 (+   665us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.894228 (+   196us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.894309 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.894414 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.313155 (+418741us) raft_consensus.cc:1685] finished
0709 12:10:59.313182 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.313350 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":732,"prepare.queue_time_us":155888,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":5926,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":20496,"thread_start_us":430829,"threads_started":2,"wal-append.queue_time_us":433161}
I20260709 12:10:59.393772 25611 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:59.395972 25614 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
W20260709 12:10:59.397403 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47756.1us
W20260709 12:10:59.398001 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61651.7us
I20260709 12:10:59.389887 25764 rpcz_store.cc:276] 0709 12:10:57.836065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.836214 (+   149us) service_pool.cc:224] Handling call
0709 12:10:57.850793 (+ 14579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.040176 (+189383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.040208 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.040679 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.120885 (+ 80206us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.120972 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.345890 (+1224918us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001d51d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:10:59.345944 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.345993 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:59.346007 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.389402 (+ 43395us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":968,"raft.queue_time_us":3147,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10855,"spinlock_wait_cycles":432198912,"thread_start_us":78337,"threads_started":1,"wal-append.queue_time_us":116722,"wal-append.run_cpu_time_us":2144,"wal-append.run_wall_time_us":1057465}
I20260709 12:10:59.399395 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:59.400651 29327 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.342960 29263 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:59.342315 28817 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:10:59.401237 29327 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.401369 29263 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.403549 29263 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.403614 29327 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.321452 29233 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.404472 29206 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.405507 29272 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:59.399685 29271 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.406929 28792 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.407449 28792 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.407649 29271 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.407872 28792 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.407158 29328 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.409082 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:59.312148 29333 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.413166 29328 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.363803 29172 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:59.415305 29172 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.417865 29172 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.418505 25766 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:59.418826 29370 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:10:59.447525 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48224us
I20260709 12:10:59.311369 28947 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.420269 25582 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:59.389183 29289 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.432621 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.451937 25759 raft_consensus.cc:2410] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:59.429740 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.425836 25513 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:59.342223 28901 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.435928 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.460933 25761 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:59.461279 25613 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:10:59.436513 29153 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.438452 29263 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:10:59.441613 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44117.7us
I20260709 12:10:59.459437 25513 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 6 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 8 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.465853 25513 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 6 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.471514 25513 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:59.476686 25513 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 4 to 6, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 6 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:59.479084 25513 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 7 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.491176 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:59.492218 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45420 (request call id 20) took 1172 ms. Trace:
I20260709 12:10:59.492336 25513 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 8 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.493125 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:59.492717 25687 rpcz_store.cc:276] 0709 12:10:58.300449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.300606 (+   157us) service_pool.cc:224] Handling call
0709 12:10:59.472344 (+1171738us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b4c003e2e00. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1027a20 00007fbdb1038a29 00007fbdb0ffe644 00007fbdb1025f2d 00007fbdb1025b93 00007fbdb2d55c92 00007fbdb2d5584a 00007fbdb7d2360a 00007fbdb12a97d4 00007fbdb12a9762 00007fbdb12a9691
0709 12:10:59.472464 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122359168}
I20260709 12:10:59.498294 25612 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:59.460038 29092 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.498230 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:10:59.497906 25513 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 7, term changed from 9 to 10, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131), NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 10 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:59.499325 29241 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.464260 29152 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.450510 29272 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:59.513705 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.500795 26334 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 LEARNER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:59.500094 29289 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.474834 29098 raft_consensus.cc:3055] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:59.522125 25513 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 7 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:59.513509 29175 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.475423 29263 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:59.534991 25658 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:10:59.536449 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.498944 29370 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:10:59.540640 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:59.496877 29281 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.526396 29241 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.503474 29206 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:59.563633 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.539219 25513 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.536816 29289 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:10:59.572742 25513 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 5 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:59.522857 29092 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:59.536916 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:10:59.574664 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:59.579183 25764 raft_consensus.cc:2368] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10.
I20260709 12:10:59.580232 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:59.580991 25764 raft_consensus.cc:2368] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:59.581786 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.569752 29241 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.572173 28817 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:59.540362 29295 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.583587 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.571794 29289 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.598363 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:59.537998 29098 raft_consensus.cc:740] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:59.588406 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debca0eda6c649e38d13858860f6a245"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:59.597780 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.604288 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.604876 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.607016 25764 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:59.563405 29360 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:10:59.608161 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.615137 25615 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:59.617900 25611 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:10:59.607470 25764 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.592939 25513 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 6 to 7, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:10:59.620844 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.584127 29279 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.623027 25613 raft_consensus.cc:1217] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Deduplicated request from leader. Original: 9.7->[10.8-12.9]   Dedup: 10.8->[12.9-12.9]
I20260709 12:10:59.623649 25613 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
W20260709 12:10:59.623106 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.626991 26338 raft_consensus.cc:2393] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 6: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:10:59.591171 28817 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:10:59.626504 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.604691 29243 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.636754 25610 raft_consensus.cc:2368] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:10:59.632083 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.637440 25761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:10:59.638033 25761 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:59.638480 25761 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:59.639179 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.639662 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.639992 25615 raft_consensus.cc:2393] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:10:59.612134 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.640417 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.640852 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.641497 25615 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:10:59.639950 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.644340 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.644965 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.645625 25611 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:10:59.645973 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 105430us
I20260709 12:10:59.641764 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.646458 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.647363 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:10:59.647539 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.647624 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:59.642342 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:10:59.650215 25614 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:59.650671 29378 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.651582 29378 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.604470 29295 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:59.657068 29372 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:10:59.661092 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:10:59.670027 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.612360 29151 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:59.671478 25582 leader_election.cc:400] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10.
I20260709 12:10:59.673643 25582 leader_election.cc:400] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:59.673990 25582 leader_election.cc:403] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.636318 29279 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:10:59.682528 29279 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.684017 29380 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.684979 29380 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.652657 29153 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.654812 29378 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:59.687480 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 78619us
W20260709 12:10:59.692093 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.694888 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:59.700512 25764 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.709242 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:59.686964 29206 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11.
I20260709 12:10:59.591579 29272 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.715029 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:10:59.715478 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 145028us
I20260709 12:10:59.690408 29172 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.722549 29172 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:59.725047 29371 log.cc:927] Time spent T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:10:59.725370 29172 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.726763 29083 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:10:59.727331 29083 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.718504 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:10:59.730783 25618 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:10:59.719651 29329 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.727021 29282 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.713008 25761 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.735442 25764 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.711575 29333 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:59.737680 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.734788 29090 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.747701 25761 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:10:59.764324 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.765548 25764 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:59.716405 29304 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:10:59.716063 29107 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.711387 29327 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:10:59.768488 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.771445 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.773722 25761 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:10:59.774464 25764 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:10:59.702454 28817 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.739966 29150 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.735090 29175 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.775025 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:59.778270 25761 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.667476 29098 consensus_queue.cc:260] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:59.780833 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.782053 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:10:59.774897 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60335.4us
I20260709 12:10:59.737959 29329 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.741935 29333 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.762633 29281 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.793852 25732 leader_election.cc:400] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:10:59.795643 25732 leader_election.cc:403] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.749019 29263 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:10:59.791958 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.778282 29327 consensus_queue.cc:1243] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:10:59.749454 29209 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.764330 29317 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:10:59.734860 29282 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.799304 25761 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:10:59.768666 29304 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.801445 25764 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:10:59.772857 29153 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:10:59.787358 29251 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.722s	user 0.015s	sys 0.000s
I20260709 12:10:59.747493 29090 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:10:59.805557 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71653.4us
I20260709 12:10:59.779488 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:10:59.836187 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.829101 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.848343 25692 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:10:59.829370 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.849802 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.795013 29333 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.834669 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.794782 29098 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.838411 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.791036 29329 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.819681 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.839644 25582 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:10:59.839699 25762 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:10:59.840481 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.869366 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.870488 25688 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:10:59.871753 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:59.873281 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.843567 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.844390 25767 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:10:59.874554 25767 pending_rounds.cc:85] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 8
I20260709 12:10:59.874837 25767 pending_rounds.cc:107] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:10:59.875113 25767 raft_consensus.cc:2889] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.850656 25692 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:59.880216 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.853289 25685 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:59.818948 28817 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.777487 29107 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.900179 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.896374 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:59.901486 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:59.859550 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.841112 29304 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:10:59.905030 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.794838 29328 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:59.869431 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.834476 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.819788 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.790699 29150 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.891716 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.893906 29209 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:59.924811 29150 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.868770 29298 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.847679 29289 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.791010 29175 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:10:59.897522 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.897774 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.898195 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.897679 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.844753 29153 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.799418 29172 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.902453 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:10:59.881810 29219 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.910902 25686 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:10:59.921419 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:59.928114 29107 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.928630 25764 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:10:59.957680 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:10:59.958801 25764 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.919360 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.931219 25688 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:10:59.932999 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:10:59.935976 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.962906 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.936108 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.946962 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:10:59.953131 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 50847.7us
I20260709 12:10:59.936391 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.963874 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.960392 25692 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:10:59.954047 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.887547 29380 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:10:59.993080 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 196050us
I20260709 12:10:59.994063 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.993209 25686 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:11:00.730379 29125 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.898838 29317 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.733530 29233 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:00.496275 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.734148 29233 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:00.507651 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:00.200052 29378 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.736263 25690 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.736096 29233 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.737912 29233 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.990922 29271 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:00.739522 29271 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:00.740312 29271 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:00.505738 25689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.010s	sys 0.004s
W20260709 12:11:00.744837 25689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.022s	sys 0.012s
W20260709 12:10:59.989821 29384 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:11:00.744899 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:00.493371 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.928683 29298 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.995997 25764 raft_consensus.cc:2410] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:59.943863 29282 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:00.487635 25513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.012s	sys 0.043s
W20260709 12:11:00.640811 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.491991 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.751036 25686 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:11:00.521723 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.545091 26305 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.002s	sys 0.010s
W20260709 12:11:00.158452 29358 consensus_meta.cc:287] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.819s	user 0.015s	sys 0.000s
I20260709 12:11:00.507614 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.988415 29333 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.804782 29330 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.204530 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1947) took 1336 ms. Trace:
I20260709 12:11:00.805667 29330 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.806569 25767 rpcz_store.cc:276] 0709 12:10:58.867906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.353392 (+485486us) service_pool.cc:224] Handling call
0709 12:10:59.353944 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.875767 (+521823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.204143 (+328376us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400249ad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:00.204433 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126996736}
I20260709 12:10:59.940371 29153 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.809094 29330 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:00.213730 25768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 1932) took 1911 ms (client timeout 2164 ms). Trace:
I20260709 12:11:00.635073 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1975) took 1228 ms. Trace:
I20260709 12:11:00.620622 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1926) took 2367 ms. Trace:
W20260709 12:11:00.615630 25760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 1944) took 1928 ms (client timeout 2010 ms). Trace:
W20260709 12:11:00.605753 25612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 2409) took 1531 ms (client timeout 1844 ms). Trace:
W20260709 12:11:00.794575 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.622200 26337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60616 (request call id 147) took 1117 ms. Trace:
I20260709 12:11:00.814877 26337 rpcz_store.cc:276] 0709 12:10:59.504410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.504644 (+   234us) service_pool.cc:224] Handling call
0709 12:10:59.533552 (+ 28908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.534061 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.534100 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.536127 (+  2027us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.573002 (+ 36875us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:59.573043 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.573123 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.590190 (+ 17067us) raft_consensus.cc:1685] finished
0709 12:10:59.590211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.621425 (+1031214us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5400863dd0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.621874 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5151,"raft.queue_time_us":1833,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4747,"spinlock_wait_cycles":65311616,"thread_start_us":36535,"threads_started":1,"wal-append.queue_time_us":52085,"wal-append.run_cpu_time_us":2237,"wal-append.run_wall_time_us":1151847}
I20260709 12:10:59.930626 29289 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:10:59.992169 29107 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.820043 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.820827 29107 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:10:59.927493 29209 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:00.620065 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:00.618425 25687 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:11:00.823427 25513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.020s	sys 0.052s
W20260709 12:11:00.786948 26305 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.006s	sys 0.019s
W20260709 12:11:00.331427 29346 consensus_meta.cc:287] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.068s	user 0.009s	sys 0.006s
I20260709 12:11:00.632191 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2401) took 1754 ms. Trace:
I20260709 12:11:00.809258 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:00.813856 25612 rpcz_store.cc:269] 0709 12:10:59.074512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.074907 (+   395us) service_pool.cc:224] Handling call
0709 12:11:00.604718 (+1529811us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54003a6e54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.605336 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937886080}
W20260709 12:11:00.633770 25762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 1941) took 2059 ms (client timeout 1578 ms). Trace:
I20260709 12:11:00.502039 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:00.639464 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1980) took 1231 ms. Trace:
I20260709 12:11:00.811704 25759 rpcz_store.cc:276] 0709 12:10:59.405940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.454288 (+ 48348us) service_pool.cc:224] Handling call
0709 12:11:00.519661 (+1065373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.520800 (+  1139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.520986 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.521137 (+   151us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:00.521249 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.521418 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.634510 (+113092us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000596d0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.634795 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448588160}
I20260709 12:11:00.797576 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:00.228104 29220 consensus_meta.cc:287] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.003s
I20260709 12:11:00.810995 25766 rpcz_store.cc:276] 0709 12:10:58.253282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.471411 (+218129us) service_pool.cc:224] Handling call
0709 12:10:59.182493 (+711082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.442859 (+260366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.619224 (+1176365us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540024aed4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:00.620008 (+   784us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540024aed0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.620348 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176636672}
I20260709 12:11:00.825824 25617 rpcz_store.cc:276] 0709 12:10:58.878012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.339710 (+461698us) service_pool.cc:224] Handling call
0709 12:10:59.340088 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.410968 (+ 70880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.411002 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.411063 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:59.411160 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.631240 (+1220080us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b5400277c54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:00.631475 (+   235us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.631870 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162516736}
W20260709 12:11:00.811124 25760 rpcz_store.cc:269] 0709 12:10:58.687045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.763180 (+ 76135us) service_pool.cc:224] Handling call
0709 12:11:00.614957 (+1851777us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400316fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.615319 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525483264}
W20260709 12:10:59.942668 28792 consensus_meta.cc:287] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:11:00.835582 25694 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:00.108227 28901 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.000s
I20260709 12:11:00.829221 25765 rpcz_store.cc:276] 0709 12:10:59.407500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.457815 (+ 50315us) service_pool.cc:224] Handling call
0709 12:11:00.616018 (+1158203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.616708 (+   690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.616754 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.616833 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:00.616889 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.616990 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.638998 (+ 22008us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400316fd0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.639241 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662537472}
W20260709 12:11:00.838900 25768 rpcz_store.cc:269] 0709 12:10:58.302474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.417450 (+114976us) service_pool.cc:224] Handling call
0709 12:11:00.213473 (+1796023us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54000596d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.213638 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105805184}
I20260709 12:11:00.832824 25692 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:11:00.109792 29090 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.066884 29251 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:00.842757 25691 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:10:59.953902 29388 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:59.932924 29175 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
W20260709 12:11:00.828748 25762 rpcz_store.cc:269] 0709 12:10:58.574207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.580639 (+  6432us) service_pool.cc:224] Handling call
0709 12:11:00.633196 (+2052557us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400318dd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.633489 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2587574528}
I20260709 12:11:00.195731 29111 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:00.798444 29329 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.005s
I20260709 12:11:00.218952 29083 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.853574 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:00.500402 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 535061us
I20260709 12:11:00.858986 29220 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:00.862644 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.388279 29172 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:11:00.864737 29243 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.863307 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:10:59.961944 26334 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:00.795372 29358 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:00.874217 25685 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 6.
I20260709 12:11:00.868549 25688 raft_consensus.cc:2468] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 5.
I20260709 12:11:00.879739 25767 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.886333 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:00.881629 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1996) took 1021 ms. Trace:
I20260709 12:11:00.886853 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:10:59.926200 29241 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.867775 29290 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:00.903414 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52792.9us
I20260709 12:11:00.904151 29392 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:00.904570 29251 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.905186 29392 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:00.907891 29251 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:00.870105 29276 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:00.912556 25759 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:00.832840 29209 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:00.908064 29398 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:11:00.901335 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1629) took 1058 ms. Trace:
I20260709 12:10:59.964123 29219 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.916054 29289 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.917459 25685 rpcz_store.cc:276] 0709 12:10:59.842755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.963786 (+121031us) service_pool.cc:224] Handling call
0709 12:11:00.892639 (+928853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.901652 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:00.924485 29107 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.926556 25766 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:00.926663 25691 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:00.889672 25764 rpcz_store.cc:276] 0709 12:10:59.851603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.957393 (+105790us) service_pool.cc:224] Handling call
0709 12:11:00.869389 (+911996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.933284 29207 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:00.934454 29153 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:00.935120 29153 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.937600 29153 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.938390 29329 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.939862 29358 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:00.940982 29329 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:00.904146 28901 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.947572 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:00.938390 29243 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.850786 29346 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.908105 29392 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:00.958559 29276 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.959811 28817 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:00.960753 28817 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.961858 29289 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.962808 29330 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:00.963675 29207 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.964401 29289 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.966136 29388 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:00.967361 28817 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.967707 29388 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.968432 29207 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.968987 25690 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:00.969574 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1643) took 1113 ms. Trace:
I20260709 12:11:00.969937 25690 rpcz_store.cc:276] 0709 12:10:59.858435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.506755 (+648320us) service_pool.cc:224] Handling call
0709 12:11:00.969500 (+462745us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24320}
I20260709 12:11:00.970464 28792 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.978986 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1694) took 1028 ms. Trace:
I20260709 12:11:00.961258 29276 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.980024 25690 rpcz_store.cc:276] 0709 12:10:59.955501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.970910 (+1015409us) service_pool.cc:224] Handling call
0709 12:11:00.971458 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.975416 (+  3958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.975463 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.976956 (+  1493us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.977200 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.977296 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.977462 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.950896 29111 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:11:00.984440 25583 connection.cc:256] RPC call timeout handler was delayed by -1.0412964710001233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 12:11:00.984993 25619 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:00.985845 25688 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:00.986044 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 464) took 1025 ms. Trace:
I20260709 12:11:00.986615 25690 rpcz_store.cc:276] 0709 12:10:59.960868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.984732 (+1023864us) service_pool.cc:224] Handling call
0709 12:11:00.985261 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.985636 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.985671 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.985735 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.985769 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.985839 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.985980 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.169792 29304 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:00.975231 29083 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.997431 25686 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.987267 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1556) took 1348 ms. Trace:
I20260709 12:11:00.994630 29153 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.000209 25687 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:01.001096 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51490 (request call id 463) took 1040 ms. Trace:
I20260709 12:11:00.996352 28817 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.001543 25687 rpcz_store.cc:276] 0709 12:10:59.960571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.976685 (+1016114us) service_pool.cc:224] Handling call
0709 12:11:00.999951 (+ 23266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.000726 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.000994 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.002233 28817 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.003115 28901 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.004213 28792 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.000573 29153 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.005178 29364 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:01.006022 29364 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:01.007342 29153 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.008075 29153 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.009284 29364 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:01.005192 28817 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.008783 29153 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.013000 29153 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.014045 29392 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:01.014382 29333 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.014889 29392 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:01.015271 29317 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.017957 29211 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.018755 29211 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:01.022063 25763 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:01.022584 25763 pending_rounds.cc:85] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 8
I20260709 12:11:01.022862 25763 pending_rounds.cc:107] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.9
I20260709 12:11:01.023269 25763 raft_consensus.cc:2917] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Aborting config change with OpId 10.9: Aborted: Op aborted by new leader
I20260709 12:11:00.988726 29207 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.023851 25763 raft_consensus.cc:2889] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.023968 29207 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.027797 29243 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.027805 29392 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:01.029049 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:01.030586 25765 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:11:00.963726 29330 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.031971 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.032835 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:01.032953 25691 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:11:00.991362 29290 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.038852 29207 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.998600 25619 rpcz_store.cc:276] 0709 12:10:59.639209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.639339 (+   130us) service_pool.cc:224] Handling call
0709 12:11:00.986907 (+1347568us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400418f54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:00.987190 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3030540544}
I20260709 12:11:01.054376 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1692) took 1105 ms. Trace:
I20260709 12:11:01.040376 29304 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.042323 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1957) took 1520 ms. Trace:
I20260709 12:11:01.046805 25694 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:01.049938 25692 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:11:01.053815 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 1991) took 1253 ms. Trace:
I20260709 12:11:01.055687 25765 rpcz_store.cc:276] 0709 12:10:59.796628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.858176 (+1061548us) service_pool.cc:224] Handling call
0709 12:11:01.049798 (+191622us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.995111 29378 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.060719 29220 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.062454 29330 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:00.994940 29276 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.066936 29276 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.068805 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:01.069711 29276 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.071343 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:01.074069 25766 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:01.075418 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:01.075456 29271 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.076205 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:01.077756 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.078282 29207 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.079139 25616 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:01.079248 29207 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.072187 29346 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.074070 29280 consensus_queue.cc:1059] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:11:01.081780 29207 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.082700 29395 raft_consensus.cc:3055] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:01.083190 29395 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:01.057652 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:01.084340 25765 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.085137 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1958) took 1441 ms. Trace:
I20260709 12:11:01.068619 29290 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.054917 25760 rpcz_store.cc:276] 0709 12:10:59.521422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.927818 (+1406396us) service_pool.cc:224] Handling call
0709 12:11:01.041117 (+113299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.041783 (+   666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.041815 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.041868 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.041907 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.041988 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.042171 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.085589 25766 rpcz_store.cc:276] 0709 12:10:59.643373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.082925 (+1439552us) service_pool.cc:224] Handling call
0709 12:11:01.083941 (+  1016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.084427 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.084592 (+   165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.084657 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:01.084769 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.084850 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.085003 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.054744 25691 rpcz_store.cc:276] 0709 12:10:59.948567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.972560 (+1023993us) service_pool.cc:224] Handling call
0709 12:11:00.997581 (+ 25021us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.053989 (+ 56408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.054312 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.091431 25688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1649) took 1144 ms. Trace:
I20260709 12:11:01.082089 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:01.097065 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:01.089211 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:01.093003 26334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45784 (request call id 99) took 1345 ms (client timeout 1719 ms). Trace:
I20260709 12:11:01.086810 25612 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 9.
I20260709 12:11:01.105875 25688 rpcz_store.cc:276] 0709 12:10:59.947208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.892753 (+945545us) service_pool.cc:224] Handling call
0709 12:11:00.923549 (+ 30796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.986361 (+ 62812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.091157 (+104796us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54003e3fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:01.091366 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124408064}
W20260709 12:11:01.086184 29393 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:11:01.021898 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:01.112884 26334 rpcz_store.cc:269] 0709 12:10:59.747541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.761420 (+ 13879us) service_pool.cc:224] Handling call
0709 12:11:01.092635 (+1331215us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540054f454. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:01.092806 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232901888}
I20260709 12:11:01.135550 25765 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:01.010069 29364 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:11:01.140681 25690 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:01.089233 29298 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.078182 29271 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.091990 29241 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.230180 25761 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
W20260709 12:11:01.214970 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.229765 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.172616 25688 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:01.144398 25618 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:01.174206 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 185378us
I20260709 12:11:01.148648 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.173151 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1959) took 1497 ms. Trace:
I20260709 12:11:01.262467 25760 rpcz_store.cc:276] 0709 12:10:59.654278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.150527 (+1496249us) service_pool.cc:224] Handling call
0709 12:11:01.151104 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.151500 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.151545 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.151619 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.151670 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.151723 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.151836 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.234290 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.189293 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1688) took 1241 ms. Trace:
W20260709 12:11:01.265347 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 185029us
W20260709 12:11:01.267434 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1019932670001253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 12:11:01.268174 29298 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.269436 29298 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:01.269651 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0092932670002028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 12:11:01.189512 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1691) took 1241 ms. Trace:
I20260709 12:11:01.270951 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.153153 25759 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:01.264035 25686 rpcz_store.cc:276] 0709 12:10:59.947511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.910936 (+963425us) service_pool.cc:224] Handling call
0709 12:11:00.970475 (+ 59539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.049257 (+ 78782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.188926 (+139669us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b5400328a54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:01.189175 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44848384}
I20260709 12:11:01.093359 29111 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.272941 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:01.275449 25767 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:01.185174 25764 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:01.147703 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:01.292471 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.144538 29394 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:11:01.277361 25767 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:01.291131 29207 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.294880 29290 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.295284 29207 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.295717 29290 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.302445 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.295051 25614 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:01.322844 29304 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.323817 29304 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.329746 25765 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:01.271097 25685 rpcz_store.cc:276] 0709 12:10:59.948310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.945591 (+997281us) service_pool.cc:224] Handling call
0709 12:11:00.946041 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.987800 (+ 41759us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:01.007682 (+ 19882us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.187641 (+179959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.187702 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.187743 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.187825 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.189453 (+  1628us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26643,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":150,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":179268,"threads_started":1,"wal-append.queue_time_us":258555}
I20260709 12:11:01.229993 29209 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.330394 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1960) took 1642 ms. Trace:
I20260709 12:11:01.352726 25767 rpcz_store.cc:276] 0709 12:10:59.663475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.276653 (+1613178us) service_pool.cc:224] Handling call
0709 12:11:01.277123 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.293930 (+ 16807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.305773 (+ 11843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.084523 29395 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:01.358434 29346 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:01.359027 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:01.359519 25610 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:01.359874 25616 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:01.358085 29209 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.360883 29290 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.362080 29241 raft_consensus.cc:1064] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
W20260709 12:11:01.362614 29241 raft_consensus.cc:1068] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Unable to promote non-voter 8481c5f6be5b4faa9fe7c83301759f65: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:01.358019 29404 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:01.233680 29375 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.364007 29404 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:01.364027 29375 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.366941 29404 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:01.366968 29375 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.362996 29209 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:01.367682 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 84156.3us
I20260709 12:11:01.368089 29395 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.369899 25618 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:01.320629 29211 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:01.370407 25618 pending_rounds.cc:85] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 5
W20260709 12:11:01.370894 25761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 2000) took 1477 ms (client timeout 1878 ms). Trace:
I20260709 12:11:01.371237 25618 pending_rounds.cc:107] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:01.371783 25618 raft_consensus.cc:2889] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:01.372567 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.371345 25761 rpcz_store.cc:269] 0709 12:10:59.893482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.920890 (+ 27408us) service_pool.cc:224] Handling call
0709 12:11:01.368945 (+1448055us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400150754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:01.370824 (+  1879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224626944}
I20260709 12:11:01.375211 25690 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:01.388204 29290 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:01.388418 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 366774us
I20260709 12:11:01.388499 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.389103 29290 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.389544 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1626) took 1537 ms. Trace:
I20260709 12:11:01.389415 29207 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.390062 25694 rpcz_store.cc:276] 0709 12:10:59.841354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.932721 (+ 91367us) service_pool.cc:224] Handling call
0709 12:11:01.370634 (+1437913us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54001950d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:01.378422 (+  7788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979552000}
I20260709 12:11:01.390673 29207 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:01.338060 29271 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:01.391711 25615 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:01.392014 29271 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.392566 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1615) took 1566 ms. Trace:
I20260709 12:11:01.392591 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:01.393476 25760 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
W20260709 12:11:01.394843 29403 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 12:11:01.393152 25689 rpcz_store.cc:276] 0709 12:10:59.825771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.826291 (+   520us) service_pool.cc:224] Handling call
0709 12:10:59.826802 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:59.827368 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.827394 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.844157 (+ 16763us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.745773 (+901616us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:00.794590 (+ 48817us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.890540 (+ 95950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.890673 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.392276 (+501603us) raft_consensus.cc:1685] finished
0709 12:11:01.392308 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.392486 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158038,"prepare.queue_time_us":38277,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":106442,"raft.run_cpu_time_us":460,"raft.run_wall_time_us":6505,"thread_start_us":838468,"threads_started":1,"wal-append.queue_time_us":1124234}
I20260709 12:11:01.391762 29290 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.396924 29111 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:01.404543 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:01.389469 25612 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:01.406229 29220 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.409189 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.409494 29295 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.410980 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1963) took 1702 ms. Trace:
I20260709 12:11:01.426249 25762 rpcz_store.cc:276] 0709 12:10:59.708394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.376500 (+1668106us) service_pool.cc:224] Handling call
0709 12:11:01.410079 (+ 33579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.410576 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.410603 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.410672 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.410709 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.410765 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.410881 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.411909 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1632) took 1566 ms. Trace:
I20260709 12:11:01.420588 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41126 (request call id 271) took 1727 ms. Trace:
I20260709 12:11:01.421257 29290 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.429366 25766 rpcz_store.cc:276] 0709 12:10:59.692919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.290719 (+1597800us) service_pool.cc:224] Handling call
0709 12:11:01.419199 (+128480us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:11:01.419630 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.420021 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.420054 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.420133 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.420176 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.420263 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.420444 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4623232}
I20260709 12:11:01.427573 25693 rpcz_store.cc:276] 0709 12:10:59.845386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.935246 (+ 89860us) service_pool.cc:224] Handling call
0709 12:11:01.411224 (+1475978us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003c46d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:01.411603 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199166336}
I20260709 12:11:01.433990 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:01.440783 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:01.447948 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:01.442646 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.442850 29211 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.462734 29220 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.425148 29271 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:01.468109 25764 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:01.648195 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 95880.6us
I20260709 12:11:01.648860 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1962) took 1941 ms. Trace:
I20260709 12:11:01.649253 25764 rpcz_store.cc:276] 0709 12:10:59.707137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.321260 (+1614123us) service_pool.cc:224] Handling call
0709 12:11:01.422473 (+101213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.648484 (+226011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.648774 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19712}
W20260709 12:11:01.553366 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 112794us
I20260709 12:11:01.649222 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:01.641604 25759 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:01.631842 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1956) took 2110 ms. Trace:
W20260709 12:11:01.491909 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.623760 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 200864us
I20260709 12:11:01.471145 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:01.646517 29415 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 12:11:01.535594 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:01.693491 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.665331 25768 rpcz_store.cc:276] 0709 12:10:59.521177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.870714 (+1349537us) service_pool.cc:224] Handling call
0709 12:11:00.903665 (+ 32951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.950909 (+ 47244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.950945 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.964411 (+ 13466us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.128320 (+163909us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.128353 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.631206 (+502853us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b54001b8d54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:01.631276 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.631344 (+    68us) raft_consensus.cc:1685] finished
0709 12:11:01.631360 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.631721 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11804544,"thread_start_us":163453,"threads_started":1,"wal-append.queue_time_us":163942}
I20260709 12:11:01.583056 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1945) took 2838 ms. Trace:
I20260709 12:11:01.675125 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1982) took 2019 ms. Trace:
I20260709 12:11:01.581916 29298 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.464299 29290 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.718942 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:01.553632 29392 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.715919 25763 rpcz_store.cc:276] 0709 12:10:58.744351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.261744 (+517393us) service_pool.cc:224] Handling call
0709 12:10:59.261991 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.025008 (+1763017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.582645 (+557637us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b5400165654. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:01.582967 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4045902080}
I20260709 12:11:01.722667 25762 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:01.726181 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:01.471910 29209 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.582180 29219 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.671705 29304 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.717154 25759 rpcz_store.cc:276] 0709 12:10:59.655859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.293788 (+1637929us) service_pool.cc:224] Handling call
0709 12:11:01.641024 (+347236us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b5800151298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:11:01.641296 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.674790 (+ 33494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.675058 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14621568}
I20260709 12:11:01.727253 25766 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 8.
I20260709 12:11:01.534327 29211 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.747097 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1966) took 2023 ms. Trace:
I20260709 12:11:01.750901 25765 rpcz_store.cc:276] 0709 12:10:59.723403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.647242 (+1923839us) service_pool.cc:224] Handling call
0709 12:11:01.715084 (+ 67842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.741859 (+ 26775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.741887 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.746729 (+  4842us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.746777 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.746854 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.747012 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.726732 29281 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:01.749845 25616 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:11:01.755296 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 283410us
I20260709 12:11:01.740429 29271 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.760607 26334 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 LEARNER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:01.768468 25768 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:01.769490 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1995) took 1918 ms. Trace:
I20260709 12:11:01.769886 25768 rpcz_store.cc:276] 0709 12:10:59.851359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.742051 (+1890692us) service_pool.cc:224] Handling call
0709 12:11:01.752664 (+ 10613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.769157 (+ 16493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.769414 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.773190 25767 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:01.775650 25617 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.765455 25761 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:11:01.779994 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:01.780485 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1989) took 2014 ms. Trace:
I20260709 12:11:01.780915 25761 rpcz_store.cc:276] 0709 12:10:59.765754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.649778 (+1884024us) service_pool.cc:224] Handling call
0709 12:11:01.735405 (+ 85627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.780210 (+ 44805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.780428 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:01.783445 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.786877 25764 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:01.756217 29281 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:01.789754 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.795248 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.795534 29175 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.796170 29175 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:01.785162 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.806972 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1964) took 2087 ms. Trace:
I20260709 12:11:01.807540 25767 rpcz_store.cc:276] 0709 12:10:59.719901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.646128 (+1926227us) service_pool.cc:224] Handling call
0709 12:11:01.646714 (+   586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.773934 (+127220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.806679 (+ 32745us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b5400165154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:01.806899 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290144000}
I20260709 12:11:01.811026 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1997) took 1959 ms. Trace:
I20260709 12:11:01.811528 25766 rpcz_store.cc:276] 0709 12:10:59.851874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.752787 (+1900913us) service_pool.cc:224] Handling call
0709 12:11:01.798752 (+ 45965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.810650 (+ 11898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.810677 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.810723 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:01.810757 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.810821 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.810956 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.799467 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:01.782363 29219 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.818521 25764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1994) took 1967 ms. Trace:
W20260709 12:11:01.826624 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 177559us
I20260709 12:11:01.829262 25764 rpcz_store.cc:276] 0709 12:10:59.851058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.720401 (+1869343us) service_pool.cc:224] Handling call
0709 12:11:01.755105 (+ 34704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.800403 (+ 45298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.818443 (+ 18040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.799044 29281 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.840550 25619 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 7: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:11:01.841444 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.772015 29271 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:01.820159 29404 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:01.845310 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:01.846706 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 136708us
I20260709 12:11:01.849793 25731 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:01.852188 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:01.863554 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:01.864503 25611 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:01.861989 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1998) took 2009 ms. Trace:
I20260709 12:11:01.866539 25763 rpcz_store.cc:276] 0709 12:10:59.852118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.747366 (+1895248us) service_pool.cc:224] Handling call
0709 12:11:01.786719 (+ 39353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.861619 (+ 74900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.861651 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:01.861700 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:01.861735 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.861797 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.861927 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:01.868863 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.870573 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:01.872330 25768 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:01.859818 29209 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:01.873766 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:01.877406 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:01.883495 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58777us
I20260709 12:11:01.866106 29404 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:01.878665 29417 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 12:11:01.889822 29207 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.890801 29375 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:01.906175 25768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2003) took 1951 ms. Trace:
I20260709 12:11:01.895608 29153 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.904130 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:01.876116 29209 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.907095 25768 rpcz_store.cc:276] 0709 12:10:59.954625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.781119 (+1826494us) service_pool.cc:224] Handling call
0709 12:11:01.842678 (+ 61559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.877911 (+ 35233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.906088 (+ 28177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.874897 29219 raft_consensus.cc:2764] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:01.904747 29304 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.905004 29295 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.906245 29207 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:01.912323 29209 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.942444 25763 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:01.933943 29298 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.921217 29358 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:01.944864 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 224653us
I20260709 12:11:01.932816 29295 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.931264 29304 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:01.936337 29207 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.983525 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 129535us
I20260709 12:11:01.941763 29290 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:01.991119 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 87143.6us
I20260709 12:11:01.948369 29358 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.993032 25764 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.973376 29304 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.967100 29175 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.948944 29211 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:01.999362 25657 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:01.971611 29295 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.936762 29153 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:02.003188 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 93089.2us
I20260709 12:11:02.003679 25768 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:01.998796 29358 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.001945 29375 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:02.014813 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:02.018585 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 126591us
I20260709 12:11:02.019740 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:02.022590 29390 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.024468 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.025934 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.026793 29290 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.027202 29290 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:02.027575 29290 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.027805 29298 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.034220 25615 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:02.013868 29375 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:02.028903 29271 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.027590 29220 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:02.046211 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52424.2us
I20260709 12:11:02.009473 29404 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.012696 25768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54016
I20260709 12:11:02.051265 25768 raft_consensus.cc:606] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 12:11:02.051618 25768 raft_consensus.cc:614] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:02.060082 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.068252 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.072281 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:02.078895 29416 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:02.081025 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 1992) took 2262 ms. Trace:
I20260709 12:11:02.081364 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1971) took 1138 ms. Trace:
I20260709 12:11:02.066639 29390 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:02.064543 29422 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.065267 29271 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.110824 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 1974) took 1166 ms. Trace:
I20260709 12:11:02.111434 25763 rpcz_store.cc:276] 0709 12:11:00.944318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.886464 (+942146us) service_pool.cc:224] Handling call
0709 12:11:01.908490 (+ 22026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.946357 (+ 37867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.092450 (+146093us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540024b3d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:02.110714 (+ 18264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77235072}
I20260709 12:11:02.066309 29426 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:02.121905 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 63137.8us
I20260709 12:11:02.081975 25766 rpcz_store.cc:276] 0709 12:11:00.943248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.822131 (+878883us) service_pool.cc:224] Handling call
0709 12:11:01.822699 (+   568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.865423 (+ 42724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.865469 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.889305 (+ 23836us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.049662 (+160357us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:02.049720 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.049807 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.081142 (+ 31335us) raft_consensus.cc:1685] finished
0709 12:11:02.081163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.081307 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9175,"raft.queue_time_us":13849,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5855,"thread_start_us":110561,"threads_started":1,"wal-append.queue_time_us":151208}
I20260709 12:11:02.125372 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2002) took 2214 ms. Trace:
I20260709 12:11:02.091113 29392 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:02.078954 29153 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.129220 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:02.081647 29220 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.135548 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.081421 25760 rpcz_store.cc:276] 0709 12:10:59.818983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.394744 (+1575761us) service_pool.cc:224] Handling call
0709 12:11:01.395411 (+   667us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.399537 (+  4126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.399577 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.400283 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.437891 (+ 37608us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.727469 (+289578us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.727739 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.727822 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.080738 (+352916us) raft_consensus.cc:1685] finished
0709 12:11:02.080769 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.080949 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3114,"prepare.queue_time_us":485998,"prepare.run_wall_time_us":49,"raft.queue_time_us":5219,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":5861,"spinlock_wait_cycles":14967168,"thread_start_us":209283,"threads_started":2,"wal-append.queue_time_us":559463}
W20260709 12:11:02.143939 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 88667.3us
I20260709 12:11:02.108498 29271 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.138175 25691 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
W20260709 12:11:02.148516 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 76335.7us
I20260709 12:11:02.149554 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.155179 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:02.083540 29390 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:11:02.159330 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:02.147663 29271 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.165402 29435 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.162289 29395 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.084576 29422 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.168118 29395 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:02.170562 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44724.1us
I20260709 12:11:02.173779 29422 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.174142 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2004) took 2178 ms. Trace:
I20260709 12:11:02.167536 29435 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:02.175976 29435 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.177438 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.178557 29298 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.179059 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.179418 29298 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:02.180171 29298 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.180593 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.166525 29241 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:02.169422 29395 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.183171 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:02.184863 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.186612 29219 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:02.186868 29429 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:02.174544 25761 rpcz_store.cc:276] 0709 12:10:59.995828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.781696 (+1785868us) service_pool.cc:224] Handling call
0709 12:11:01.835652 (+ 53956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.854056 (+ 18404us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:02.005871 (+151815us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.173578 (+167707us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b18002ea5c0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafbe8c0a 00007fbdb9328219 00007fbdafc70a40 00007fbdafc6b4e4 00007fbdafc6b455 00007fbdb2d53060 00007fbdb2d65716 00007fbdb2d76287 00007fbdb2d76208
0709 12:11:02.173756 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.173816 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:02.173873 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.173945 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.174075 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1832,"prepare.queue_time_us":184617,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":30,"spinlock_wait_cycles":7399168,"thread_start_us":235822,"threads_started":2,"wal-append.queue_time_us":111679}
I20260709 12:11:02.188170 29304 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:02.182135 29290 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.192915 29290 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:02.192915 29281 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.194695 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 51) took 5617 ms. Trace:
I20260709 12:11:02.202701 25516 rpcz_store.cc:276] 0709 12:10:56.577521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.590747 (+ 13226us) service_pool.cc:224] Handling call
0709 12:11:02.194435 (+5603688us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50246,"reported_tablets":2}
I20260709 12:11:02.188791 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.205472 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.126818 25765 rpcz_store.cc:276] 0709 12:10:59.910877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.755110 (+1844233us) service_pool.cc:224] Handling call
0709 12:11:01.794837 (+ 39727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.823870 (+ 29033us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:02.007637 (+183767us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.124881 (+117244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.124948 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.125015 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.125115 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.125290 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214424,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":274,"thread_start_us":242128,"threads_started":2,"wal-append.queue_time_us":104518}
I20260709 12:11:02.125998 29375 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:02.207278 25565 auto_rebalancer.cc:893] Removing replace marker failed: Replica 04e6206f9e924fb3931891bf3a64b392 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:11:02.207863 25565 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:11:02.199393 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
W20260709 12:11:02.208201 25565 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:11:02.212878 29392 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.198057 29304 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:02.213791 29111 consensus_meta.cc:287] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.005s
I20260709 12:11:02.215332 29281 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.138341 29426 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.223039 29426 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.223738 29426 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:02.224138 29426 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:02.224623 29426 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.230883 29211 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:02.233741 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2005) took 1572 ms. Trace:
I20260709 12:11:02.207880 29375 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:02.235565 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.234314 25767 rpcz_store.cc:276] 0709 12:11:00.661543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.809115 (+1147572us) service_pool.cc:224] Handling call
0709 12:11:01.809460 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.809771 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:02.007848 (+198077us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.230542 (+222694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.230619 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:02.230680 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.233417 (+  2737us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.233650 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74129,"prepare.queue_time_us":223830,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":71,"raft.queue_time_us":74279,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":314974,"threads_started":2}
I20260709 12:11:02.235881 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:02.238449 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.213783 29392 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:02.245507 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.242218 26334 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:11:02.242373 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73614.4us
I20260709 12:11:02.258033 25731 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:02.258535 29439 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:02.258563 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75558.5us
I20260709 12:11:02.262204 29207 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.255349 29392 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:02.265580 29392 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.266249 29241 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:02.266681 29290 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.269749 29364 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:02.269992 29295 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.271592 29434 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:02.272045 29434 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:02.272760 29295 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.273161 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.272936 29434 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.273422 29211 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:02.229660 29435 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.283252 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.286963 29434 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:02.279199 29290 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:02.289944 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:02.290179 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 150859us
I20260709 12:11:02.290891 25761 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:02.290747 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:02.292296 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.298028 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.297930 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:02.303090 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.306879 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:02.306879 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.244354 29395 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:02.308314 25760 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:02.285252 29241 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:02.321988 29390 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:02.328481 29439 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:02.331657 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:02.335070 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.297703 29358 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.335951 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.337193 29358 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.335119 29207 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.339830 29435 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.352172 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:02.352172 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.353533 25767 raft_consensus.cc:2410] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:02.291488 29209 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:02.354558 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 69705.6us
W20260709 12:11:02.355356 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 119611us
I20260709 12:11:02.331346 29241 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:02.289553 29290 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:02.357318 29435 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:02.363145 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.359611 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.366822 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.367353 25763 raft_consensus.cc:2393] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:02.369122 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:02.363866 29435 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.379127 29435 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:02.390496 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.405994 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:02.406783 25615 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:11:02.365870 29423 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.412395 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:02.416523 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.420202 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:02.423074 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:02.423693 25611 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.424850 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:02.425455 25613 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.426276 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:02.426900 25612 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 9.
I20260709 12:11:02.430721 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:02.421551 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:02.436327 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76791.6us
I20260709 12:11:02.434744 25617 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:11:02.439769 25760 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.439893 25613 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:02.437736 26304 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:02.442427 25763 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:11:02.448680 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 89099.9us
I20260709 12:11:02.451354 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:02.452071 25767 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.454756 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 88589.9us
I20260709 12:11:02.448753 29358 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:02.459940 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.460112 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.453796 29175 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.467542 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:02.468415 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.429983 29241 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.469467 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:02.470108 25613 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.479235 25613 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:11:02.479300 29435 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.482152 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.483191 25768 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:02.484225 25764 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.484525 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.485176 25766 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:02.485694 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:02.486732 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.488900 25759 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:02.489233 29395 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:02.434765 29423 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.482242 29435 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.494787 29281 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.495241 29281 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:02.496105 29281 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.513412 25767 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:02.497401 29281 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.531038 29443 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 12:11:02.466576 29438 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:02.498380 29175 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.548605 25763 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.554116 25760 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:02.492349 29423 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:02.557246 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 101769us
I20260709 12:11:02.558885 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2001) took 2655 ms. Trace:
W20260709 12:11:02.560353 29440 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:11:02.535915 29390 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.560719 29241 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.572516 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 97804.5us
I20260709 12:11:02.540558 29304 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:02.581919 25513 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 181) took 11970 ms (client timeout 15000 ms). Trace:
W20260709 12:11:02.582515 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.556329 29175 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.584113 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:02.584810 25691 raft_consensus.cc:3060] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.584872 26304 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:02.585729 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.567239 25762 rpcz_store.cc:276] 0709 12:10:59.903913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.747833 (+1843920us) service_pool.cc:224] Handling call
0709 12:11:01.807489 (+ 59656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.324984 (+517495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.325038 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.325814 (+   776us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.350401 (+ 24587us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.350458 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.494775 (+144317us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54003fdc54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:02.494823 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.530274 (+ 35451us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:11:02.558552 (+ 28278us) raft_consensus.cc:1685] finished
0709 12:11:02.558589 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.558808 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53938,"raft.queue_time_us":49571,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":680343552,"thread_start_us":159813,"threads_started":2,"wal-append.queue_time_us":26579}
I20260709 12:11:02.514660 29437 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 12:11:02.611032 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 158435us
I20260709 12:11:02.611207 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:02.616475 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.580790 29390 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:02.618746 29390 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.620780 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.599576 29364 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:02.621986 29364 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.625727 29364 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.630606 29451 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:02.631573 29451 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:02.632858 29451 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.643245 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.571398 29392 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:02.646355 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 179430us
W20260709 12:11:02.647244 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.643906 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:02.647192 25658 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:02.611012 29444 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:02.639727 29434 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:02.586736 29209 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:02.656806 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 75967.1us
I20260709 12:11:02.656468 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.660748 25761 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.604055 29395 raft_consensus.cc:2804] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:02.661490 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.661770 29423 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.659543 29375 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:02.653807 29434 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:02.661917 29452 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:02.666862 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.667160 25767 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.669338 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:02.638550 29271 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.653105 29444 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.676172 25763 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:02.664529 29423 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.658169 29304 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.664970 29439 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.664630 29209 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.664952 29434 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:02.665995 29452 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.665330 29447 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.678728 29436 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:02.695158 29452 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.677232 29395 raft_consensus.cc:697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:02.714562 29395 consensus_queue.cc:237] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:02.690474 25614 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:02.682957 29444 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:02.690146 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.683785 29423 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.712037 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:02.713446 29392 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:02.690408 29304 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.727000 29439 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:02.727296 29437 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.727931 29437 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:02.727676 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 7 to 9, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 9 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.728302 29439 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.728943 29437 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.690187 29209 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.731464 29209 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:02.731854 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.666512 29422 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:11:02.689826 29456 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.736112 29456 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.736508 29456 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.582789 25513 rpcz_store.cc:269] 0709 12:10:50.608793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.609090 (+   297us) service_pool.cc:224] Handling call
0709 12:10:50.793274 (+184184us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b5400002490. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc370b2 00007fbdb8bb0759 00007fbdb8b48a76 00007fbdb8b19d58 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc
0709 12:11:02.570057 (+11776783us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:59.944274 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:59.944946 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:59.944992 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:10:59.945012 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:59.960866 (+ 15854us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:59.992489 (+ 31623us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:59.997258 (+  4769us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:11:00.112480 (+115222us) tablet.cc:701] Row locks acquired
0709 12:11:00.112514 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:11:00.112780 (+   266us) write_op.cc:270] Start()
0709 12:11:00.112960 (+   180us) write_op.cc:276] Timestamp: P: 1783599060112705 usec, L: 0
0709 12:11:00.112991 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:11:00.187797 (+ 74806us) log.cc:844] Serialized 4904 byte log entry
0709 12:11:01.298935 (+1111138us) op_driver.cc:464] REPLICATION: finished
0709 12:11:01.479769 (+180834us) write_op.cc:301] APPLY: starting
0709 12:11:01.479965 (+   196us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:01.480548 (+   583us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:01.480766 (+   218us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:01.892287 (+411521us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:01.892820 (+   533us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:11:01.892893 (+    73us) write_op.cc:312] APPLY: finished
0709 12:11:01.893547 (+   654us) log.cc:844] Serialized 88 byte log entry
0709 12:11:01.893805 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:01.894084 (+   279us) write_op.cc:454] Released schema lock
0709 12:11:01.894174 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:01.894750 (+   576us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:01.894781 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64757,"reported_tablets":43,"spinlock_wait_cycles":15671680,"child_traces":[["op",{"apply.queue_time_us":135643,"apply.run_cpu_time_us":8759,"apply.run_wall_time_us":423756,"num_ops":12,"prepare.queue_time_us":283512,"prepare.run_cpu_time_us":22231,"prepare.run_wall_time_us":491568,"raft.queue_time_us":177675,"raft.run_cpu_time_us":8607,"raft.run_wall_time_us":62472,"replication_time_us":1185570,"thread_start_us":1513262,"threads_started":4,"wal-append.queue_time_us":637034}]]}
I20260709 12:11:02.739082 25691 raft_consensus.cc:2468] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:11:02.736508 25515 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.757949 29435 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:02.758589 29435 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:02.759075 29435 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:02.762959 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75851.9us
W20260709 12:11:02.768666 25732 connection.cc:256] RPC call timeout handler was delayed by -1.429766114000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 12:11:02.769402 25732 connection.cc:256] RPC call timeout handler was delayed by -1.4045661140000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:11:02.769918 25732 connection.cc:256] RPC call timeout handler was delayed by -1.3000934440001402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 12:11:02.770411 25732 connection.cc:256] RPC call timeout handler was delayed by -1.2334934440000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
W20260709 12:11:02.771409 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1741661140001725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24409999999999998s for a response
W20260709 12:11:02.779780 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 125191us
W20260709 12:11:02.780882 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.787072 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.781009 25582 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:02.792076 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0418568120001055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2529s for a response
W20260709 12:11:02.796362 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84441.4us
W20260709 12:11:02.797798 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.726230 29304 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:02.801815 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.804452 29426 consensus_meta.cc:287] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.579s	user 0.016s	sys 0.003s
I20260709 12:11:02.804894 29426 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.807344 25515 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 4 to 7, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.780001 29404 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.809995 25515 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.820466 29444 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.822059 29271 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.821759 25515 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.824486 25515 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.794919 29437 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.800933 29422 consensus_queue.cc:1243] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:02.818203 29426 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:02.834508 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 53599.8us
I20260709 12:11:02.821864 29358 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:02.837090 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.839366 25616 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:02.818074 29364 raft_consensus.cc:1064] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:02.852558 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:02.788754 29175 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:02.880991 25515 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 7 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.849999 29422 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.845160 29404 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:02.881104 25732 leader_election.cc:336] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.646s (SENT)
I20260709 12:11:02.887223 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:02.877025 29364 raft_consensus.cc:1068] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Unable to promote non-voter 8481c5f6be5b4faa9fe7c83301759f65: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:02.814249 29390 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:02.885661 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 219475us
I20260709 12:11:02.894596 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:02.902667 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54581.9us
I20260709 12:11:02.886371 29304 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.853031 29281 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:02.887684 29438 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:02.905778 29404 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.906818 29175 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 10 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:11:02.909785 29452 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.910586 29304 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.876855 29392 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:02.896727 29422 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:02.911540 29434 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.889317 29451 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:02.910127 29435 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:02.916155 29458 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:11:02.916728 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.938921 25515 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 6 to 8, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:02.917107 29456 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.918390 29290 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:02.881932 29241 consensus_queue.cc:1059] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:02.922187 29445 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:02.903911 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51357.2us
I20260709 12:11:02.955807 29375 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:02.962810 29375 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.963483 29434 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.963523 29445 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:02.964329 29445 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:02.965265 29375 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.965696 29358 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:02.965344 29445 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.927551 29453 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:02.928705 29281 consensus_queue.cc:1243] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:02.923751 29390 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.932057 29457 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.967952 29445 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.968246 25761 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:11:02.968715 25761 pending_rounds.cc:85] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 4
I20260709 12:11:02.968515 29457 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:02.969378 25761 pending_rounds.cc:107] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:02.969805 25761 raft_consensus.cc:2889] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.933132 29447 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.970817 29209 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.943397 29441 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.975512 29441 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.976373 29209 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.933629 29452 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:02.946240 29207 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:02.966096 29358 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:02.912926 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:02.933648 29304 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.941185 29211 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.974311 29271 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:02.950135 29444 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.998159 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:02.999081 25764 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.998752 29207 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.001159 29207 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:02.974881 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:02.945104 29422 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:02.980796 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:02.979698 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 66861.8us
I20260709 12:11:02.995920 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:02.990165 29211 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:03.006170 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.010761 25763 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:03.008128 29457 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.009951 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:03.010135 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.013526 25688 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:11:03.012255 25760 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:11:03.013773 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 132690us
I20260709 12:11:02.996201 29447 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:03.024652 26304 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:02.995836 29271 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.023913 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.028076 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.028041 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:03.027241 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 67159.7us
I20260709 12:11:03.028833 25768 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:03.029249 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.030913 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.031898 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.032670 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.033830 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.036010 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.039070 25616 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:03.043691 25767 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:03.045209 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.046602 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.047331 25612 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.049744 29290 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:03.026053 29447 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.050566 29447 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:03.051293 29375 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.051714 29375 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:03.051889 29358 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.052587 29375 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.053298 29358 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.053766 29375 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.030475 29423 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.054771 25615 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:03.057631 29271 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.058597 29439 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:03.076200 29439 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.079092 29439 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.078840 29211 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.079911 29470 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:03.080241 29211 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.080629 29470 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.081873 29470 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:03.081127 25764 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:11:03.054414 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.074040 26337 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:11:03.084424 25760 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 6.
I20260709 12:11:03.059360 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:11:03.085035 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59399.8us
I20260709 12:11:03.083781 25619 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:03.088143 25763 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:11:03.088968 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.092160 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.019074 29438 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:03.097478 25612 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:03.028349 29451 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:03.103402 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.104115 25763 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:03.114812 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.117442 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.121603 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.123248 25617 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:03.124665 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.127279 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.124660 25764 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:03.140209 25762 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:03.141841 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.125401 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.143344 29423 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.145175 25612 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:03.139459 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.096148 29457 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.147951 25767 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:03.148852 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.145980 25766 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:03.149435 25760 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:03.151849 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.154497 25768 raft_consensus.cc:2393] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 15: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:03.122189 29451 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.160482 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.177240 25619 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:03.163093 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.163697 29438 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.166728 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.114101 29471 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:03.039156 29452 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.185398 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.186470 29452 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.186895 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.187847 25761 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:03.189792 29434 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:03.191345 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.173990 29435 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.180343 25617 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 10.
I20260709 12:11:03.183717 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.194754 25763 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:03.195075 25759 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:03.188817 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.171404 29457 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.192862 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.190091 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.197674 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.217576 25766 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:03.157943 29441 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.218219 25764 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:11:03.218529 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.218916 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.190292 29434 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:03.224032 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.225220 25691 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.226657 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.227474 25760 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.228004 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.232518 25759 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:03.237751 26337 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:03.239602 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.241204 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.216368 29457 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:03.253340 29469 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
I20260709 12:11:03.291404 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.292449 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.293252 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.259160 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.295948 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.223898 29471 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:03.302652 25759 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:03.302796 29471 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.310377 25767 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:03.311338 25763 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:03.314508 29451 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.319552 29271 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:03.331610 25616 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.346510 25762 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:03.332118 25614 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:03.336757 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.350704 25760 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:03.335925 25619 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:03.352985 25688 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.355122 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.355130 29434 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.356053 25691 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:03.356565 29434 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.228621 29456 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.358878 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.411701 25618 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:03.412985 25693 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:03.305949 29471 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.418296 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.423938 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.425159 25760 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:03.419147 25614 raft_consensus.cc:2410] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:03.421077 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.444260 25616 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.429632 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.445861 25693 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.434834 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.330240 29304 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.457456 25619 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:03.463548 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.464964 25693 raft_consensus.cc:2393] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.466032 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.467020 25691 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:03.467677 25765 raft_consensus.cc:2368] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9.
I20260709 12:11:03.469492 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.470681 25619 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:03.471069 25614 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:03.472206 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.466027 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.475670 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.441978 29468 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:03.479662 29466 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:11:03.486397 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.489279 29447 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.494024 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.496747 29304 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:03.498232 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:03.504753 25583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.678s (SENT) [suppressed 34 similar messages]
I20260709 12:11:03.507155 25618 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:03.509752 25617 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:03.513005 29435 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:03.504621 29470 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.514032 29451 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:03.520676 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.522274 29451 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:03.522917 29451 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.524204 29451 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.527552 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:03.529649 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.531320 25612 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:03.528069 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.515936 29447 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.529953 29453 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:03.536592 29453 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:03.537102 29453 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.540863 29438 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:03.541518 29438 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:03.546552 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.548862 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.549682 25618 raft_consensus.cc:2368] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:11:03.550201 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.551180 25617 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.551751 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.554337 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.560801 25612 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:03.561271 25614 raft_consensus.cc:2393] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:11:03.566970 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 128566us
I20260709 12:11:03.569546 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.573081 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.574756 25688 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:03.576387 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.554646 29451 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.564868 29435 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.581243 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:03.583773 25691 raft_consensus.cc:2410] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:03.586608 25614 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:03.591373 25618 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.592128 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:03.592409 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:03.538209 29453 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.595885 29453 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.595944 29390 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:03.596200 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.596855 25614 raft_consensus.cc:2376] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
I20260709 12:11:03.597148 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.598132 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.598973 25612 raft_consensus.cc:2376] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13. Re-sending same reply.
I20260709 12:11:03.583671 29395 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:03.600606 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.601017 25615 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.603087 25689 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:11:03.607020 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.607705 25688 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:03.580785 29438 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:03.609448 29438 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.611306 29358 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:03.612293 29436 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:03.612687 29436 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.614651 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.614943 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.615439 25765 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:03.615525 25764 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:03.604760 29390 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.617180 29390 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.617875 25763 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:03.613600 29436 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.619270 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.619657 29436 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.594534 29271 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.621443 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.621634 29271 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.621995 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:03.622833 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.623687 29304 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:03.622720 29271 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.601634 29435 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.625125 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.625756 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:03.646935 25615 raft_consensus.cc:2393] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:03.622304 25691 raft_consensus.cc:2393] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 6: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.647394 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.626215 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.648362 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.648931 25691 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.649027 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.650226 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.651302 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.651962 25686 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.652124 25613 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.652652 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.653225 25686 raft_consensus.cc:2376] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10. Re-sending same reply.
I20260709 12:11:03.654446 25694 raft_consensus.cc:2376] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
I20260709 12:11:03.655679 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.626441 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.627497 29463 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:03.628880 29445 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:03.629130 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:03.629539 29437 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:03.631137 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.665283 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:03.632791 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:03.666208 25763 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.635753 29470 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:03.636777 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.665598 26304 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:03.637926 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.638833 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.642869 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.670981 25692 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.643186 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.657336 25689 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:11:03.673007 25688 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.674530 25691 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:03.654047 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.677918 25686 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.677937 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.684628 25685 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.694432 25613 raft_consensus.cc:1275] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:03.686463 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.701249 25732 leader_election.cc:400] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:11:03.703809 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.704063 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.703048 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.706627 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.704846 29281 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.714761 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.716607 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.717263 25686 raft_consensus.cc:2376] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13. Re-sending same reply.
I20260709 12:11:03.717308 25582 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.718602 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.668972 29447 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:03.697693 29304 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.722615 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.683670 29463 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:03.698647 29211 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:03.724395 25694 raft_consensus.cc:2368] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 10.
I20260709 12:11:03.722671 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.733534 25690 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.725852 25582 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.734141 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.735288 25685 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:03.735858 25691 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:03.737234 25688 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:11:03.734174 25583 leader_election.cc:336] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.720s (SENT)
I20260709 12:11:03.738719 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.738857 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:03.746722 25767 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:03.749115 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.749221 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.749990 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.750669 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.751274 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.751808 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.752405 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.752868 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.753144 25685 raft_consensus.cc:2393] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.738734 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:03.754245 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.754273 25689 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:03.755358 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.757112 25764 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:03.713480 29153 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.757066 25686 raft_consensus.cc:2376] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12. Re-sending same reply.
I20260709 12:11:03.758858 29153 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:03.759622 29153 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.723500 29441 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:03.762887 29441 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:03.764137 29441 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.713877 29465 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.767686 29465 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:03.723026 29304 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:03.771000 29304 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.721728 29479 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:03.773181 29479 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:03.773686 29479 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.715397 29281 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.732504 29211 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.757058 25690 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:11:03.775926 29211 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:03.702196 29466 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:11:03.701402 29435 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.698498 29457 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:03.778987 29447 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.780083 29447 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.750015 25687 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.785326 25763 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:03.769418 29465 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:03.803808 29438 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.734977 29463 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:03.744011 29207 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:03.828790 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 103007us
W20260709 12:11:03.829066 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 94922.7us
I20260709 12:11:03.830009 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.830363 29457 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:03.841642 25583 leader_election.cc:336] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.775s (SENT)
W20260709 12:11:03.842012 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.842370 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:03.836905 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.819193 29466 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:03.839104 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.853581 25685 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.851226 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:03.832818 29438 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.840286 29375 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:03.849989 29452 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:03.890966 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.899730 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62914.6us
I20260709 12:11:03.904174 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.864704 29207 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:03.835196 29153 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.871555 29468 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:03.913682 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.928593 25688 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.928400 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.929489 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:03.826735 29281 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:03.930615 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.931341 25688 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:03.872452 29438 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:03.923518 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81917.3us
I20260709 12:11:03.885469 29472 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.926360 29456 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:03.891170 29492 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:03.932097 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:03.945207 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 241199us
I20260709 12:11:03.972790 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:03.983137 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
W20260709 12:11:03.986763 25583 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.815s (SENT)
I20260709 12:11:03.987404 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:03.992841 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.994508 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.995555 25688 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:03.996516 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:03.997442 25688 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 7: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:04.001866 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.002830 25688 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.944556 29456 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.990710 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:04.017019 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 116147us
I20260709 12:11:04.033756 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:04.035547 29471 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:04.036994 29470 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.037629 29470 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:04.054307 29470 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.033737 29207 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.005231 29497 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.058354 29497 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.011327 29456 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:04.011747 29441 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:04.017338 29494 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:04.065291 29494 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.004130 29375 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:04.067656 29375 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.069888 29499 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.070518 29499 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:04.071540 29499 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.073128 25687 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:04.000375 29304 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:04.086047 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.087903 25687 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:11:04.109418 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 122712us
I20260709 12:11:04.117136 29495 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:04.130501 29153 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:04.129952 29495 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.130501 29504 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.133276 29504 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:04.141638 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.121729 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:04.164292 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.168560 29437 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.171730 29437 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.117465 29463 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.179275 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.181528 25690 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.187894 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.225507 25690 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.179450 29463 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:04.239710 29494 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.244658 29452 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:04.247026 25686 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:04.339643 25688 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:04.348201 25619 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:04.245873 29495 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:04.357113 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 323474us
I20260709 12:11:04.375711 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.343307 29494 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.382886 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 392068us
I20260709 12:11:04.387785 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:04.389356 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.384137 29506 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.405669 29506 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.408677 29506 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.354830 29504 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:04.423853 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51646.2us
I20260709 12:11:04.442941 25690 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:04.446312 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58594us
I20260709 12:11:04.448542 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:04.373030 29505 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.458755 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.460595 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.457862 25516 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 10 to 11, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:04.416963 29495 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:04.474611 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:04.476270 25760 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:04.477658 25763 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:04.479262 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.446535 29304 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:04.460178 29454 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:04.486337 25613 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:04.457808 29506 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:04.462947 29441 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.418207 29494 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.495616 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.505630 25693 raft_consensus.cc:2376] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:11:04.467902 29437 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:04.516287 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54880.6us
W20260709 12:11:04.501114 25685 consensus_meta.cc:287] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.647s	user 0.019s	sys 0.001s
I20260709 12:11:04.501094 25618 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:04.451858 29512 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:11:04.491464 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:04.524441 25685 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:11:04.524696 25765 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.487274 29497 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.526414 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.527245 25692 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:04.465925 29505 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.498025 29435 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.532788 25760 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:04.514418 29508 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.542851 25583 leader_election.cc:336] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.568s (SENT)
I20260709 12:11:04.543855 26304 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:04.545230 25583 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:04.516196 29441 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:04.551190 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.557670 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.559021 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.565496 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.496629 29495 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.515851 29465 consensus_queue.cc:1048] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:04.594167 25765 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:04.596414 25610 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:04.599557 25583 leader_election.cc:336] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.161s (SENT)
I20260709 12:11:04.600924 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:04.545567 29506 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:11:04.567314 29438 consensus_meta.cc:287] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.004s
W20260709 12:11:04.570324 29211 consensus_meta.cc:287] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.793s	user 0.018s	sys 0.002s
I20260709 12:11:04.610868 29438 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.611434 29211 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.510506 29452 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.603358 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.606696 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.624647 25610 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:04.603358 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.554827 29504 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:04.621052 29211 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.620232 29438 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.622400 29468 raft_consensus.cc:2764] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:04.568579 29510 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:04.625197 25693 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:04.618566 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.632470 25685 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:04.571940 29442 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:04.545306 29435 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:04.614785 29501 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:11:04.629338 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:04.632735 25583 leader_election.cc:336] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.212s (SENT)
I20260709 12:11:04.637140 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:04.603456 29497 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:04.640676 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:04.640740 25610 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:04.642077 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.638132 29442 raft_consensus.cc:697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:04.554024 29508 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.645057 29442 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:04.647639 29508 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.648010 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.648978 25618 raft_consensus.cc:2410] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:04.630748 29504 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:04.651613 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.653805 25685 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:04.659577 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:04.660156 25765 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:04.664740 29511 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:04.656287 29153 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:04.668350 29153 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:04.670183 29505 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:04.670703 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.671490 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.672269 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.673552 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.674621 25693 raft_consensus.cc:2376] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
W20260709 12:11:04.675755 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.675873 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:04.668840 29479 consensus_meta.cc:287] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.895s	user 0.011s	sys 0.010s
I20260709 12:11:04.683676 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.676537 25689 raft_consensus.cc:2376] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
W20260709 12:11:04.686304 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.622115 29506 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.691936 25763 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:11:04.651818 29495 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.693171 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:04.697232 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.692589 25763 pending_rounds.cc:85] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 8
I20260709 12:11:04.698874 25763 pending_rounds.cc:107] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:04.699337 25763 raft_consensus.cc:2889] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.703094 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.706933 25618 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:04.709223 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:04.710060 25760 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:04.696385 29479 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.691584 29447 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.651479 29497 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.714396 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.715764 25689 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:04.715694 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 83019us
I20260709 12:11:04.716831 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.717257 25765 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:11:04.660900 29512 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:04.721552 29522 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:04.722645 29504 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.656570 29441 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.728199 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.728199 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.729179 25690 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:04.734920 25612 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:04.738986 25583 leader_election.cc:336] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.782s (SENT)
W20260709 12:11:04.745810 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 48132.2us
I20260709 12:11:04.747814 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:04.749151 25732 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.763s (SENT)
I20260709 12:11:04.751009 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:04.753356 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:04.753993 25618 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.755820 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:04.756420 29456 consensus_meta.cc:287] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.696s	user 0.020s	sys 0.021s
I20260709 12:11:04.756844 29456 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.738106 29494 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.740583 29435 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:04.738533 29153 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:04.759272 29463 consensus_meta.cc:287] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 12:11:04.741084 29457 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:04.719569 29447 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.763801 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:04.764993 25765 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:11:04.765682 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 67172.6us
I20260709 12:11:04.766755 29456 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:04.775010 25693 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:04.775382 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.776659 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:04.777267 25614 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:04.741586 29504 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:04.778895 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.779947 25688 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:04.794545 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.794858 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.829656 25689 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:04.863734 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:04.795473 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.870440 25688 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:04.871131 25760 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.841274 25764 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:04.795984 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:04.877560 25611 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:04.879679 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.886053 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.886780 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.887136 25686 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:04.888157 25689 raft_consensus.cc:2393] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:11:04.845988 29470 consensus_meta.cc:287] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.791s	user 0.020s	sys 0.020s
I20260709 12:11:04.889122 29470 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:04.853668 29526 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:11:04.839035 29468 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.891634 29468 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.893620 25617 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:04.894467 25615 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.898804 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:04.899899 25690 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:04.903381 25618 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
W20260709 12:11:04.906361 25583 leader_election.cc:336] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.894s (SENT)
I20260709 12:11:04.907032 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.798471 29494 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.860739 29479 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:04.913836 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:04.908776 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:04.908975 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 188159us
I20260709 12:11:04.851975 29447 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:04.915733 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:04.908733 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.924860 25760 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:04.927114 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:04.928488 25689 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:04.893910 29468 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:04.788230 29504 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:04.905915 29436 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:11:05.217483 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:05.221920 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 193055us
W20260709 12:11:05.223053 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 473924us
I20260709 12:11:05.223420 25686 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:05.018311 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.225764 25732 leader_election.cc:336] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.767s (SENT)
I20260709 12:11:05.223080 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.228477 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:05.227119 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.006721 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.017807 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.245280 25687 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:05.231825 25690 raft_consensus.cc:2376] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:11:05.254156 25760 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:05.261052 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.261631 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.262490 25687 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:05.262768 25686 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:05.263840 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.265116 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:05.118717 29529 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 12:11:05.272053 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.288076 25688 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:05.273198 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.277376 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:05.289772 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.290529 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64797us
W20260709 12:11:05.290918 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.291460 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.016772 29447 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:05.118577 29497 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:05.292743 25688 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.926187 29445 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.352s
I20260709 12:11:05.295521 25687 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.295837 25760 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:05.295784 25688 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:05.267612 29470 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:05.297552 25687 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:05.299163 25687 pending_rounds.cc:85] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 5
I20260709 12:11:05.299477 25687 pending_rounds.cc:107] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:05.297989 25686 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:05.301430 25688 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.299737 25687 raft_consensus.cc:2889] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.302089 25686 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:05.294572 29447 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.296098 29509 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:05.304750 29447 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:05.386610 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 470967us
W20260709 12:11:05.393886 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.394542 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.396128 29544 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.396962 29544 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.398703 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:05.400835 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.401489 25685 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:05.407056 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.308300 29509 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:05.419413 25732 leader_election.cc:336] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.899s (SENT)
I20260709 12:11:05.422726 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:05.430862 29497 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.432639 25685 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:05.433257 29504 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:05.439247 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.431257 29509 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:05.445528 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.448498 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.443311 29441 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.448679 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:05.441327 29375 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:05.449193 29441 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.449565 29506 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:05.449837 29375 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.451526 29441 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:05.451915 29375 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:05.443727 29497 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.439881 29504 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.449309 25765 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.452677 25764 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:05.452840 29504 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:05.453372 29506 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.453922 29506 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:05.454715 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:05.455137 29504 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:05.454869 29506 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.457868 29451 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.459100 25764 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:05.452744 29497 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:05.454679 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:05.462178 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.468708 29497 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.469717 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.470495 25611 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:05.470610 29544 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:05.471500 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.472795 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.462931 29457 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:05.464084 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.464488 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.477223 25610 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:11:05.473922 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.480449 25611 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:05.491770 29504 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:05.495442 25763 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:05.467713 29451 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:05.498745 29504 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.509554 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.512058 29468 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:05.513150 29468 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:05.513525 29468 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.513948 29447 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.516175 29447 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:05.516990 25765 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:05.518373 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.519748 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.523979 29504 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:05.527257 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:05.528575 29442 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:05.529130 29468 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.530301 29503 raft_consensus.cc:1064] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:05.531559 29468 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:05.546123 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.546367 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:05.547811 25619 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.525590 29504 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.551539 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.536983 29497 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.551061 29471 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:05.552973 29375 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:05.551061 29504 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:05.532569 29503 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:05.564477 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2492) took 1879 ms. Trace:
I20260709 12:11:05.572700 25612 rpcz_store.cc:276] 0709 12:11:03.685540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.685785 (+   245us) service_pool.cc:224] Handling call
0709 12:11:03.711581 (+ 25796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.735507 (+1023926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.564204 (+828697us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540008e154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:05.564409 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2352761216}
W20260709 12:11:05.554601 29499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.016s	sys 0.015s
W20260709 12:11:05.577636 29499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.016s	sys 0.015s
I20260709 12:11:05.578773 29375 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:05.569888 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:05.572778 29504 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.580046 29441 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:05.580148 29375 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.598301 25619 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:05.581337 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:05.588140 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 2037) took 1125 ms. Trace:
W20260709 12:11:05.627888 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46641.7us
I20260709 12:11:05.630360 29207 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.630846 29207 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.631150 29207 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.583843 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2497) took 1660 ms. Trace:
I20260709 12:11:05.565773 29497 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.577966 29471 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:05.633237 25617 rpcz_store.cc:276] 0709 12:11:03.923142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.925361 (+  2219us) service_pool.cc:224] Handling call
0709 12:11:03.925835 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.894097 (+968262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.583528 (+689431us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b540016e4d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:05.583778 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225130368}
I20260709 12:11:05.627910 25759 rpcz_store.cc:276] 0709 12:11:04.462289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.462399 (+   110us) service_pool.cc:224] Handling call
0709 12:11:04.462757 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.603329 (+140572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.603364 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.624887 (+ 21523us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.779832 (+154945us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:04.779876 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.587705 (+807829us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54000591d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:05.587748 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.587805 (+    57us) raft_consensus.cc:1685] finished
0709 12:11:05.587818 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.588072 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19242,"raft.queue_time_us":36326,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":28334,"spinlock_wait_cycles":150393216,"thread_start_us":172180,"threads_started":2,"wal-append.queue_time_us":245091}
W20260709 12:11:05.643158 25732 leader_election.cc:336] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.808s (SENT)
W20260709 12:11:05.645282 25732 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.860s (SENT)
I20260709 12:11:05.635762 29497 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:05.660392 25732 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.007s (SENT)
I20260709 12:11:05.668200 29471 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:05.674556 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.157s (SENT)
I20260709 12:11:05.675158 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:05.685072 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.687861 29506 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.688450 29506 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.690711 29506 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:05.691618 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.691510 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2499) took 1516 ms. Trace:
I20260709 12:11:05.639806 29441 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:05.692186 25615 rpcz_store.cc:276] 0709 12:11:04.175381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.183768 (+  8387us) service_pool.cc:224] Handling call
0709 12:11:04.223693 (+ 39925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.894850 (+671157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.691128 (+796278us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400417b54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:05.691422 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542177152}
I20260709 12:11:05.737861 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.770087 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.728442 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.719909 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.722220 25613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2493) took 1969 ms. Trace:
I20260709 12:11:05.767516 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.823851 25614 raft_consensus.cc:606] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:05.733479 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.727202 25692 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:05.833464 25686 raft_consensus.cc:2376] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8. Re-sending same reply.
I20260709 12:11:05.833771 25692 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:05.834424 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:05.752374 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.835040 25693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 1776) took 1037 ms. Trace:
W20260709 12:11:05.769330 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 111175us
I20260709 12:11:05.836164 25693 rpcz_store.cc:276] 0709 12:11:04.797892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.769714 (+971822us) service_pool.cc:224] Handling call
0709 12:11:05.834975 (+ 65261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:05.838388 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.832366 25613 rpcz_store.cc:276] 0709 12:11:03.752952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.807128 (+ 54176us) service_pool.cc:224] Handling call
0709 12:11:03.807431 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.489275 (+681844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.699824 (+1210549us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540037b4d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:05.721935 (+ 22111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560759040}
I20260709 12:11:05.838749 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 1765) took 1043 ms. Trace:
W20260709 12:11:05.749531 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.839521 25694 rpcz_store.cc:276] 0709 12:11:04.794847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.799571 (+  4724us) service_pool.cc:224] Handling call
0709 12:11:05.767279 (+967708us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800028298. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:11:05.838668 (+ 71389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814848}
W20260709 12:11:05.840041 25583 leader_election.cc:336] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.678s (SENT)
I20260709 12:11:05.841886 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:05.841061 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59334 (request call id 7) took 1572 ms. Trace:
W20260709 12:11:05.844154 25583 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.757s (SENT)
W20260709 12:11:05.845741 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.845674 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:05.847594 25583 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.820s (SENT)
I20260709 12:11:05.848158 25583 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:05.848229 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.848932 25688 raft_consensus.cc:2376] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11. Re-sending same reply.
W20260709 12:11:05.849211 25583 leader_election.cc:336] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.838s (SENT)
I20260709 12:11:05.843334 25616 rpcz_store.cc:276] 0709 12:11:04.253206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.356505 (+103299us) service_pool.cc:224] Handling call
0709 12:11:05.819728 (+1463223us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540008e154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d61735 00007fbdb7d21d29 00007fbdb12a01d4 00007fbdb12a0162 00007fbdb12a0091 00007fbdb12a000c 00007fbdb129f2c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:05.825810 (+  6082us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750073088}
I20260709 12:11:05.850370 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:05.849645 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:05.695403 29281 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.853552 25693 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:05.845448 29561 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.857542 29441 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.712147 29451 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:05.881170 29451 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.852530 29456 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.859344 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.884641 25694 raft_consensus.cc:2410] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:05.859838 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.860098 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:05.886219 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.887322 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.862517 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.862869 25759 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:11:05.863210 25765 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:05.868417 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:05.891412 25690 raft_consensus.cc:2376] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7. Re-sending same reply.
I20260709 12:11:05.891940 25690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 1777) took 1093 ms. Trace:
I20260709 12:11:05.892252 25690 rpcz_store.cc:276] 0709 12:11:04.798180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.846089 (+1047909us) service_pool.cc:224] Handling call
0709 12:11:05.891870 (+ 45781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.871727 29453 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:05.874686 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 200180us
I20260709 12:11:05.874888 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:05.903457 25688 raft_consensus.cc:2376] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14. Re-sending same reply.
I20260709 12:11:05.840710 29506 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.676093 29447 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.176s
I20260709 12:11:05.869199 25766 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:05.904454 25732 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.165s (SENT)
I20260709 12:11:05.916420 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:05.906109 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:05.907627 29556 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:11:05.834942 29358 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:05.906181 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:05.981935 25685 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:05.917322 25766 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:06.013935 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.034898 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:06.035831 25762 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:06.035061 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:06.037776 25685 raft_consensus.cc:2368] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16.
W20260709 12:11:06.071992 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 167575us
I20260709 12:11:06.071851 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:06.075800 25685 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:06.079603 25685 pending_rounds.cc:85] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 5
I20260709 12:11:06.079936 25685 pending_rounds.cc:107] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:06.080222 25685 raft_consensus.cc:2889] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:06.077811 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 228599us
I20260709 12:11:06.073472 25766 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:06.090212 25732 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.185s (SENT)
I20260709 12:11:06.092607 25690 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:11:06.093794 25583 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.890s (SENT)
W20260709 12:11:06.095422 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.096645 25583 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.902s (SENT)
I20260709 12:11:06.039026 29468 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:06.099080 25583 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.912s (SENT)
I20260709 12:11:06.099512 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.099915 25760 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:06.101069 25766 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:06.107414 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.927495 29453 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:11:06.104538 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 461214us
I20260709 12:11:06.092811 29358 consensus_queue.cc:1243] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:06.129257 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:06.095157 29390 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:06.131922 29560 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:11:06.109287 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet 4fcae3b0851948f58bc6dc5970b11943: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:06.095027 29506 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:06.149817 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4641492409998591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:11:06.150454 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4587492409998504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 12:11:06.156800 25762 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
W20260709 12:11:06.165457 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4488492409998344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:11:06.166011 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4344492409998111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:11:06.167018 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3822492409999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 12:11:06.167383 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3651492409999264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 12:11:06.132980 29471 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:06.167707 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3354492409998784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:11:06.171598 29504 consensus_meta.cc:287] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.592s	user 0.018s	sys 0.002s
I20260709 12:11:06.172060 29504 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:06.174453 25763 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:06.136045 29390 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:06.175822 29390 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.177109 29390 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:06.177708 29447 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.178352 29447 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:06.178946 29207 consensus_meta.cc:287] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260709 12:11:06.179492 29207 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.181068 29447 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.182003 29207 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:06.169245 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3354492409998784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:11:06.188784 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 113175us
W20260709 12:11:06.194849 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.195510 25732 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.239s (SENT)
W20260709 12:11:06.195711 25657 connection.cc:256] RPC call timeout handler was delayed by -1.2850492409997969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 12:11:06.195946 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.142592 29441 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:06.196098 25657 connection.cc:256] RPC call timeout handler was delayed by -1.0825492409999242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 12:11:06.235983 25657 connection.cc:256] RPC call timeout handler was delayed by -1.0645492409998951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 12:11:06.236727 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:06.201551 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:06.237713 25766 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:06.211894 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:06.182154 29557 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:11:06.244216 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:06.244920 25759 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:06.218111 25619 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:06.234570 25762 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:06.151530 29358 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.247159 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:06.214458 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:06.248067 25617 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:06.146554 29153 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:06.248040 25766 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
W20260709 12:11:06.194628 29562 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:11:06.247231 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76936.3us
I20260709 12:11:06.171213 29452 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:06.252846 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:06.257761 25614 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:06.258347 25760 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:06.252673 25765 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:06.254794 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45434.3us
W20260709 12:11:06.235909 29563 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:11:06.248598 25616 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:06.260365 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 64886.7us
I20260709 12:11:06.187865 29453 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.235764 29544 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.267463 25732 leader_election.cc:336] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.441s (SENT)
I20260709 12:11:06.152571 29506 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:06.268054 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 137507us
I20260709 12:11:06.260151 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.258770 29445 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:11:06.269246 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:06.266392 29547 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:11:06.257537 29358 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.259758 29504 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:06.269554 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:06.265792 29543 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:11:06.270815 29570 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:06.259413 29509 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.259205 29503 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:11:06.271952 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:06.273654 25617 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:06.274231 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.275461 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff1240c7107404994c96234274c5e64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:06.288437 25619 raft_consensus.cc:606] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:06.288836 25619 raft_consensus.cc:614] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.252205 29447 raft_consensus.cc:2764] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:11:06.269550 29564 log.cc:927] Time spent T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:11:06.266593 29561 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.279343 25583 leader_election.cc:336] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.113s (SENT)
W20260709 12:11:06.278530 29497 consensus_meta.cc:287] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.004s
I20260709 12:11:06.267213 29441 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:06.291957 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.296113 26334 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:06.311147 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:06.311779 25768 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:06.305243 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.309862 25583 leader_election.cc:336] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.121s (SENT)
I20260709 12:11:06.291205 29456 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.306366 29471 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:06.278326 29544 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.315321 29468 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.310830 29497 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.308264 29514 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:06.329321 29506 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:06.335662 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.330188 25691 raft_consensus.cc:2410] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:06.339280 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47390.8us
W20260709 12:11:06.346728 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.346681 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 79251.9us
I20260709 12:11:06.347254 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.344027 29451 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:06.314564 29375 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.352336 25765 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:06.354015 25732 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.529s (SENT)
I20260709 12:11:06.354561 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.355603 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:06.356266 25616 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:06.340569 29517 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.309695 29561 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.346679 29437 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.349192 29451 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:06.355530 29153 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:11:06.363577 25692 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.359501 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:06.377070 25692 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:06.387354 25763 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:06.395501 25583 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:06.352021 29436 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:06.407703 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.374491 29565 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.352162 29547 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:06.368698 29468 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:06.439644 29561 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.390091 29570 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:11:06.440959 25761 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:06.411734 29447 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:06.441488 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:06.442054 29447 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.330046 29441 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:06.408172 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.418485 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 68219.5us
I20260709 12:11:06.426321 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:06.378743 29271 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.430883 25759 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:06.356009 29375 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.431156 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:06.446806 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51380.6us
I20260709 12:11:06.459374 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.453362 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:06.472975 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65319.1us
I20260709 12:11:06.474342 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.474865 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.478204 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:06.479110 25686 raft_consensus.cc:606] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:06.417873 29435 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:06.378575 29437 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.379953 29456 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:11:06.486966 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.443364 29358 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:06.489259 25691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 1726) took 2677 ms (client timeout 2017 ms). Trace:
W20260709 12:11:06.489847 25691 rpcz_store.cc:269] 0709 12:11:03.822468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.928095 (+105627us) service_pool.cc:224] Handling call
0709 12:11:06.485297 (+2557202us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400328a54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:06.485461 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5521435520}
I20260709 12:11:06.418547 29471 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:06.501298 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.476949 29514 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:06.483790 29578 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 12:11:06.477249 29570 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:06.471359 29470 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:06.510635 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:06.529655 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54887.1us
I20260709 12:11:06.480769 29153 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:06.536417 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.536275 29153 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:06.444563 29565 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.538566 29565 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.538569 29153 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:06.476733 29561 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:06.557111 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.507524 29445 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:06.501466 29435 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:06.560210 25657 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.505494 29468 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.526738 29580 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:06.540495 29453 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:06.568996 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.569873 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 95744.9us
I20260709 12:11:06.578125 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.579617 25768 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:06.575727 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.591094 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.489457 29451 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.561388 29504 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.596524 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.563680 29445 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:06.597339 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.619446 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.578148 29463 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.565745 29547 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.568888 29153 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.597146 29570 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:06.631605 29570 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.565279 29585 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:06.635290 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 48283us
I20260709 12:11:06.568715 29456 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:06.636467 29456 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:11:06.640995 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 130406us
I20260709 12:11:06.635428 29590 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.642249 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.597175 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:06.652273 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 121286us
I20260709 12:11:06.584299 29544 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.655089 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:06.655674 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:06.676064 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:06.661839 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:06.666530 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:06.679466 25760 raft_consensus.cc:2410] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:06.594087 29514 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:06.657061 25615 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:06.683674 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.684943 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:06.680665 25613 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.688187 25618 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:06.613538 29271 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.614861 29497 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:06.620443 29453 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:06.694090 25657 leader_election.cc:400] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9.
I20260709 12:11:06.696378 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:06.724438 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 65969.5us
I20260709 12:11:06.706588 25616 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:06.731334 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89182.9us
W20260709 12:11:06.732227 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 83069.7us
I20260709 12:11:06.733036 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.743149 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:06.743588 29445 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.738799 29583 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.751091 29583 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.754832 29583 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.698794 29451 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.770239 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:06.763311 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.697028 29580 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.627166 29504 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.775267 29504 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:06.777644 29504 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:06.620796 29588 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
W20260709 12:11:06.739861 29390 consensus_meta.cc:287] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.002s
I20260709 12:11:06.750064 29445 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:06.696496 29544 raft_consensus.cc:2764] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:11:06.788725 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63472.7us
I20260709 12:11:06.790112 29453 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:06.734364 29574 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.790962 29153 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:11:06.802418 29575 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.332s	user 0.000s	sys 0.002s
W20260709 12:11:06.804699 29550 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:06.805593 29484 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:11:06.806078 29470 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:06.791965 29583 consensus_queue.cc:1059] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:11:06.806466 29452 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:06.614341 29471 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:06.759339 29585 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.783473 29271 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.705219 29435 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:06.830513 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60401.9us
I20260709 12:11:06.758030 29497 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:06.791282 29447 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.829677 25613 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
W20260709 12:11:06.838056 25764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.033s
W20260709 12:11:06.838487 25764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.033s
I20260709 12:11:06.820649 29375 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:06.835093 29509 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:06.824194 29561 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:11:06.826877 29580 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 12:11:06.864114 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 58663.7us
I20260709 12:11:06.828997 29358 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:11:06.893004 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 61618.9us
I20260709 12:11:06.899096 25583 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:06.846093 29522 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:06.885102 29468 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:06.969560 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 80305.4us
I20260709 12:11:06.866155 29514 consensus_queue.cc:1059] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:06.869204 29517 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:11:06.968883 29504 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:06.970886 29390 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.971166 29574 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.014631 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:06.977399 29453 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.026561 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 127576us
I20260709 12:11:07.027988 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:07.011930 29588 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.044123 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:07.054229 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:07.025350 29390 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:07.034636 29596 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:07.036340 29453 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.063426 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:07.063627 25583 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.098s (SENT)
I20260709 12:11:07.067111 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:07.069600 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.070497 25693 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:07.069751 25691 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:07.071219 25691 pending_rounds.cc:85] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 7
I20260709 12:11:07.071563 25691 pending_rounds.cc:107] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:07.071862 25691 raft_consensus.cc:2889] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:07.072260 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.073235 25685 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:07.077505 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.025751 29544 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:07.070537 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.080261 25687 raft_consensus.cc:2410] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:07.081919 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.083142 25691 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:11:07.079092 29591 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
I20260709 12:11:07.084118 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.054818 29583 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:07.086228 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.087307 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.084992 25691 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:07.088485 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.011255 29601 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:11:07.088559 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.090422 25693 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
I20260709 12:11:07.091264 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.089308 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.097960 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.068306 29517 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:07.026172 29574 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.082888 29602 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.238s
W20260709 12:11:07.143956 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 173737us
I20260709 12:11:07.104262 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.079222 29592 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.105082 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:07.107039 29582 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 12:11:07.108229 29600 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:11:07.111105 29603 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:07.111869 29606 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:07.113003 29565 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:07.116497 29610 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.104601 29504 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.120034 29390 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.104041 29580 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.105592 29517 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.167320 29517 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.168737 29453 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.146013 25689 raft_consensus.cc:2410] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:07.172292 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.147149 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.068619 29463 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:07.160192 29565 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:07.160548 25685 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.160727 25610 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:07.174642 29565 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.175307 29207 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.175716 29207 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:07.173395 29586 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:11:07.176633 29207 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.177925 29207 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.178351 29574 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.188000 29437 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.194772 29561 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:07.195266 29561 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:07.196169 29561 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.197803 29561 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.198995 29611 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:07.199493 29611 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:07.200560 29611 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:07.203186 29590 consensus_meta.cc:287] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 12:11:07.203714 29590 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.204567 25761 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.207770 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.208693 25688 raft_consensus.cc:2410] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 12:11:07.207140 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 382431us
I20260709 12:11:07.215576 29503 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:07.219312 25583 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.676s (SENT)
I20260709 12:11:07.202024 29611 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.213035 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:07.227910 25685 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:07.238687 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:07.240939 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:07.242316 25612 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:07.242643 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:07.243825 25613 raft_consensus.cc:2393] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:07.250612 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.251026 25616 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:07.251665 25689 raft_consensus.cc:2376] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
I20260709 12:11:07.252602 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:07.253571 25611 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:07.232715 29503 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:07.259630 25613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:07.262387 25613 raft_consensus.cc:606] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:07.262827 25613 raft_consensus.cc:614] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:07.268050 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.268708 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.269076 25689 raft_consensus.cc:2410] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:07.272168 25688 raft_consensus.cc:2410] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:07.273572 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:07.278833 25583 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.550s (SENT)
I20260709 12:11:07.273514 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:07.268530 29503 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:07.296010 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.303012 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.303607 25689 raft_consensus.cc:2410] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:07.303715 25688 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:07.320721 29456 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:07.321002 29503 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.326624 29567 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.327188 29567 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:07.328022 29567 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.329118 29567 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.330550 25583 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.612s (SENT)
I20260709 12:11:07.299088 29437 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:07.349004 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.362136 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.363140 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.345302 29437 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.376767 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.381346 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:07.391484 25583 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.677s (SENT)
I20260709 12:11:07.392094 25583 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:07.393143 25764 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:07.394447 25689 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:07.381906 29437 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.395881 29281 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:07.396266 29281 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:07.397083 29281 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.399381 29612 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.404734 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:07.366149 29504 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.410430 25582 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 460a9cbf9985461f9237f09b4f5ca854. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:07.378814 29585 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:07.418864 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 46845us
I20260709 12:11:07.419772 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.422801 25688 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:07.429459 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.422048 29281 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.421975 29585 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:07.419960 29504 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.434383 29585 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.435577 29585 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.435621 29504 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:07.425729 29451 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.438678 29451 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.441200 29451 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.406220 29437 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.495412 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.495702 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.496047 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.540761 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.541617 25686 raft_consensus.cc:2410] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:07.496368 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.496745 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.497195 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.498569 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.518749 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.519793 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.521484 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.545286 25766 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:07.523054 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.541955 25583 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:07.550591 25694 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:07.551774 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.553153 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.553859 25694 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:07.554993 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.539229 25689 raft_consensus.cc:2376] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
I20260709 12:11:07.555663 25694 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.557535 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.559326 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.560943 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.561158 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.563202 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.564046 25687 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:07.565603 25687 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:07.567627 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:07.569865 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:07.546975 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.573369 25693 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:07.580233 25583 leader_election.cc:400] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16.
I20260709 12:11:07.580734 25583 leader_election.cc:403] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.586771 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:07.591132 29635 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:11:07.593972 25691 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:07.632983 25689 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:07.576514 29644 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:11:07.638873 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:07.640396 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60274.5us
I20260709 12:11:07.639773 25763 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:07.605437 29522 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:07.656262 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.656294 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.659441 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:07.664008 25761 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:11:07.636245 29153 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16.
I20260709 12:11:07.670856 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:07.678432 29465 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:07.678968 29465 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:07.679982 29465 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:07.681114 29456 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:07.682723 29634 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 12:11:07.665930 29592 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.683600 29592 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.662248 29522 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.693776 25694 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
W20260709 12:11:07.694923 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.686097 29592 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.675772 29441 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:11:07.702585 29522 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:07.732064 29517 consensus_meta.cc:287] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.001s
W20260709 12:11:07.812827 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.831355 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.820334 29503 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:07.816386 29153 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:07.867448 25687 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:07.871373 29567 consensus_meta.cc:287] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.001s
I20260709 12:11:07.874987 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 2083) took 1216 ms. Trace:
W20260709 12:11:07.893834 29561 consensus_meta.cc:287] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.002s
I20260709 12:11:07.892804 25759 rpcz_store.cc:276] 0709 12:11:06.658843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.662564 (+  3721us) service_pool.cc:224] Handling call
0709 12:11:06.662951 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.778799 (+115848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.778851 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.779601 (+   750us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.042078 (+262477us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.042128 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.874533 (+832405us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400150754. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:07.874586 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.874636 (+    50us) raft_consensus.cc:1685] finished
0709 12:11:07.874650 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.874908 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16770,"raft.queue_time_us":70177,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":10895,"spinlock_wait_cycles":265168256,"thread_start_us":261978,"threads_started":1,"wal-append.queue_time_us":258697}
I20260709 12:11:07.881932 29456 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.824502 29517 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.897306 29517 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.846519 29437 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:07.847505 29503 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.901034 29503 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:07.879516 25732 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.511s (SENT)
I20260709 12:11:07.890698 25688 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:07.903589 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:07.904776 25732 leader_election.cc:336] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.516s (SENT)
W20260709 12:11:07.905676 25732 leader_election.cc:336] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.547s (SENT)
I20260709 12:11:07.906095 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:07.907087 29608 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.907449 25732 leader_election.cc:336] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.555s (SENT)
I20260709 12:11:07.907804 29608 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.907968 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:07.909394 25732 leader_election.cc:336] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.602s (SENT)
I20260709 12:11:07.909893 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:07.911206 25732 leader_election.cc:336] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.628s (SENT)
I20260709 12:11:07.914340 29590 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:07.912127 29648 log.cc:927] Time spent T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:11:07.917021 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.901746 29514 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:07.984247 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 56038.8us
I20260709 12:11:07.848166 29153 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:07.925192 29514 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:07.924393 29590 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:07.994469 29632 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.564s	user 0.002s	sys 0.002s
I20260709 12:11:07.984360 29570 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:07.994807 29608 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.896621 29522 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:08.009296 29580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.013s	sys 0.026s
I20260709 12:11:08.023680 29281 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.024959 25688 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:08.027606 25688 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:08.030027 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:08.030793 25688 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.033525 25694 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:08.027256 25658 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:08.035475 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.036486 25694 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:08.036875 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:08.037711 25691 raft_consensus.cc:2376] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13. Re-sending same reply.
I20260709 12:11:08.040293 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:08.041622 25691 raft_consensus.cc:2376] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11. Re-sending same reply.
I20260709 12:11:08.043357 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.043463 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:08.045102 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.045332 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:08.025003 29580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.013s	sys 0.027s
I20260709 12:11:08.046617 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.081780 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:08.082528 25616 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.047847 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.017540 29570 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.085810 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:08.064994 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.009264 29590 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.024293 29281 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.077301 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:08.019623 29375 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:08.046723 25694 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:08.086298 25690 raft_consensus.cc:2393] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:08.044162 25613 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:11:08.046774 29271 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.091378 25615 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:08.087003 25691 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:08.105468 25691 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 12:11:08.099613 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 186630us
I20260709 12:11:08.109685 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.126663 25688 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
W20260709 12:11:08.128252 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.141603 25692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1797) took 2375 ms. Trace:
I20260709 12:11:08.146150 25692 rpcz_store.cc:276] 0709 12:11:05.720663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.726475 (+  5812us) service_pool.cc:224] Handling call
0709 12:11:05.727016 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.363292 (+636276us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540007b320. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd906f 00007fbdb2d51f60 00007fbdb2d537de 00007fbdb2d5db49 00007fbdb2d5e416 00007fbdb2d5ad8f 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62
0709 12:11:07.171311 (+808019us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b180007a5c0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb2d53060 00007fbdb2d53bfb 00007fbdb2d5e64b
0709 12:11:07.171453 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:07.274461 (+103008us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.049807 (+775346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.095682 (+ 45875us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.095743 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.095828 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.095982 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40483,"prepare.queue_time_us":176710,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":110905,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":21645,"spinlock_wait_cycles":707892864,"thread_start_us":911440,"threads_started":4,"wal-append.queue_time_us":548475}
W20260709 12:11:08.151046 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.704s (SENT)
W20260709 12:11:08.152110 25732 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.705s (SENT)
I20260709 12:11:08.152518 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.156740 25616 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:08.156572 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:08.157547 25767 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:08.157969 25761 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:08.158638 25685 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:08.159168 25732 leader_election.cc:336] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.712s (SENT)
I20260709 12:11:08.159878 25688 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:08.160697 25761 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.089756 29567 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:08.160898 25690 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:08.161507 29506 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.161931 29611 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.162539 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:08.160764 29499 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:08.165395 25688 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:08.167896 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.108690 29271 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.094386 29375 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:08.163340 29651 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:08.178546 29506 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.179589 29567 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:08.180663 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:08.214846 25614 raft_consensus.cc:606] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:08.215409 25614 raft_consensus.cc:614] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:08.181674 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.075603 29514 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:08.230636 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.191350 29281 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:08.191219 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:08.108049 29468 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.169204 29593 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:08.166280 29504 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.193826 25687 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:08.240154 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:08.231662 29652 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:11:08.196731 25767 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:08.195709 25692 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:08.201934 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 94940.4us
I20260709 12:11:08.227844 29456 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:11:08.206235 29649 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 12:11:08.233843 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:08.202977 29271 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.240697 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.241549 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.198570 25688 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:08.251178 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:08.251982 25688 raft_consensus.cc:2376] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10. Re-sending same reply.
I20260709 12:11:08.253129 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:08.230209 29494 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.249567 25687 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:08.201678 29611 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.267359 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:08.273711 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 105937us
I20260709 12:11:08.276758 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.285930 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:08.289717 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55997.1us
I20260709 12:11:08.290846 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:08.255240 29522 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:08.325268 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.240201 29468 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.247653 29504 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.334790 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.255081 29456 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:08.289424 29494 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:08.333213 29436 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.286942 29153 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:08.345091 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:08.352216 29656 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:11:08.353003 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.325102 29606 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.360054 25759 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:08.342346 29445 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:08.369062 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 101814us
I20260709 12:11:08.334776 29590 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:08.354214 29436 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:08.375113 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84407.3us
I20260709 12:11:08.375982 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:08.349349 29593 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.366559 29494 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.381690 25759 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:08.363029 29570 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:08.361579 29606 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.288784 29375 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:08.389649 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.378489 29436 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.380117 29593 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.382472 29358 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:08.475018 29666 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 12:11:08.448858 29657 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 12:11:08.479230 29667 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:11:08.578078 29668 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:08.384469 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:08.583274 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 230417us
I20260709 12:11:08.583406 29468 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:08.384488 29590 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.375300 29445 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:11:08.581887 29494 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.830538 29570 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:08.584431 29281 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.774818 25617 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:08.775324 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:08.819036 25694 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.018s
W20260709 12:11:08.828255 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.830801 29153 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.825765 29606 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.848273 29506 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:08.845480 29661 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:08.847872 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.845731 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.383345 29670 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.830971 29593 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.836181 29375 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.854522 29611 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:08.868468 29271 consensus_meta.cc:287] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.007s
W20260709 12:11:08.868396 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.867863 25694 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.019s
I20260709 12:11:08.842824 29567 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:08.853943 29468 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:11:08.891978 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46335.9us
I20260709 12:11:08.893754 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.895496 29590 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:08.898108 29611 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:08.897369 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.870349 29661 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:08.902686 29456 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:08.903542 29456 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:08.905344 29661 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:08.866294 29281 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:08.907781 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.873648 29668 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:08.864635 29677 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.907109 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:08.882479 29506 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.921343 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2075) took 1372 ms. Trace:
I20260709 12:11:08.886435 29358 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:08.927173 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.929051 25760 rpcz_store.cc:276] 0709 12:11:07.549443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.568544 (+ 19101us) service_pool.cc:224] Handling call
0709 12:11:07.568982 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.653032 (+ 84050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.653087 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.670275 (+ 17188us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.993162 (+322887us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:07.993226 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.993352 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.921036 (+927684us) raft_consensus.cc:1685] finished
0709 12:11:08.921066 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.921255 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70885,"raft.queue_time_us":84353,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":14737,"thread_start_us":298535,"threads_started":1,"wal-append.queue_time_us":354557}
I20260709 12:11:08.868703 29153 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.908993 29590 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.878784 29570 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:08.920533 29494 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:08.928910 29668 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:08.935413 29677 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.933426 29504 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:08.940140 29506 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.977470 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:08.889809 29271 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:08.908913 29468 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:09.011381 29506 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.012634 29153 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.013144 29468 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:08.989647 29494 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.014827 29271 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.015447 29607 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:09.016410 29494 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.019136 29677 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.021101 29570 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:09.022456 29681 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:09.023065 29681 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:09.023535 29681 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:09.027077 29679 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:09.027655 29281 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.003644 29680 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.028878 29680 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.029465 29668 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:09.031893 29606 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:09.040126 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62747.7us
I20260709 12:11:09.040529 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:09.041515 25617 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.041575 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:09.042517 25614 raft_consensus.cc:2410] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:09.043470 29494 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.041153 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:09.046605 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:09.047483 29672 log.cc:927] Time spent T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:11:09.048738 29607 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.049192 29607 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:09.049825 29607 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.054380 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1831) took 1006 ms. Trace:
I20260709 12:11:09.054589 29271 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.055111 29271 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.054873 25691 rpcz_store.cc:276] 0709 12:11:08.047479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.106500 (+ 59021us) service_pool.cc:224] Handling call
0709 12:11:08.106805 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.163882 (+ 57077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.163918 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.170515 (+  6597us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.326756 (+156241us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:08.326804 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.326880 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.053779 (+726899us) raft_consensus.cc:1685] finished
0709 12:11:09.053817 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.054306 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110269,"raft.queue_time_us":58800,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":15292,"thread_start_us":82580,"threads_started":1,"wal-append.queue_time_us":140482}
I20260709 12:11:09.057701 29271 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.063643 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:09.064965 25616 raft_consensus.cc:2410] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:09.049109 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.067293 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.061713 29611 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:09.069124 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 198264us
I20260709 12:11:09.072137 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:09.072984 25614 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:11:09.076587 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.078168 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.079524 25583 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:09.080330 25617 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:09.059808 29680 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.062361 29468 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.069233 29506 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.092885 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 711636us
I20260709 12:11:09.076262 29668 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.094017 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:09.067755 29494 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:09.082119 29570 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:09.124557 25657 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:09.106091 25658 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:09.130100 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:09.099498 29625 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:11:09.101099 29680 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:09.177929 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45839.1us
I20260709 12:11:09.131672 29674 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.103518 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:09.184496 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81096.4us
I20260709 12:11:09.187589 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1828) took 1141 ms. Trace:
I20260709 12:11:09.168699 29281 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:11:09.188091 25686 rpcz_store.cc:276] 0709 12:11:08.046596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.080422 (+ 33826us) service_pool.cc:224] Handling call
0709 12:11:08.080743 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.081114 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.081143 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.092653 (+ 11510us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.271922 (+179269us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:08.842580 (+570658us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.187214 (+344634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.187313 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.187364 (+    51us) raft_consensus.cc:1685] finished
0709 12:11:09.187375 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.187518 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78328,"prepare.queue_time_us":93621,"prepare.run_cpu_time_us":864,"prepare.run_wall_time_us":5871,"raft.queue_time_us":30845,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":19674,"thread_start_us":911641,"threads_started":3,"wal-append.queue_time_us":227058}
I20260709 12:11:09.207701 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:09.129074 29668 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:11:09.224820 25658 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:09.172832 29447 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:09.226668 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 96648.4us
I20260709 12:11:09.230873 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.244266 25658 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:09.205948 29468 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.249656 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:09.250059 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:09.236670 29677 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.237092 29547 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.231407 29674 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:09.204545 29611 consensus_queue.cc:1059] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:11:09.291697 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 212210us
I20260709 12:11:09.257901 25657 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:09.292820 25583 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:09.255810 25686 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 11.
I20260709 12:11:09.236723 29606 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.248955 29271 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.226675 29504 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:09.285869 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:09.251044 29685 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.246851 29690 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:09.321453 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.344820 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.366285 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73557.7us
I20260709 12:11:09.263108 29375 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:09.253017 29691 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.250411 29684 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:09.402129 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:09.405418 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 147589us
I20260709 12:11:09.290603 29281 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.409782 29447 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:09.410588 29447 consensus_queue.cc:1243] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:09.412467 29281 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:09.413539 29281 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:09.417197 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.408280 25766 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 11.
I20260709 12:11:09.281138 29468 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:09.419786 25766 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.421135 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.295711 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:09.296208 29271 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.320076 29522 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.371279 29593 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.334903 29570 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.427467 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.406354 29436 consensus_meta.cc:287] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.003s
I20260709 12:11:09.433132 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:09.397537 29375 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.406675 29677 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.330062 29494 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:11:09.403390 29611 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:09.418504 29547 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.426914 29690 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.426890 29271 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.456182 29547 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.461326 29547 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.461617 29693 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.462330 29693 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.467047 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:09.437871 29499 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.451328 29375 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:09.474318 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.454021 29590 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:09.474895 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.476046 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55646us
I20260709 12:11:09.477568 26303 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:09.479529 29281 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.480695 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.480660 29281 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.337363 29674 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.458689 29690 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.499995 29690 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.468863 29611 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.483932 29543 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:09.484521 29549 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:09.431278 29685 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:09.439610 29522 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.467626 29678 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.453008 29436 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.468189 29658 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.502240 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1815) took 1472 ms. Trace:
I20260709 12:11:09.509039 25685 rpcz_store.cc:276] 0709 12:11:08.029592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.031672 (+  2080us) service_pool.cc:224] Handling call
0709 12:11:08.032039 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.159077 (+127038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.502004 (+1342927us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003b8154. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:09.502176 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290307328}
I20260709 12:11:09.493408 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54032 (request call id 2088) took 1330 ms. Trace:
I20260709 12:11:09.510198 25759 rpcz_store.cc:276] 0709 12:11:08.163296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.163423 (+   127us) service_pool.cc:224] Handling call
0709 12:11:09.493118 (+1329695us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000afad4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:09.493321 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286049280}
I20260709 12:11:09.455648 29677 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.496532 29607 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:09.497390 29653 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 1.307s	user 0.007s	sys 0.000s
I20260709 12:11:09.437598 29694 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:11:09.503441 29543 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:09.503232 29611 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:09.505221 29670 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.005s
I20260709 12:11:09.527987 29670 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.507284 29681 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.532524 29681 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.532889 29677 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.534446 29698 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.534720 29514 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.535038 29698 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.524334 29593 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.539801 29694 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:09.539662 29561 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:09.540303 29694 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:09.524832 29543 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.486586 29468 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.523404 29658 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.508044 29678 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.449738 29570 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.526767 29607 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:09.546448 29694 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:09.876993 29693 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.877767 29698 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:09.911341 29694 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:10.943773 29678 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.008965 29522 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:11.031869 29690 consensus_meta.cc:287] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.531s	user 0.014s	sys 0.016s
I20260709 12:11:11.032691 29690 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.037441 29690 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.129302 29436 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:11.140055 29271 consensus_meta.cc:287] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.667s	user 0.026s	sys 0.026s
I20260709 12:11:11.144199 29271 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.146926 29271 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.148608 29465 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.531766 29547 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.173586 29547 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:11.170338 29514 consensus_meta.cc:287] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.635s	user 0.006s	sys 0.019s
I20260709 12:11:11.175081 29565 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:11.188398 29699 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.189188 29699 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.246800 29665 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 2.867s	user 0.000s	sys 0.009s
W20260709 12:11:11.252071 29655 log.cc:927] Time spent T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 3.044s	user 0.011s	sys 0.006s
I20260709 12:11:11.194159 29699 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:11.285921 29375 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.794s	user 0.022s	sys 0.019s
I20260709 12:11:11.286752 29375 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.290298 29375 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.317113 29687 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.318009 29687 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:11:11.329453 25659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.854s	user 0.018s	sys 0.021s
W20260709 12:11:11.330502 25659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.857s	user 0.018s	sys 0.022s
I20260709 12:11:11.334583 29606 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.335273 25689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 1821) took 3290 ms. Trace:
I20260709 12:11:11.335476 29606 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.335815 25689 rpcz_store.cc:276] 0709 12:11:08.044377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.044527 (+   150us) service_pool.cc:224] Handling call
0709 12:11:08.044832 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.070464 (+ 25632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.070495 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.071115 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.237140 (+166025us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.336143 (+ 99003us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.337877 (+  1734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.338012 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.220982 (+2882970us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:11:11.334591 (+113609us) raft_consensus.cc:1685] finished
0709 12:11:11.334703 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.334972 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6533,"prepare.queue_time_us":128021,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":7661,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":12317,"spinlock_wait_cycles":7293824,"thread_start_us":212882,"threads_started":2,"wal-append.queue_time_us":202304}
I20260709 12:11:11.338465 29514 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.339090 29514 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.341856 29514 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.334038 25617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2581) took 2048 ms. Trace:
I20260709 12:11:11.346117 29514 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:11.344724 25617 rpcz_store.cc:276] 0709 12:11:09.285324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.293739 (+  8415us) service_pool.cc:224] Handling call
0709 12:11:09.294225 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.419118 (+124893us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:09.419156 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.419646 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.534487 (+114841us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:09.534533 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.534607 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.333327 (+1798720us) raft_consensus.cc:1685] finished
0709 12:11:11.333371 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.333755 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":592,"raft.queue_time_us":123546,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":236488,"threads_started":2,"wal-append.queue_time_us":487211,"wal-append.run_cpu_time_us":2485,"wal-append.run_wall_time_us":1033400}
I20260709 12:11:11.347692 29514 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:11.351325 29606 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.353081 29514 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:11.371583 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.373838 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.379446 26303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.892s	user 0.006s	sys 0.025s
W20260709 12:11:11.380364 26303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.893s	user 0.007s	sys 0.026s
I20260709 12:11:11.413272 29281 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.441206 29570 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.447908 29608 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.463825 29608 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:11:11.465612 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800077240 after lost signal to thread 24445
I20260709 12:11:11.465862 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:11:11.474599 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800091ee0 after lost signal to thread 25514
W20260709 12:11:11.465698 26304 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 2.236s (SENT) [suppressed 61 similar messages]
W20260709 12:11:11.474969 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800091f20 after lost signal to thread 25516
I20260709 12:11:11.477372 29658 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.491014 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:11.494295 29608 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.499150 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2559) took 3428 ms. Trace:
I20260709 12:11:11.500216 29608 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.496748 29506 consensus_meta.cc:287] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 2.402s	user 0.018s	sys 0.013s
I20260709 12:11:11.499830 25611 rpcz_store.cc:276] 0709 12:11:08.070184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.070370 (+   186us) service_pool.cc:224] Handling call
0709 12:11:08.078988 (+  8618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.152054 (+ 73066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.152087 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.152133 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:08.152165 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.498520 (+3346355us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b5400302d54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:11.498621 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.498950 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163339520}
I20260709 12:11:11.505349 29506 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:11.510820 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45331.3us
W20260709 12:11:11.515921 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.516518 29543 consensus_meta.cc:287] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 1.975s	user 0.018s	sys 0.009s
I20260709 12:11:11.517115 29543 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:11.526710 29713 ts_tablet_manager.cc:933] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:11:11.527571 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2074) took 4004 ms. Trace:
W20260709 12:11:11.528628 25732 connection.cc:256] RPC call timeout handler was delayed by -1.9459530730000552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 12:11:11.547533 29543 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.548184 29668 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.546489 25762 rpcz_store.cc:276] 0709 12:11:07.522616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.544924 (+ 22308us) service_pool.cc:224] Handling call
0709 12:11:07.545223 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.583421 (+ 38198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.583450 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.636094 (+ 52644us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.984491 (+348397us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.203627 (+219136us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.210877 (+3007250us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18000812e0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc3c2a6 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db
0709 12:11:11.214088 (+  3211us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:11:11.521337 (+307249us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b18000812e0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6b455 00007fbdb2d53060 00007fbdb2d65716 00007fbdb2d76287
0709 12:11:11.521526 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.521646 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.521703 (+    57us) raft_consensus.cc:1685] finished
0709 12:11:11.521715 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.527267 (+  5552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75103,"prepare.queue_time_us":286021,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":3524,"raft.queue_time_us":90400,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":38390,"spinlock_wait_cycles":90379648,"thread_start_us":627692,"threads_started":3,"wal-append.queue_time_us":437066}
I20260709 12:11:11.548593 29608 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.548895 29668 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.549362 29608 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:11.550647 29494 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.551206 29494 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.551753 29668 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.552311 29668 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.552958 29668 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.553473 29494 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.554522 29713 tablet_copy_client.cc:323] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:11:11.554741 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:11.555250 29668 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.555634 26334 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:11:11.555660 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:11.557721 25685 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.559464 29668 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:11.560458 29668 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:11.561757 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:11.562448 29504 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.563333 29504 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.562806 26334 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:11.565486 29504 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.568111 29608 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:11.571070 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:11.571341 29608 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.572681 29684 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:11.573060 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.573470 29684 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.574474 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.574988 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.572831 29608 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.575521 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.579936 29612 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.579823 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.580866 29612 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.581295 29717 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.582141 29717 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.575562 25685 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
I20260709 12:11:11.566049 29504 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.587970 25610 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:11.588625 29717 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.589223 29717 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.589746 29717 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.590312 29668 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:11.589952 25610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53302 (request call id 2582) took 2123 ms (client timeout 1762 ms). Trace:
W20260709 12:11:11.590929 25610 rpcz_store.cc:269] 0709 12:11:09.466447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.466684 (+   237us) service_pool.cc:224] Handling call
0709 12:11:11.589669 (+2122985us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b5400302854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:11.589806 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4874964736}
I20260709 12:11:11.592013 29717 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.576960 29608 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.583922 29612 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.592581 29717 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.586416 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800091f00 after lost signal to thread 25551
I20260709 12:11:11.554073 29494 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.581252 25762 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:11.585170 29570 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.594380 29570 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.593755 29494 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.590947 29668 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.596791 29570 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.575963 29684 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.598348 29684 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.599154 29684 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.601102 25759 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:11.602295 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 2.07944e+06us
I20260709 12:11:11.602572 29718 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.593227 29717 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.603613 29718 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.588104 29504 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.606848 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.606688 29494 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.607702 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.609222 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.610679 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.604074 29506 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.630541 29675 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.631670 29675 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.635627 25548 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa740 after lost signal to thread 25565
I20260709 12:11:11.635842 29692 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:11.636216 25548 debug-util.cc:398] Leaking SignalData structure 0x7b080017bbe0 after lost signal to thread 25571
I20260709 12:11:11.636341 29687 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:11:11.636518 29692 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.637348 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:11.640805 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:11.641657 25759 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.637811 25767 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:11:11.643579 25760 raft_consensus.cc:2410] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:11.644578 25762 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.620887 29570 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:11.646023 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:11.650527 29561 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.651706 29658 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.651358 29561 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.652093 29570 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.652328 29658 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.653056 29503 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.653855 29561 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.653692 29503 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.654453 29375 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.655050 29375 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.655992 29503 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.657621 29506 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.658208 29718 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:11.659674 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800307400 after lost signal to thread 25643
I20260709 12:11:11.660082 29506 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.660772 29456 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:11.652762 29570 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.674043 25548 debug-util.cc:398] Leaking SignalData structure 0x7b080031d980 after lost signal to thread 25718
I20260709 12:11:11.676214 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:11.676858 29375 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.677008 25611 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.678385 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800363380 after lost signal to thread 25719
W20260709 12:11:11.685753 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800101740 after lost signal to thread 25792
I20260709 12:11:11.679404 29453 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.671392 29504 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.671168 29675 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.722110 29612 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.723021 29612 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.646404 29668 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.724869 29567 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.725476 29567 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.726902 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:11.727743 25768 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:11.728475 25657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.268s	user 0.001s	sys 0.058s
I20260709 12:11:11.724255 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.731523 25610 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:11.732637 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:11.722010 25583 connection.cc:256] RPC call timeout handler was delayed by -2.0446134150001853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:11:11.691803 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800108420 after lost signal to thread 26364
I20260709 12:11:11.692176 25763 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:11.692584 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.695390 29692 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.698640 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.687856 29494 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.677796 29718 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.702121 29717 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.703653 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.706027 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:11.707388 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.708923 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:11.709158 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.709930 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.756912 25615 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.711627 25514 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.713565 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:11.719584 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:11.720252 29453 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.758236 25657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.298s	user 0.001s	sys 0.058s
W20260709 12:11:11.739732 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800377f40 after lost signal to thread 26365
I20260709 12:11:11.740293 25759 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
W20260709 12:11:11.759248 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.766974 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.781095 25619 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:11.782768 29628 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.783775 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:11.785013 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:11.785598 25548 debug-util.cc:398] Leaking SignalData structure 0x7b080033fc00 after lost signal to thread 29682
I20260709 12:11:11.785755 25759 raft_consensus.cc:2393] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:11.787223 29281 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.787838 29281 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.790588 29675 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.791344 29675 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.793625 29675 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.794797 29668 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.774755 29658 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.797574 29567 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.799959 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.800668 25767 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 11.
W20260709 12:11:11.800931 25583 connection.cc:256] RPC call timeout handler was delayed by -1.7251134150001235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 12:11:11.801576 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.802377 29494 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.804193 29699 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.804703 29375 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:11.804765 29699 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.805342 29375 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.806676 29447 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.807512 29375 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.807272 29447 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.808044 29375 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:11.808581 29375 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:11.809523 29447 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.811916 29453 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.781283 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.814550 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 52) took 9244 ms. Trace:
I20260709 12:11:11.814824 25765 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:11.815534 29570 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.817440 29612 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.818285 29718 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.821271 29718 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.802201 25767 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:11:11.822394 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 66461.5us
I20260709 12:11:11.823194 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:11.823880 29699 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.824848 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:11.827657 29447 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:11.828051 29447 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.828426 29447 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.831229 25765 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:11.831598 29435 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:11.832207 29435 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.832628 29435 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.774433 29676 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.834957 29676 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.835513 25762 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:11.836585 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:11.836941 25614 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 10: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:11.838267 29680 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.839185 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:11.838974 29680 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.839805 25685 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.841318 29680 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.843006 25689 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.843339 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.843986 25765 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:11.844228 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.844857 25692 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:11.845311 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.844852 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:11.846541 29390 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.846877 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.847122 29390 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.848224 25685 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:11.849620 29390 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.837949 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.850502 25618 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:11:11.841221 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.849740 29689 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.832535 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:11.841964 29680 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.866447 25768 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
I20260709 12:11:11.805905 29494 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:11.790119 29281 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.899116 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.878677 29547 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:11.899884 25687 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:11.900075 29547 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.900893 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:11.887964 25615 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:11:11.890630 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.891258 25764 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:11.891525 29375 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:11.891315 29689 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:11.891988 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 172678us
I20260709 12:11:11.892683 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.894786 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.837180 29676 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.898095 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.918362 25611 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:11.915405 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.898536 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:11.919975 25767 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:11.918876 25693 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:11:11.923527 25694 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:11.929992 25687 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.926769 25760 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 6.
I20260709 12:11:11.933260 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:11.944948 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.951411 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:11.953248 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.951089 25615 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:11.957592 25689 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 12:11:11.964257 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.958178 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:11.987553 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.990139 29547 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:11.990581 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:11.991254 25686 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:11.954874 29281 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:12.008615 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 158837us
W20260709 12:11:12.009021 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 108177us
I20260709 12:11:12.009192 25658 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:12.009222 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 81252.5us
I20260709 12:11:11.954372 29680 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:11.996750 29281 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.015756 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:11.814965 25516 rpcz_store.cc:276] 0709 12:11:02.578950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.581817 (+  2867us) service_pool.cc:224] Handling call
0709 12:11:11.814306 (+9232489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:06.808308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:06.809176 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:06.809228 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:11:06.809254 (+    26us) tablet.cc:662] Decoding operations
0709 12:11:06.809774 (+   520us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:06.809852 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:06.809901 (+    49us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:06.810167 (+   266us) tablet.cc:701] Row locks acquired
0709 12:11:06.810193 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:11:06.810421 (+   228us) write_op.cc:270] Start()
0709 12:11:06.810580 (+   159us) write_op.cc:276] Timestamp: P: 1783599066810350 usec, L: 0
0709 12:11:06.810611 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:11:06.811620 (+  1009us) log.cc:844] Serialized 602 byte log entry
0709 12:11:07.051775 (+240155us) op_driver.cc:464] REPLICATION: finished
0709 12:11:07.219714 (+167939us) write_op.cc:301] APPLY: starting
0709 12:11:07.219826 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:07.219929 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:07.220061 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:07.220281 (+   220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:07.220463 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:11:07.220506 (+    43us) write_op.cc:312] APPLY: finished
0709 12:11:07.220723 (+   217us) log.cc:844] Serialized 22 byte log entry
0709 12:11:07.220902 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.220988 (+    86us) write_op.cc:454] Released schema lock
0709 12:11:07.221040 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:07.221439 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.221470 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6383900,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":167656,"apply.run_cpu_time_us":1719,"apply.run_wall_time_us":1725,"num_ops":1,"prepare.queue_time_us":402355,"prepare.run_cpu_time_us":10018,"prepare.run_wall_time_us":265643,"raft.queue_time_us":1629,"raft.run_cpu_time_us":72745,"raft.run_wall_time_us":101373,"replication_time_us":240916,"spinlock_wait_cycles":46464,"thread_start_us":533186,"threads_started":4,"wal-append.queue_time_us":235645,"wal-append.run_cpu_time_us":4829,"wal-append.run_wall_time_us":1233119}]]}
I20260709 12:11:12.011655 29675 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.024379 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:11.998471 29447 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.026571 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.017612 29281 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.028894 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.027221 25691 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:12.030861 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.031942 25690 pending_rounds.cc:85] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 7
I20260709 12:11:12.032413 25690 pending_rounds.cc:107] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:12.032737 25690 raft_consensus.cc:2889] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.032943 29689 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.022811 29676 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.039208 29676 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:12.039621 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:12.040565 29676 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.041142 29631 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.042608 29547 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:12.042995 29547 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.043313 29547 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:12.044662 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.045459 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.045492 25617 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:12.047789 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.041996 29631 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:12.050520 25611 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:12.055090 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:12.050225 29567 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.057268 25685 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 15. Ops: []
I20260709 12:11:12.065362 25686 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:12.024677 29675 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:12.080389 25732 leader_election.cc:336] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.697s (SENT)
I20260709 12:11:12.080974 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:12.081383 29684 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:12.082423 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.093740 25687 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:12.050120 29631 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.098603 29503 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.099123 29503 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:12.099514 29503 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.099457 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:12.093554 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:12.056933 29447 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.098658 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.091439 29675 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.113065 29565 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:12.115399 29565 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.115772 29565 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:12.116102 29680 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.118451 29684 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:12.113572 25616 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:11:12.083376 29456 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:12.126636 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.128052 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.114977 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.114993 29625 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:11:12.145233 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.147413 25687 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:12.138289 25514 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.149351 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:12.138827 29625 consensus_queue.cc:1243] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:12.152447 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.161851 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:12.170328 29451 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.170861 29451 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.171254 29451 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.171375 29628 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.171949 29628 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.172323 29628 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.159848 29435 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.176721 29435 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.177639 25687 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:12.180124 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.181361 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.181633 29451 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.240917 25514 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:12.244740 25514 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:12.242933 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73930.1us
W20260709 12:11:12.248615 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 78243.1us
W20260709 12:11:12.246030 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62186.4us
I20260709 12:11:12.263022 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.264052 25687 raft_consensus.cc:2410] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 12:11:12.269699 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 102183us
I20260709 12:11:12.278079 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.279157 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.279502 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.278606 25514 catalog_manager.cc:5697] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:12.281625 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.283135 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.284052 29451 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.284330 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:12.285732 29733 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:11:12.286926 25514 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.273988 29281 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.292495 29281 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.294116 29565 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.298532 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:12.300321 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.307087 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.307363 25658 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:12.295284 25514 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:12.323865 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.313814 29375 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:12.326550 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.328548 25514 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:12.328301 29375 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:12.418372 29733 log.cc:927] Time spent T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:11:12.435180 29737 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:11:12.439174 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.491990 25514 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:12.318825 29451 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:12.503412 25732 leader_election.cc:336] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.239s (SENT)
I20260709 12:11:12.504002 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:12.507304 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.508217 25686 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.509034 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.509127 29547 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.509248 25514 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 5 to 6, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 6 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:12.510556 25691 raft_consensus.cc:2368] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14.
I20260709 12:11:12.510104 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.520587 25686 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
W20260709 12:11:12.521775 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.511672 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:12.510551 29494 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:12.501940 29503 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.531591 29503 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.531795 29565 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.535342 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.490293 29375 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.536763 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.537932 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.551123 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:12.552039 25686 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.497323 29451 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.559584 25514 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 9, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.562341 29543 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.563047 29543 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.563421 29543 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.566851 25690 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.567806 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:12.569448 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 258633us
I20260709 12:11:12.576040 25616 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:12.577246 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:12.577837 25616 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.579535 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:12.565987 29547 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.582577 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.586393 25617 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:12.584208 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.590543 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:12.589884 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.591157 25610 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:12.602618 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.644610 25689 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:12.649770 29543 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:12.675139 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.619310 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.676348 25759 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
I20260709 12:11:12.676620 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:12.659197 25515 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 177) took 21340 ms (client timeout 15000 ms). Trace:
I20260709 12:11:12.621409 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:12.643790 29675 consensus_meta.cc:287] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.000s
I20260709 12:11:12.679380 29675 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.679419 25767 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:12.620306 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.623391 25693 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:12.618022 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:12.643775 29494 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.622694 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:12.680661 25687 raft_consensus.cc:2368] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:11:12.682821 29494 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.682423 25614 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:12.684554 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:12.684968 29494 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:12.685091 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.685509 29494 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:12.685693 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:12.646720 29732 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 12:11:12.684161 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.626973 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.623740 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.686468 25694 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.681694 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.619791 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.686923 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.680851 25768 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:12.677230 29543 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
W20260709 12:11:12.681509 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51390.9us
I20260709 12:11:12.626533 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.728792 25687 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.729204 25762 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:12.681210 25767 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:12.695900 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.696841 25616 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:12.718067 25763 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:12.734220 25618 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.749776 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.753490 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.587497 25514 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 9 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:11:12.590039 29736 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:12.782423 25685 raft_consensus.cc:2393] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
I20260709 12:11:12.779152 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.784909 25514 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 9 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 12 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:12.786348 25616 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:12.686067 29494 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.702386 25686 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:12.792824 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.568030 29451 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.704066 29675 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:12.641644 29628 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:12.706161 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.707047 25612 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:12.622952 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.610651 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:12.725658 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:12.708627 25761 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:12.727264 25692 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:12.751441 25760 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
W20260709 12:11:12.616384 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62188us
I20260709 12:11:12.779150 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:12.787724 25514 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:12.791476 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:12.842584 25732 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.442s (SENT)
I20260709 12:11:12.888170 25765 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:12.982781 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:12.983287 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.983981 26303 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:12.984440 25691 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
W20260709 12:11:12.918994 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.904855 25763 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:12.985270 25614 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:12.966173 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.805222 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:12.848230 25610 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:12.986630 25694 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
W20260709 12:11:12.843101 25582 connection.cc:256] RPC call timeout handler was delayed by -3.6321001530000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 12:11:12.986863 25768 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:12.987278 25582 connection.cc:256] RPC call timeout handler was delayed by -3.5151001530000485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:11:12.987723 25766 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 7.
W20260709 12:11:12.987820 25582 connection.cc:256] RPC call timeout handler was delayed by -3.3745196219997524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
I20260709 12:11:12.887681 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:12.988401 25582 connection.cc:256] RPC call timeout handler was delayed by -3.3243001529999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 12:11:12.988833 25762 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:12.988960 25688 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 15: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.986742 25686 raft_consensus.cc:2393] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.989843 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.804252 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.870286 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.843387 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.992686 25693 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:12.867887 29612 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.784895 29697 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:12.780170 29547 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.222s
W20260709 12:11:12.902304 29736 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:11:13.007941 29730 raft_consensus.cc:2804] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.008105 29153 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.008431 29606 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:13.008690 29153 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.009717 29730 raft_consensus.cc:697] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:13.010634 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:12.887281 29602 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.015221 25612 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.020943 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:12.935842 29494 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:13.025170 25611 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:11:12.678975 25515 rpcz_store.cc:269] 0709 12:10:51.113499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.113858 (+   359us) service_pool.cc:224] Handling call
0709 12:11:12.329299 (+21215441us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:03.253527 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:03.254354 (+   827us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:03.254417 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:11:03.254439 (+    22us) tablet.cc:662] Decoding operations
0709 12:11:03.255612 (+  1173us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:03.255734 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:03.255784 (+    50us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:11:03.256754 (+   970us) tablet.cc:701] Row locks acquired
0709 12:11:03.256809 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:11:03.257037 (+   228us) write_op.cc:270] Start()
0709 12:11:03.257220 (+   183us) write_op.cc:276] Timestamp: P: 1783599063256951 usec, L: 0
0709 12:11:03.257246 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:11:03.379314 (+122068us) log.cc:844] Serialized 3281 byte log entry
0709 12:11:03.609346 (+230032us) op_driver.cc:464] REPLICATION: finished
0709 12:11:03.833565 (+224219us) write_op.cc:301] APPLY: starting
0709 12:11:03.833681 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:03.833902 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:03.834063 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:03.879769 (+ 45706us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:03.880128 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:11:03.880204 (+    76us) write_op.cc:312] APPLY: finished
0709 12:11:03.880613 (+   409us) log.cc:844] Serialized 64 byte log entry
0709 12:11:03.880865 (+   252us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:03.881064 (+   199us) write_op.cc:454] Released schema lock
0709 12:11:03.881140 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:03.881739 (+   599us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:03.881784 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53897,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":217184,"apply.run_cpu_time_us":4475,"apply.run_wall_time_us":53114,"num_ops":8,"prepare.queue_time_us":202554,"prepare.run_cpu_time_us":17877,"prepare.run_wall_time_us":198354,"raft.queue_time_us":95452,"raft.run_cpu_time_us":42223,"raft.run_wall_time_us":106078,"replication_time_us":351929,"thread_start_us":411182,"threads_started":4,"wal-append.queue_time_us":97230,"wal-append.run_cpu_time_us":32173,"wal-append.run_wall_time_us":1406712}]]}
I20260709 12:11:13.029414 25514 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.031932 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.028561 25688 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:13.032747 25687 raft_consensus.cc:2368] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:11:13.034225 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:11:13.037403 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 237612us
I20260709 12:11:13.037722 25763 raft_consensus.cc:1240] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.041420 25658 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:13.044160 25612 raft_consensus.cc:1240] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:13.042001 25765 pending_rounds.cc:85] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 3
I20260709 12:11:13.048923 25765 pending_rounds.cc:107] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:13.049216 25765 raft_consensus.cc:2889] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.051450 29606 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:13.054934 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.054940 25611 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:13.056329 25762 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:13.057158 25514 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:13.010774 29730 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:13.060469 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.005887 29612 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.035656 29494 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.061874 25514 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 9, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.063184 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.069276 25689 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:13.070649 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.089212 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.499s (SENT)
I20260709 12:11:13.089041 25514 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:13.054138 29675 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.028481 29602 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.011837 29697 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.099890 25514 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.094822 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:13.095513 25768 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:13.101464 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:13.107383 29153 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.108451 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.109546 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.110569 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.111056 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.112746 25610 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:13.118949 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.119249 29602 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.119747 25617 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:13.119078 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.120704 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.121277 25617 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:13.121556 25618 raft_consensus.cc:1240] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:13.122180 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.122913 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.123602 25619 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:11:13.124557 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.126216 25514 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 7, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 7 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.129005 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.130584 25514 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 4 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.135640 25611 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:13.140704 29697 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.142719 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.142195 25614 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:13.146878 25514 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 8 to 10, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.112028 29675 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:13.151831 25514 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.151610 29749 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.155020 29612 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.158912 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.100731 29451 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.145284 29494 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:13.161388 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.161793 29494 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.162541 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.163861 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.171774 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.172024 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.173118 25615 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 15: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
W20260709 12:11:13.166342 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 121644us
I20260709 12:11:13.162127 25619 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:13.179211 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.179739 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.183007 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.179230 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.185366 25615 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:13.186631 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.187301 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:13.188668 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.189828 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.190639 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 123869us
I20260709 12:11:13.159955 29628 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.192286 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.187737 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 139943us
I20260709 12:11:13.193187 25616 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:13.194518 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.195616 25614 raft_consensus.cc:2393] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:13.188066 25689 raft_consensus.cc:2376] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12. Re-sending same reply.
W20260709 12:11:13.195253 29375 consensus_meta.cc:287] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.003s
I20260709 12:11:13.207086 29675 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.211225 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.212365 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.219218 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.221485 25617 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:13.221378 29547 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:13.221261 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:13.229297 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.231443 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:13.231793 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.217100 29628 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:13.236548 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.234587 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.242192 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.242827 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.243058 25767 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.243496 25612 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:13.212667 29606 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:11:13.231076 29547 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:13.211701 29375 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.244446 29628 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.255162 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.254529 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:13.260154 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.269315 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.275204 25613 raft_consensus.cc:2393] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:13.251672 29676 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:13.277221 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.281564 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.437851 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 159828us
I20260709 12:11:13.458403 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.318672 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.460193 25686 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:13.393334 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.317910 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.265954 29494 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:13.316715 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:13.373338 29759 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.275858 29547 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:13.464494 25759 raft_consensus.cc:1217] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[11.7-16.9]   Dedup: 11.7->[14.8-16.9]
I20260709 12:11:13.465044 25759 pending_rounds.cc:85] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 7
I20260709 12:11:13.465314 25759 pending_rounds.cc:107] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:13.465633 25759 raft_consensus.cc:2889] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.465167 29547 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.318595 29375 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.316717 29628 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.312096 29676 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:13.326222 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.319725 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.284221 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:13.470976 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47386us
I20260709 12:11:13.470945 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:13.469619 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.470626 25690 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:13.480830 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.380252 29658 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.494486 29676 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.498616 29658 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:13.529660 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.525293 25767 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
I20260709 12:11:13.536866 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.537590 25614 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:13.497923 29765 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:13.541568 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67377.1us
I20260709 12:11:13.542114 29765 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.544538 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:11:13.549324 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.557787 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.561076 29451 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:13.553741 29686 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.472189 29759 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.563747 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.564760 25768 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:13.565274 29759 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:13.525064 29375 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:13.565838 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.567070 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.567662 25761 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.568086 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.568701 25685 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:13.570676 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.571408 25764 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.571481 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:13.531555 29675 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:13.599275 29658 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.602726 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:13.606768 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.607697 25612 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:13.620229 25761 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:13.637964 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.629331 29765 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:13.637475 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.646457 29658 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.647537 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.649022 25767 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:13.649415 25766 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.650296 29754 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.336s	user 0.004s	sys 0.001s
W20260709 12:11:13.652364 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 97035.8us
I20260709 12:11:13.658640 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.660071 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.592727 29675 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.672166 29686 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:13.677205 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.677912 25762 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 6.
I20260709 12:11:13.686954 25765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54034 (request call id 2138) took 1002 ms. Trace:
I20260709 12:11:13.688511 25688 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:13.687595 25765 rpcz_store.cc:276] 0709 12:11:12.684548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.016561 (+332013us) service_pool.cc:224] Handling call
0709 12:11:13.035264 (+ 18703us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:13.049919 (+ 14655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.049947 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:13.050562 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:11:13.164602 (+114040us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:13.164644 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.164710 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.600359 (+435649us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:11:13.678513 (+ 78154us) raft_consensus.cc:1685] finished
0709 12:11:13.678574 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.686847 (+  8273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19301,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":9528704,"thread_start_us":113573,"threads_started":1,"wal-append.queue_time_us":263594}
W20260709 12:11:13.691094 29771 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:13.694569 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.696732 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.697389 25761 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:13.697664 25583 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:13.698477 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.698588 29375 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:13.699550 29375 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.699777 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.699972 29375 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.700389 29375 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.700448 25761 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:13.701452 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.702492 29697 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.702714 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.702931 29697 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:13.703559 25768 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:13.703871 29697 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:13.704402 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.705408 25768 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:13.705554 29697 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.706326 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.706943 29775 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:13.707567 25760 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:13.708079 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.708451 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.709533 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.710114 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.694582 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.690124 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.714924 25765 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:13.715866 25760 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:13.716216 25760 pending_rounds.cc:85] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 5
I20260709 12:11:13.716421 25760 pending_rounds.cc:107] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:13.716636 25760 raft_consensus.cc:2889] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:13.719439 25764 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:11:13.702157 25761 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:13.711648 25763 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:13.732115 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.673944 29606 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:13.755072 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.756269 25759 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:13.764294 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.765290 25615 raft_consensus.cc:2468] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
W20260709 12:11:13.769945 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 90347us
W20260709 12:11:13.767652 26304 leader_election.cc:336] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 2.236s (SENT)
I20260709 12:11:13.774798 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.776261 25616 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:13.786585 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.799189 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.697997 29686 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:13.759195 29606 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:13.812475 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.808496 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.817109 25759 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.788686 29628 consensus_queue.cc:1059] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:13.828068 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:13.867856 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.872229 25657 connection.cc:256] RPC call timeout handler was delayed by -3.3290983339998093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
I20260709 12:11:13.880614 25759 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:13.882413 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.883957 25759 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.889669 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.890563 25764 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:13.895131 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.898627 25759 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
W20260709 12:11:13.888411 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 98376.5us
I20260709 12:11:13.959432 25583 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:13.962373 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.963639 25759 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:13.964741 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:13.965739 25759 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:13.967965 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 200368us
I20260709 12:11:13.973187 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:13.978056 25657 connection.cc:256] RPC call timeout handler was delayed by -2.4621100569997907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:11:13.978776 25657 connection.cc:256] RPC call timeout handler was delayed by -2.3280100569998012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 12:11:13.979202 25657 connection.cc:256] RPC call timeout handler was delayed by -2.0949100569998791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 12:11:13.979568 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4253100569999333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2759s for a response
W20260709 12:11:13.979981 25657 connection.cc:256] RPC call timeout handler was delayed by -1.3731100569998489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2817s for a response
I20260709 12:11:13.986970 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:13.993825 25762 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.002576 25768 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:14.002707 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:14.003319 25761 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.008968 25759 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:14.019866 25764 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:14.022758 25763 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:11:14.028741 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 69247.8us
I20260709 12:11:14.031467 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:14.041981 25766 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:14.045658 25761 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
I20260709 12:11:14.034677 29628 raft_consensus.cc:3055] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:14.053215 29628 raft_consensus.cc:740] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:14.053604 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.054288 29628 consensus_queue.cc:260] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:14.055884 29628 raft_consensus.cc:3060] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.056849 29658 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.062449 29765 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.062005 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:14.091516 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.109069 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.091171 29794 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:14.090925 29788 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:14.105116 29675 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.124167 29788 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.101603 29793 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:14.127206 29793 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.127676 29793 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.091346 29785 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:14.091015 29757 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:14.136353 29757 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.089926 29606 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.079802 29759 consensus_queue.cc:1059] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:11:14.204047 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.209131 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 147196us
W20260709 12:11:14.206337 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48183.4us
I20260709 12:11:14.212407 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:14.206372 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 399877us
I20260709 12:11:14.241043 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.241797 25618 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
W20260709 12:11:14.240638 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 153358us
I20260709 12:11:14.204224 29794 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:14.252025 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:14.248258 29765 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.279074 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.281399 25618 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
I20260709 12:11:14.258328 29788 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.223851 29790 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:11:14.281152 29765 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:14.308126 29801 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.312561 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:11:14.315774 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.282404 29757 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.304337 29779 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:11:14.318935 29800 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.334158 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:14.336560 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.334453 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.373085 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:14.382766 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:14.385499 29796 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:11:14.395190 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 148317us
I20260709 12:11:14.345450 29801 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.330623 29799 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:14.479877 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 225741us
W20260709 12:11:14.483325 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.479673 29375 consensus_meta.cc:287] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.005s
W20260709 12:11:14.506520 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.510977 29802 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:14.511216 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.481676 29795 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.514956 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.517292 29800 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.519909 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.520867 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:14.522248 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.511669 29802 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:14.541607 29802 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:14.504742 29759 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.517194 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet 460a9cbf9985461f9237f09b4f5ca854 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
W20260709 12:11:14.543347 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.548569 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:14.548797 25618 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
I20260709 12:11:14.524313 29795 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:14.552644 25619 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:14.554206 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 341864us
I20260709 12:11:14.531699 29800 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:14.515821 29375 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.566675 25732 leader_election.cc:400] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:11:14.567992 25732 leader_election.cc:403] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.551779 29759 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:14.567112 29811 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:14.570988 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45569.6us
I20260709 12:11:14.570571 29814 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 7. Current term is 8.
I20260709 12:11:14.552510 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet 460a9cbf9985461f9237f09b4f5ca854 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-460a9cbf9985461f9237f09b4f5ca854
I20260709 12:11:14.481371 29794 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:14.580017 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 60327.9us
I20260709 12:11:14.584072 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:14.588637 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 84676.5us
I20260709 12:11:14.574518 29759 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.594225 29375 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.619009 25612 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:14.537710 29765 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.620671 29765 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.563836 29802 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:14.602808 29801 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:14.595544 29697 consensus_meta.cc:287] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.005s
I20260709 12:11:14.614078 29776 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:14.617937 25616 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:14.622115 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:14.614945 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44814.4us
I20260709 12:11:14.586964 29795 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.636878 29795 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.593012 29800 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.640044 29800 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.642926 29801 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:14.643458 29801 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:14.644480 29801 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.632444 29778 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:14.652433 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:11:14.653541 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75877.9us
I20260709 12:11:14.596189 29806 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.633076 29697 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.660297 29697 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:14.660786 29697 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.627394 29776 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.661985 29776 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.662735 29790 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.663250 25582 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:14.664628 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.664711 29797 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.659370 29778 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:14.669253 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:14.670022 25614 raft_consensus.cc:606] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:14.670718 25614 raft_consensus.cc:614] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:14.672187 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:14.673164 29778 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:14.646045 29801 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:14.681496 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
W20260709 12:11:14.657685 29785 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.016s
I20260709 12:11:14.688670 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.689666 29802 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:14.690793 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57136.4us
W20260709 12:11:14.661871 29793 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.011s
I20260709 12:11:14.695297 25582 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.709791 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.711120 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.691538 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:14.701714 25614 raft_consensus.cc:606] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:14.712997 25657 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:14.713506 25614 raft_consensus.cc:614] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:14.692582 25583 leader_election.cc:336] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.546s (SENT)
I20260709 12:11:14.714474 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:14.722429 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.734920 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:14.750880 25582 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:14.715945 29797 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.719583 29803 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.754722 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:14.719779 29375 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:14.730938 29676 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:14.746018 29786 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.712680 29793 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.753607 29790 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:14.753314 29805 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.769462 29790 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:14.773066 29790 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:14.760131 29817 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:14.785935 29817 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:14.787317 29817 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.755497 29612 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.789619 29612 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:14.790184 29790 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.757382 29375 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:14.754854 29797 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:14.757155 29803 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:14.790096 29612 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:14.808878 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54198.8us
I20260709 12:11:14.748095 29806 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:11:14.815733 29806 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.816483 29806 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:14.817385 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:14.818032 25612 raft_consensus.cc:606] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:14.818447 25612 raft_consensus.cc:614] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:14.819150 29809 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.316s	user 0.003s	sys 0.000s
W20260709 12:11:14.822851 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.824465 29790 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.831825 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:14.832895 29781 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.765057 29785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59334 (request call id 8) took 7637 ms. Trace:
I20260709 12:11:14.807861 29797 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.833878 29781 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:14.834486 29785 rpcz_store.cc:276] 0709 12:11:07.122400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.123745 (+  1345us) service_pool.cc:224] Handling call
0709 12:11:07.185500 (+ 61755us) log.cc:844] Serialized 513 byte log entry
0709 12:11:14.755962 (+7570462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15534,"raft.queue_time_us":20270,"raft.run_cpu_time_us":2623,"raft.run_wall_time_us":72405,"thread_start_us":66510,"threads_started":1,"wal-append.queue_time_us":179862,"wal-append.run_cpu_time_us":65965,"wal-append.run_wall_time_us":1397817}
I20260709 12:11:14.766172 29786 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.836387 29781 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.839458 29786 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.839684 25629 tablet_copy_source_session.cc:215] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:14.840428 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:14.841037 29813 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:14.841180 25613 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:14.841506 29813 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:14.841941 29813 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.810286 29803 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.758985 29628 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:14.813108 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:14.854868 25582 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.825444 29697 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:11:14.861146 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 110363us
I20260709 12:11:14.807078 29375 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:14.862854 29805 raft_consensus.cc:2764] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:14.858737 29697 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:14.870759 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.869010 25658 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:14.874435 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:14.877689 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 147594us
W20260709 12:11:14.878012 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.867791 29765 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.868232 29790 raft_consensus.cc:2764] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:14.878079 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:14.887058 25760 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:14.882547 29451 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.891508 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:14.894814 29697 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:14.895021 29794 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.895419 29697 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:14.817723 29806 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.888757 29801 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:14.949733 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60293.5us
I20260709 12:11:14.891942 29680 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.891104 29451 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:14.951364 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.959823 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:14.952946 25732 leader_election.cc:336] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.500s (SENT)
I20260709 12:11:14.961059 25688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:14.961699 25688 raft_consensus.cc:606] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:14.966383 29759 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.888480 29765 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:14.974006 25732 leader_election.cc:336] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.565s (SENT)
I20260709 12:11:14.969794 29759 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:14.975032 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.963765 29451 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.955188 29785 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:14.982126 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:14.982416 29793 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.975399 29780 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.986778 29806 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:14.990904 25732 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.794s (SENT)
I20260709 12:11:14.994900 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.992735 29759 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:14.979033 29680 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.003818 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.029372 29680 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.029865 29680 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:15.030315 29680 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.031253 29612 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:14.971297 29801 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.058996 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 68138.8us
W20260709 12:11:15.059953 25732 leader_election.cc:336] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.894s (SENT)
I20260709 12:11:15.060732 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:14.991699 29785 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:15.063493 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59769.9us
I20260709 12:11:15.064797 25612 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.982878 29776 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.065692 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:14.980777 29782 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:14.998735 29794 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:15.064759 29823 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:15.073163 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.079243 29835 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.079917 29835 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:15.080421 29835 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.064221 29676 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.065759 29759 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.069186 29817 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.089944 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.002651 29780 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.106007 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.107851 29780 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:14.998996 29697 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.115720 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 55816.2us
W20260709 12:11:15.116671 25732 leader_election.cc:336] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.914s (SENT)
W20260709 12:11:15.116796 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 223131us
W20260709 12:11:15.121310 25732 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.917s (SENT)
I20260709 12:11:15.121793 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.126034 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:15.127357 25732 leader_election.cc:336] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.933s (SENT)
I20260709 12:11:15.113391 29800 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:15.118360 29785 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.129231 29836 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.130389 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:15.168184 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 94050.7us
W20260709 12:11:15.134861 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46077.3us
I20260709 12:11:15.168820 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:15.113559 29777 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.138733 29801 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:15.177001 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:15.139899 29794 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.119831 29612 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.146571 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:15.182687 25614 raft_consensus.cc:606] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:15.158936 25765 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.177981 25612 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
W20260709 12:11:15.153446 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.159301 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:15.147636 29776 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.186730 25616 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:15.155236 25760 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:15.155573 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:15.158576 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.154817 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:15.188756 25764 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:15.150895 25761 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.160835 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:15.131945 29817 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:15.170151 25583 leader_election.cc:336] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.836s (SENT)
I20260709 12:11:15.191411 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.173213 29842 consensus_queue.cc:1059] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:15.126288 29786 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:15.195729 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.197278 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.197873 25760 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.174206 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:15.174604 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:15.198573 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.174129 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:15.199137 25761 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:15.199100 25762 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:15.175151 25610 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.200726 25762 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.139456 29765 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:15.178586 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:15.178644 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48399.3us
I20260709 12:11:15.203114 25763 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:15.179221 29807 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:15.203873 29807 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:15.186775 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:15.204308 29807 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.204751 25766 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:15.197012 29680 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.154610 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:15.206614 25759 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:15.174141 25613 raft_consensus.cc:2410] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:15.203570 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.208106 29680 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.212257 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.193166 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.213238 25764 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.214025 25765 raft_consensus.cc:2393] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 8: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:15.202112 25762 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:15.222219 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.154893 29676 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:15.142125 29797 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.224174 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 96836.6us
W20260709 12:11:15.227947 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.239081 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 68954.6us
W20260709 12:11:15.240056 25583 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.901s (SENT)
I20260709 12:11:15.240538 25583 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.242075 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:15.146224 29375 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.248762 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45340.9us
I20260709 12:11:15.249482 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:15.249677 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:15.251006 25732 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.938s (SENT)
W20260709 12:11:15.251708 25732 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.938s (SENT)
I20260709 12:11:15.252405 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.253518 29817 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.250541 25658 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:15.169061 29800 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.219252 29785 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.263550 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:15.266211 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:15.264286 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 66315.5us
I20260709 12:11:15.269556 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.270211 25618 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:15.279317 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.241478 29765 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:15.271265 25761 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
W20260709 12:11:15.282737 25583 leader_election.cc:336] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.104s (SENT)
I20260709 12:11:15.288528 25764 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
W20260709 12:11:15.287163 25732 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.065s (SENT)
W20260709 12:11:15.296522 25732 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 2.065s (SENT)
I20260709 12:11:15.298365 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:15.299791 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.151s (SENT)
W20260709 12:11:15.300930 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 2.151s (SENT)
I20260709 12:11:15.301370 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.259343 29777 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.263079 29628 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.266845 29612 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.305663 29759 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.305461 29801 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:15.280323 29840 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 12:11:15.323971 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet b1deffe0cca244839dc0d8c35e1c9292: Illegal state: Replica 04e6206f9e924fb3931891bf3a64b392 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:15.325148 29606 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:15.325906 29606 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:15.326839 29606 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:15.329694 29606 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:15.302485 29846 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.344974 29375 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:15.313557 25583 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.146s (SENT)
I20260709 12:11:15.316756 25760 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
W20260709 12:11:15.319998 25732 leader_election.cc:336] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.160s (SENT)
I20260709 12:11:15.330091 29606 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:15.356071 29606 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.358780 29606 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:15.360927 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:15.361104 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47577.2us
I20260709 12:11:15.363843 29765 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:15.364893 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44854.7us
W20260709 12:11:15.367983 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 98553.5us
W20260709 12:11:15.371336 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.377751 25583 leader_election.cc:336] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.564s (SENT)
I20260709 12:11:15.378250 25583 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.306711 29835 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.335246 29786 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:15.389426 25732 leader_election.cc:336] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Timed out: RequestConsensusVote RPC to 127.23.222.129:43875 timed out after 1.501s (SENT)
W20260709 12:11:15.372534 29803 consensus_meta.cc:287] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.004s
W20260709 12:11:15.383543 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 103192us
I20260709 12:11:15.383937 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.387990 29797 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.389915 25732 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:11:15.382750 25583 leader_election.cc:336] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.614s (SENT)
W20260709 12:11:15.395377 25583 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.629s (SENT)
W20260709 12:11:15.403262 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 122678us
I20260709 12:11:15.404078 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.401602 29803 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.392848 29786 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.447855 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.394851 29375 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.313879 29697 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:11:15.404385 29765 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.446610 29793 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.448534 29786 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.465364 29375 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:11:15.460099 29806 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.448519 29797 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:15.483083 29375 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.396227 29807 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.494660 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 110820us
I20260709 12:11:15.476219 29793 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:15.452627 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.490463 29713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460a9cbf9985461f9237f09b4f5ca854. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:15.494845 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 99671.9us
I20260709 12:11:15.466156 29800 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:15.498834 29451 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.499884 29858 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:15.501238 25657 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.503684 29680 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.463151 29774 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:15.501906 29846 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:11:15.488651 29375 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:15.523880 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 55582.2us
I20260709 12:11:15.484266 29806 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.528697 25611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7414eafc9044de28063237176e3435f"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
W20260709 12:11:15.513023 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60478.7us
I20260709 12:11:15.549458 25611 raft_consensus.cc:606] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:15.479074 29850 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:11:15.533282 29680 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:15.543824 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:15.560240 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:15.561919 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.562704 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:15.522974 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.550011 25611 raft_consensus.cc:614] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:15.515846 29793 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.519030 29797 consensus_queue.cc:1243] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer 04e6206f9e924fb3931891bf3a64b392 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:15.549675 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.566105 25613 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.568135 25687 raft_consensus.cc:2368] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10.
I20260709 12:11:15.569236 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.569617 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:15.575109 25690 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 15: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:15.523614 29854 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.571005 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.571175 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:15.571589 25693 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.571944 29680 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.588626 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.560927 25694 raft_consensus.cc:2376] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:11:15.570338 29853 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:15.563791 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:15.582088 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:15.584774 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.593205 25610 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:15.594035 25610 pending_rounds.cc:85] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 7
I20260709 12:11:15.594303 25610 pending_rounds.cc:107] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 10.8
W20260709 12:11:15.566699 29813 consensus_meta.cc:287] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.003s
I20260709 12:11:15.554404 29781 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.559526 29806 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.548102 29858 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:15.596601 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:15.594722 25610 raft_consensus.cc:2889] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.606531 29803 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.606797 25688 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:15.582304 29801 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:15.608971 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.611550 29858 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.615371 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.595292 25686 raft_consensus.cc:2368] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10.
I20260709 12:11:15.598285 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:15.598605 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.617067 25692 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
W20260709 12:11:15.617375 25583 leader_election.cc:336] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.681s (SENT)
I20260709 12:11:15.599146 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.617817 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.618034 25690 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:15.591429 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.579684 29854 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:15.558413 29776 consensus_queue.cc:1059] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:11:15.615672 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.620370 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:15.622509 25582 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:15.621089 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.626205 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.627228 25768 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.619107 29800 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.631999 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:15.633721 25765 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.621569 25693 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:15.633752 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:15.635731 25583 leader_election.cc:336] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.714s (SENT)
I20260709 12:11:15.635908 25761 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:15.636562 25583 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.760s (SENT)
W20260709 12:11:15.637128 25583 leader_election.cc:336] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.862s (SENT)
I20260709 12:11:15.634074 29797 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.619513 29781 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:15.644220 29781 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.644958 29833 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:15.645438 29833 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:15.633605 29800 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:15.634945 29803 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:15.646235 29833 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.653435 29833 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.650597 29837 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.650697 29800 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:15.655877 25732 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.590s (SENT)
I20260709 12:11:15.656350 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.656745 29786 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.651757 29797 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:15.662490 29801 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:15.662853 29547 raft_consensus.cc:3055] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:15.663239 29547 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:15.663334 29797 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.664242 25732 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.600s (SENT)
I20260709 12:11:15.664175 29547 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.598937 29813 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:15.652063 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet d5b02303361d43d1903c3e943b866b64: Illegal state: Replica 56b5d00aa592407c9d5e67a03a961508 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:15.665691 29547 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.666685 29813 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.651485 29803 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:15.667363 25616 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.670539 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:15.671300 25690 raft_consensus.cc:2368] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12.
I20260709 12:11:15.668372 29803 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.664767 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:15.651764 29765 raft_consensus.cc:2764] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:15.679163 29801 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.672290 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:15.601004 29853 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:15.599236 29697 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:15.619159 29854 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.688898 29794 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:15.638971 29680 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.716693 29451 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.595647 29375 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.734127 29853 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.704550 29697 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.736294 29697 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.714527 29835 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.751468 29793 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.754797 29793 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:15.745687 29836 consensus_meta.cc:287] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.004s
I20260709 12:11:15.769552 29800 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.772677 29800 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:15.775182 29836 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:15.766013 29806 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.828771 29806 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.780382 29786 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:15.831314 29777 consensus_meta.cc:287] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 12:11:15.842578 29777 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.858180 29697 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.860900 29854 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.863111 29854 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.866014 29697 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.868924 29713 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60616 (request call id 160) took 4385 ms. Trace:
I20260709 12:11:15.869429 29713 rpcz_store.cc:276] 0709 12:11:11.483910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.484222 (+   312us) service_pool.cc:224] Handling call
0709 12:11:11.541421 (+ 57199us) ts_tablet_manager.cc:934] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
0709 12:11:15.405524 (+3864103us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:15.845444 (+439920us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:15.845771 (+   327us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:15.865437 (+ 19666us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:15.868360 (+  2923us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:15.868745 (+   385us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:15.868818 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":299,"tablet-copy.queue_time_us":41542,"thread_start_us":107333,"threads_started":2}
I20260709 12:11:15.871217 29713 tablet_copy_client.cc:806] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:15.871912 29713 tablet_copy_client.cc:670] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:15.994922 29807 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:15.997370 29817 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.997956 29817 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.000801 29817 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:16.008545 29807 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:16.009600 29781 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.010085 29781 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:16.011122 29781 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.012467 29781 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.017762 25516 catalog_manager.cc:5697] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 5 to 7, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 7 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.025853 29846 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:16.035418 25583 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.954s (SENT)
I20260709 12:11:16.036036 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:16.063925 25516 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.085207 29794 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:16.086339 29794 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:16.091495 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 56119.1us
W20260709 12:11:16.092752 25583 leader_election.cc:336] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.967s (SENT)
W20260709 12:11:16.093677 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.094564 29856 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.096952 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.098690 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:16.100983 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.101765 25613 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:16.102515 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:16.106730 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:16.107410 25613 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.107251 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:16.107964 29800 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.108517 29800 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.109179 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:16.110324 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.110648 29800 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:16.113143 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:16.114053 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.115451 25617 raft_consensus.cc:2410] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:16.111248 29800 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.115224 29856 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.125751 29697 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:16.128036 29697 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.119129 29800 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.132403 29697 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:16.135080 29800 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:16.137290 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.141193 25613 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
W20260709 12:11:16.143256 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.140384 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.144932 25617 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:16.144997 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.145915 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.146021 29862 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:16.151919 25617 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:16.152385 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.152731 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.153543 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.153784 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.158113 25617 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:16.165488 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.165833 25611 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:16.169346 29800 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.169921 29800 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.172484 29800 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:16.173700 25762 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:16.174103 25762 pending_rounds.cc:85] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 7
I20260709 12:11:16.174389 25762 pending_rounds.cc:107] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:16.174646 25762 raft_consensus.cc:2889] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:16.176653 25693 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:16.177625 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.178277 25767 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.185524 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.186650 25762 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.168565 25611 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:16.209213 29854 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:16.210215 25763 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:16.211274 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.004s
W20260709 12:11:16.211637 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.011s	sys 0.004s
I20260709 12:11:16.147851 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:16.148249 25658 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:16.213011 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 64859.8us
I20260709 12:11:16.214879 25759 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:16.215981 29835 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.216526 29835 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:16.217406 29835 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.211486 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:16.228768 25768 consensus_meta.cc:287] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.007s
I20260709 12:11:16.229756 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.229969 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.231005 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.229305 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.232280 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.233028 25692 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:16.229261 25768 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
W20260709 12:11:16.233997 25765 consensus_meta.cc:287] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.001s
I20260709 12:11:16.235790 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.245501 25686 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.250521 25767 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:16.253008 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.253679 25766 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:16.255808 25686 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:16.256803 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:16.236585 25761 consensus_meta.cc:287] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.003s
I20260709 12:11:16.241616 29793 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:16.258211 25761 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:16.236778 25689 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:16.260222 25765 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:16.260527 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.261679 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.270825 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.271612 25689 raft_consensus.cc:2368] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10.
I20260709 12:11:16.272614 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.235067 25693 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:16.237505 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.275118 25692 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 15: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:16.227115 25763 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:16.238775 25688 raft_consensus.cc:1240] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:16.240265 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.243005 25687 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.278218 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.283185 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.288713 25762 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:16.294847 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.293246 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.296759 25692 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:16.298708 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.299880 25688 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 15: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:16.293570 25686 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:16.301363 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.301297 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.302055 25686 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.307428 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.309571 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.311650 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.323676 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.324826 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.325080 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.325891 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.326166 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.326736 25691 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.331355 25766 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:16.331355 25686 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:16.338296 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:16.341302 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:16.349272 25768 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:16.350908 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:16.351176 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:16.351796 25768 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:16.351903 25688 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:16.352064 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:16.353001 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.353106 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:16.354529 25762 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:16.355173 25761 raft_consensus.cc:2410] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:16.353320 25688 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:16.355891 25762 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:16.357473 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.358801 25686 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:16.359324 25768 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:16.360258 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.330250 25687 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:16.363060 25762 raft_consensus.cc:1240] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.364346 25689 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:16.390709 25688 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.393394 25685 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:16.394596 25767 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:16.398689 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.399767 25657 connection.cc:256] RPC call timeout handler was delayed by -1.4322658770001908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:11:16.400512 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:16.401458 29855 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.402519 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.403779 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.406441 25685 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.408253 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.409212 25685 raft_consensus.cc:2393] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 8: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:16.410437 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.411832 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.413455 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.415354 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.416847 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.418329 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.418913 25687 raft_consensus.cc:1240] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:16.419745 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.420542 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.421777 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.422650 25686 raft_consensus.cc:2393] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 10: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:16.425243 25694 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:16.426720 25694 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:16.428210 25692 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:16.429029 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.425098 29864 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:16.439836 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.432920 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.436081 25691 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:16.432289 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:16.444487 25686 raft_consensus.cc:2393] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:16.446686 29451 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:16.452425 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.453524 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.453733 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.454360 25763 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.456665 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.457412 25762 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.459571 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:16.461251 25768 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:16.472019 25767 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.473448 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.475231 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.497439 25762 raft_consensus.cc:2410] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:16.446759 29864 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:16.469861 29855 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.470079 29836 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:11:16.525665 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48790.2us
I20260709 12:11:16.531422 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.535137 29864 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:16.535977 29807 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:16.539160 25763 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:16.541357 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.546893 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.569965 29777 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.555065 29889 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.600015 29892 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.600876 29889 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.603165 29888 raft_consensus.cc:493] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:16.607756 29888 raft_consensus.cc:515] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:16.610574 29894 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:16.604868 29777 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:16.611188 29894 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:16.612376 29888 leader_election.cc:290] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:16.613988 29894 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:16.615566 25506 maintenance_manager.cc:419] P 522441a6317141cea1e624f44af51018: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033495
W20260709 12:11:16.703485 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 156661us
I20260709 12:11:16.731392 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:16.732615 25657 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:16.728793 29887 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:11:16.737999 25657 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:16.743170 29891 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:16.727209 29896 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:16.743067 29898 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.734596 29836 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:16.749807 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 1.06066e+06us
W20260709 12:11:16.750520 25732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.140s (SENT) [suppressed 82 similar messages]
I20260709 12:11:16.752672 25759 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:16.746095 29889 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:16.757651 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:16.758345 25688 raft_consensus.cc:2376] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13. Re-sending same reply.
I20260709 12:11:16.760329 25759 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:16.761821 29898 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:16.760020 29777 raft_consensus.cc:993] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:16.773036 29807 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.773491 29807 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:16.778777 29807 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.780110 29807 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.764029 29896 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:16.792502 29896 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:16.792980 29896 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:16.768270 29781 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:16.770134 29898 raft_consensus.cc:697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:16.794440 29781 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:16.795100 29898 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.795383 29781 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.796592 29781 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.799067 25688 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:16.793876 29896 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.810588 29896 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.783522 29901 raft_consensus.cc:1081] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:16.827585 29807 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:16.830153 25762 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:16.836015 25762 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:16.859999 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:16.860841 29375 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.867048 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:16.868400 25762 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:16.868885 25762 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.823346 29777 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 12:11:16.878695 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.899871 29901 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:16.901324 29801 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:16.902098 29801 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:16.902661 29901 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:16.905009 25762 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:16.922984 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:16.932406 25582 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:16.906087 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:16.938213 25762 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:16.937402 29697 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:16.941586 25582 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:16.942553 25582 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:16.946749 29800 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:16.947438 29800 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:16.905373 29801 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:16.940248 29831 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:17.044700 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 129526us
W20260709 12:11:17.045893 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 103405us
I20260709 12:11:17.046368 29914 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:17.047405 25582 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:17.042299 29903 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:17.042716 29781 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.056795 29914 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:17.063037 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:17.061815 29916 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:17.071872 29835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.007s	sys 0.008s
I20260709 12:11:17.062561 29781 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.087962 29914 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.088773 29781 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:17.081522 25761 pending_rounds.cc:85] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 6
I20260709 12:11:17.089581 25761 pending_rounds.cc:107] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:17.089898 25761 raft_consensus.cc:2889] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.090121 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:17.091078 25763 raft_consensus.cc:2410] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:17.099066 29831 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:17.102499 29680 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.102870 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:17.103422 29680 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:17.085912 29835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.009s	sys 0.009s
I20260709 12:11:17.091872 29800 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:17.109351 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:17.106633 29916 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:17.106416 29917 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:17.141450 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.142027 29856 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:17.142529 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.142696 29856 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:17.144744 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:17.146063 25688 raft_consensus.cc:2410] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:17.143754 29856 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.101321 29831 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:17.153030 25583 leader_election.cc:336] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.570s (SENT)
I20260709 12:11:17.157199 29856 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.158454 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:17.139077 29919 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.152981 29697 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:17.167234 25583 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.589s (SENT)
I20260709 12:11:17.134119 29800 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:17.153724 29917 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:17.177228 29680 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:17.159775 29375 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:17.175784 25614 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:11:17.180778 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 78032.2us
I20260709 12:11:17.182209 29916 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.187193 29915 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:17.191898 29922 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.192467 29922 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.175537 29917 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:17.179654 29919 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:17.178793 29920 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.206665 29920 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:17.191920 29915 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.191021 29914 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:17.206799 29919 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.243046 29929 consensus_queue.cc:1059] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:11:17.333709 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 137919us
I20260709 12:11:17.471271 29928 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.472186 29928 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:17.475534 29930 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:11:17.479508 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:17.480620 25612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1703) took 1384 ms. Trace:
I20260709 12:11:17.480949 25612 rpcz_store.cc:276] 0709 12:11:16.096058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.479086 (+1383028us) service_pool.cc:224] Handling call
0709 12:11:17.480545 (+  1459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:17.567721 29928 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:17.568894 29928 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:17.584308 29928 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:17.609794 29928 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.391765 29922 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:17.240295 29914 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.019878 29928 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.020917 29914 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:18.059983 25582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.008s	sys 0.016s
W20260709 12:11:18.060642 25582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.009s	sys 0.016s
W20260709 12:11:17.944711 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 564351us
I20260709 12:11:18.075649 25583 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:18.074379 29929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.000s	sys 0.014s
I20260709 12:11:18.077104 29915 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:18.079182 29935 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:11:18.086052 29938 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:11:18.082211 29929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.000s	sys 0.015s
W20260709 12:11:18.081629 29916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.014s	sys 0.032s
I20260709 12:11:18.101665 29939 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.102277 29939 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.103468 29939 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.089751 29938 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:18.099071 29935 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.110176 29939 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.112924 29938 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:18.116076 25611 consensus_meta.cc:287] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 1.907s	user 0.017s	sys 0.006s
W20260709 12:11:18.099548 29916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.015s	sys 0.033s
W20260709 12:11:18.120723 25760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54034 (request call id 2178) took 1936 ms (client timeout 1852 ms). Trace:
W20260709 12:11:18.130836 25760 rpcz_store.cc:269] 0709 12:11:16.184295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.120459 (+1936164us) service_pool.cc:211] Skipping call since client already timed out
0709 12:11:18.120612 (+   153us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:11:18.134164 25614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1700) took 2039 ms (client timeout 1585 ms). Trace:
W20260709 12:11:18.143028 25614 rpcz_store.cc:269] 0709 12:11:16.095133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.098477 (+  3344us) service_pool.cc:224] Handling call
0709 12:11:18.133909 (+2035432us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540008dc54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:18.134056 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2355191040}
W20260709 12:11:18.143784 29917 consensus_meta.cc:287] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.936s	user 0.012s	sys 0.000s
I20260709 12:11:18.139801 25766 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:18.144240 29917 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.150732 29917 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.159317 25611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 292) took 2010 ms. Trace:
W20260709 12:11:18.161666 29918 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 1.064s	user 0.012s	sys 0.013s
I20260709 12:11:18.160183 25611 rpcz_store.cc:276] 0709 12:11:16.149165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.167979 (+ 18814us) service_pool.cc:224] Handling call
0709 12:11:16.168232 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.168438 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:18.124714 (+1956276us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.158471 (+ 33757us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.158800 (+   329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.158869 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:18.158938 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.159038 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.159217 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9781,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":246,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":237,"thread_start_us":32378,"threads_started":2,"wal-append.queue_time_us":21044}
W20260709 12:11:18.180501 29803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.001s	sys 0.011s
W20260709 12:11:18.181128 29803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.001s	sys 0.011s
I20260709 12:11:18.144670 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2159) took 1778 ms. Trace:
I20260709 12:11:18.183715 25766 rpcz_store.cc:276] 0709 12:11:16.366651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.139036 (+1772385us) service_pool.cc:224] Handling call
0709 12:11:18.139419 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.144362 (+  4943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.144608 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:18.082736 29936 consensus_queue.cc:1059] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:18.186174 29939 raft_consensus.cc:3055] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:18.186223 29919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.003s	sys 0.001s
I20260709 12:11:18.186687 29939 raft_consensus.cc:740] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:18.186959 29919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.003s	sys 0.001s
I20260709 12:11:18.187561 29939 consensus_queue.cc:260] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.188930 29939 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:18.190485 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 114909us
I20260709 12:11:18.195041 25583 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:18.197160 29941 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:18.199275 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecbc0 after lost signal to thread 24442
W20260709 12:11:18.199697 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08003a46c0 after lost signal to thread 24445
I20260709 12:11:18.201000 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:18.206373 29941 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.207300 29941 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.208281 29941 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.208758 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2694) took 2988 ms. Trace:
I20260709 12:11:18.209163 25616 rpcz_store.cc:276] 0709 12:11:15.220613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.220921 (+   308us) service_pool.cc:224] Handling call
0709 12:11:15.221501 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.669411 (+447910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.208465 (+2539054us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54003a7d54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:18.208691 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024931712}
I20260709 12:11:18.214745 29919 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:18.217128 29919 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:18.221370 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:18.222190 29919 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.222608 29919 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:18.222986 29919 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:18.233692 25789 debug-util.cc:398] Leaking SignalData structure 0x7b0800380be0 after lost signal to thread 24445
I20260709 12:11:18.233848 29939 consensus_queue.cc:1059] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:18.234849 29936 raft_consensus.cc:3055] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.235338 29936 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.236351 29936 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.237855 29936 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:18.239848 25615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.080s	user 0.047s	sys 0.071s
W20260709 12:11:18.240470 25615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.080s	user 0.048s	sys 0.072s
I20260709 12:11:18.241355 25615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2714) took 2141 ms. Trace:
I20260709 12:11:18.241707 25615 rpcz_store.cc:276] 0709 12:11:16.100300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.157814 (+ 57514us) service_pool.cc:224] Handling call
0709 12:11:16.158085 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.159166 (+  1081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.159200 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.159709 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.240964 (+2081255us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:18.241010 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.241081 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.241133 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:18.241147 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.241292 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":2080833,"threads_started":1,"wal-append.queue_time_us":366542,"wal-append.run_cpu_time_us":4100,"wal-append.run_wall_time_us":1054467}
W20260709 12:11:18.235178 25789 debug-util.cc:398] Leaking SignalData structure 0x7b0800082a20 after lost signal to thread 25551
W20260709 12:11:18.245185 25789 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5c00 after lost signal to thread 25643
W20260709 12:11:18.245393 25789 debug-util.cc:398] Leaking SignalData structure 0x7b08001a5ba0 after lost signal to thread 25644
I20260709 12:11:18.253336 25760 raft_consensus.cc:1240] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:18.255741 29915 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:18.256327 29915 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.259012 25766 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.237865 29919 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.239740 25583 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:18.262147 29915 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:18.262845 29936 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.262867 29915 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.263638 29936 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.263813 29915 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:18.268879 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.269317 29938 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.269902 29938 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.270867 29929 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.271010 25766 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:18.270941 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.271756 25763 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:18.271541 29929 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.272749 29938 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.270355 29915 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:18.273303 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.268711 29803 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:18.284626 25618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.116s	user 0.003s	sys 0.023s
W20260709 12:11:18.285164 25618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.117s	user 0.004s	sys 0.023s
I20260709 12:11:18.284134 29803 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.288187 29803 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.270345 29928 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.290040 29928 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.292711 29928 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:18.269914 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.275799 29929 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.286028 25618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1718) took 2178 ms. Trace:
I20260709 12:11:18.294454 25618 rpcz_store.cc:276] 0709 12:11:16.107516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.166663 (+ 59147us) service_pool.cc:224] Handling call
0709 12:11:16.166978 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.167198 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.167224 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.167784 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.285619 (+2117835us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.285670 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.285751 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.285793 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:18.285805 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.285969 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2117392,"threads_started":1,"wal-append.queue_time_us":122740,"wal-append.run_cpu_time_us":1903,"wal-append.run_wall_time_us":1009812}
I20260709 12:11:17.163524 29856 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.299641 29856 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.301296 29936 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:18.311722 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.311882 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59925.5us
I20260709 12:11:18.313998 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.314577 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.314754 25761 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:18.315423 25763 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:18.316387 29929 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.316844 29917 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.175343 29800 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.316926 29929 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.317481 29917 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.319211 29800 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:18.319211 29929 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.320881 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.333242 25763 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:18.334841 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.321987 29939 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.337359 29939 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.322242 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.338359 29917 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.338619 25761 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 8.
I20260709 12:11:18.323218 25766 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:18.341770 29939 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.323786 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.344544 25760 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:18.299679 29919 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.327266 29941 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:18.327937 29901 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.329757 29916 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:18.349956 29901 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.350911 29807 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.351473 29807 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.352466 29901 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.353240 29901 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:18.353672 29807 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.354291 29807 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.353791 29901 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:18.354748 29807 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.356504 29901 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:18.356705 29807 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.330376 29606 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:18.330583 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.358955 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:18.364671 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.366329 29936 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.366819 29936 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:18.367290 29936 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.367619 29800 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.368153 29800 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.369441 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.369807 29888 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.370229 29939 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:18.370456 29916 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.370685 29939 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.371109 29916 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.371538 29916 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.371846 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.371367 29939 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.373854 29917 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.374243 29917 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.366974 29606 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.374624 29917 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.376379 29606 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.370472 29888 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.377885 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2181) took 1450 ms. Trace:
I20260709 12:11:18.382575 25759 rpcz_store.cc:276] 0709 12:11:16.927873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.929749 (+  1876us) service_pool.cc:224] Handling call
0709 12:11:16.939583 (+  9834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.061339 (+121756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.061374 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.066235 (+  4861us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.179827 (+113592us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:17.179891 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.180002 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.377534 (+1197532us) raft_consensus.cc:1685] finished
0709 12:11:18.377564 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.377776 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16772,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":78464,"thread_start_us":192291,"threads_started":2,"wal-append.queue_time_us":282328}
I20260709 12:11:18.380038 29888 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:18.391021 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.391757 25764 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:18.391706 29800 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:18.379096 25582 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.385463 29916 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.394816 29920 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.395942 29920 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.384338 29917 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.396342 29916 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.396354 29920 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.396327 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.397943 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.398698 29941 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:18.399082 29941 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.399421 29941 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:18.400038 29917 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.400485 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.401388 29917 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:18.402071 29917 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.396531 29919 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:11:18.403035 29917 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:18.393270 29939 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.411940 29939 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.413237 29920 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:18.414498 25657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.250s	user 0.013s	sys 0.011s
W20260709 12:11:18.414986 25657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.013s	sys 0.011s
W20260709 12:11:18.415297 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 1.26326e+06us
I20260709 12:11:18.415529 29920 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.416235 29917 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.388469 29936 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:18.419497 29936 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:18.420079 29917 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.423717 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.428372 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:18.434144 29940 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.434816 29940 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.438591 29940 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.439422 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.440158 25760 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:18.441231 25618 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:18.441649 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.441972 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.442368 25760 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 7.
I20260709 12:11:18.442670 25766 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:18.443246 25618 raft_consensus.cc:1240] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.444766 25618 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.445396 25610 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:18.445542 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.446041 25610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59338 (request call id 288) took 2354 ms. Trace:
I20260709 12:11:18.446239 25618 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.446431 25610 rpcz_store.cc:276] 0709 12:11:16.091903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.444818 (+2352915us) service_pool.cc:224] Handling call
0709 12:11:18.445145 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.445792 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.445990 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:17.178838 29697 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.449678 25615 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:18.449510 29697 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.450872 25616 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:18.451360 25614 raft_consensus.cc:1240] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:18.450043 25615 pending_rounds.cc:85] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 5
I20260709 12:11:18.451828 25615 pending_rounds.cc:107] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:18.452108 25615 raft_consensus.cc:2889] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.452488 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:18.447412 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.453125 25614 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:18.453677 29846 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.454159 29846 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.459226 29846 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.470362 25619 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:18.474092 29831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.296s	user 0.008s	sys 0.005s
W20260709 12:11:18.474649 29831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.297s	user 0.010s	sys 0.005s
I20260709 12:11:18.453421 25768 raft_consensus.cc:2410] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:11:18.496124 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.497196 29858 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:18.497763 29858 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.500442 29858 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.501784 29777 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:18.502332 29777 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:18.504153 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08003856c0 after lost signal to thread 25516
I20260709 12:11:18.504853 29777 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:18.505797 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 107920us
I20260709 12:11:18.508239 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:11:18.509112 26338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45784 (request call id 112) took 1885 ms (client timeout 1886 ms). Trace:
W20260709 12:11:18.509519 26338 rpcz_store.cc:269] 0709 12:11:16.623415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.507811 (+1884396us) service_pool.cc:224] Handling call
0709 12:11:18.509047 (+  1236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:18.510890 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.511567 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.511969 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.512178 25766 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:18.512733 25761 raft_consensus.cc:2410] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:18.514945 29846 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.515453 29846 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.517598 29846 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.518450 29846 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.518926 29846 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.520907 29846 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.521795 25767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2184) took 1592 ms. Trace:
I20260709 12:11:18.522186 25767 rpcz_store.cc:276] 0709 12:11:16.929158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.930722 (+  1564us) service_pool.cc:224] Handling call
0709 12:11:16.939554 (+  8832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.957656 (+ 18102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.958123 (+   467us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.014961 (+ 56838us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.097571 (+ 82610us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:17.097622 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.097710 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.161051 (+1063341us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:11:18.521499 (+360448us) raft_consensus.cc:1685] finished
0709 12:11:18.521523 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.521733 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16735,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":19081344,"thread_start_us":54779,"threads_started":2,"wal-append.queue_time_us":40851}
I20260709 12:11:18.524544 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.524924 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.525535 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.539325 25763 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.539534 25768 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.540343 25764 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:18.533739 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.543628 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.542590 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.545693 25767 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.559696 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.588178 25763 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:18.411115 29941 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.594334 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.596192 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.596984 25765 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:18.594235 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:18.598044 25763 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.599769 25767 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:18.599985 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.560099 29949 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:18.604377 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.614805 25691 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:18.616190 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.618183 25763 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:18.604830 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.605937 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.620990 25690 raft_consensus.cc:2376] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15. Re-sending same reply.
I20260709 12:11:18.595952 29846 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.606999 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.607849 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.608247 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.608968 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.609750 25768 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:18.591629 29892 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:18.622179 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.607074 25688 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:18.633981 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.635123 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.635217 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.636171 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.636245 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.636842 25688 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:18.622817 25764 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:18.619398 25582 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.617838 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.638553 25691 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.620436 25692 raft_consensus.cc:2376] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10. Re-sending same reply.
I20260709 12:11:18.596601 29777 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:18.616600 29807 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.632421 25686 raft_consensus.cc:2376] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12. Re-sending same reply.
I20260709 12:11:18.593050 29836 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.616901 29606 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.626197 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.642639 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.649685 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.649968 25685 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:18.616452 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:18.652586 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.616766 29901 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.616362 29785 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:18.647682 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:18.655982 25691 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
W20260709 12:11:18.623222 29786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.442s	user 0.030s	sys 0.069s
I20260709 12:11:18.651124 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.646284 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:18.649820 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:18.659278 25691 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.664738 25686 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:18.668759 25765 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:18.641697 29680 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.645516 29919 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.656710 29713 tablet_copy_client.cc:538] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:18.647580 29856 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.654522 29836 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.658751 29785 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:18.654107 29777 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:18.658892 29606 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.697549 29939 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:18.662954 29901 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.705017 29606 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.705595 29606 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.672761 29917 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:18.706607 29917 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.707571 29917 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.641911 29846 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.674882 29950 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:11:18.642053 29892 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:17.184466 29375 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.716542 29375 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.720065 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.687844 29713 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:18.740728 25765 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:18.666107 29786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.479s	user 0.030s	sys 0.070s
I20260709 12:11:18.697376 29916 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:18.703940 25694 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:18.656977 29807 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.752396 25765 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:18.620252 29949 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:18.739221 25764 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:18.705921 29901 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:18.748020 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 113842us
I20260709 12:11:18.714099 29836 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.697345 29785 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.673945 29680 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.696146 29919 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:18.757943 29916 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.764077 29807 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.716495 29892 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.766623 25685 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.706018 29606 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.697495 29856 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.777261 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.706620 29939 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:18.786794 29606 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.796973 29949 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:18.799212 29777 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.800055 29846 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.803490 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.804250 25762 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:18.804306 29941 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.792449 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:18.823546 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 264318us
I20260709 12:11:18.834152 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:18.797859 29919 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.840556 29898 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.841068 29898 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:18.842344 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 51601.6us
I20260709 12:11:18.842592 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:18.855227 29846 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.855719 29858 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.855885 29846 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:18.856171 29858 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.856323 29846 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.856575 29858 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.860813 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.861593 25762 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:18.840123 29963 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.907898 25759 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.864209 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:18.891186 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55019.1us
I20260709 12:11:18.942425 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.905349 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.944526 25760 raft_consensus.cc:2410] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:18.944798 29969 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:18.944985 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.941073 29963 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.946007 29730 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:18.902922 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.949499 29730 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:18.950486 29730 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:18.951985 29730 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.907475 25768 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.911991 29856 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:18.962204 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.922222 25583 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:18.893712 29785 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.903411 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.965832 29917 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.966310 29917 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.966704 29917 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.952832 29963 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.902148 29898 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.985632 29917 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:18.955061 29922 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.959497 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.047191 29922 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.047475 25765 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:19.048637 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.049113 29680 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.051626 29966 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.052160 25687 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:19.052183 29966 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.051748 29680 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:18.946938 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.054652 29966 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:18.964133 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:19.055971 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 91871.7us
I20260709 12:11:19.056279 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.057237 25759 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:18.995409 29846 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:19.001240 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.057642 25583 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.058136 25766 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:19.059131 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.059679 25766 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.060385 29916 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.061018 29916 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.006456 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.062562 25762 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:19.065975 25583 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.066977 29375 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.069679 29939 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:19.070297 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:19.061748 29916 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:19.072026 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:18.990144 29785 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.010540 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:18.985971 25619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53302 (request call id 2700) took 3440 ms. Trace:
I20260709 12:11:19.011571 29853 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:19.012010 29855 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:19.075055 25768 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:19.075335 29855 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.076257 25768 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:19.076620 25768 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:19.007284 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:19.077491 29855 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.012468 29451 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:19.077354 25768 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.014168 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.078655 25614 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:19.078229 29451 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:19.080026 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.075075 29853 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.081228 29846 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:19.074847 25619 rpcz_store.cc:276] 0709 12:11:15.545241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.545395 (+   154us) service_pool.cc:224] Handling call
0709 12:11:15.545752 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.470944 (+2925192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.985650 (+514706us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b54001e05d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:18.985864 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6720652160}
I20260709 12:11:19.082477 29451 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:19.082777 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:19.019423 26334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45784 (request call id 111) took 2409 ms (client timeout 1597 ms). Trace:
W20260709 12:11:19.018429 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 2.26776e+06us
W20260709 12:11:19.083599 26334 rpcz_store.cc:269] 0709 12:11:16.610223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.019216 (+2408993us) service_pool.cc:211] Skipping call since client already timed out
0709 12:11:19.019330 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:11:19.019878 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 490526us
I20260709 12:11:19.029141 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:19.084455 29853 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.084702 25690 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:19.085868 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.086349 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:19.029458 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.087419 25689 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:19.030440 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.088498 25610 raft_consensus.cc:2410] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:19.089419 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.089564 29919 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.031554 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.090014 29919 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.090278 29451 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:19.090158 25583 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.091199 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.091984 29803 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.092057 29853 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.092396 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.092689 29853 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.093456 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.093628 29853 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.091219 29919 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.094907 29853 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.090013 25610 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:19.032120 25611 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:19.032460 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.033075 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.033753 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.030323 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.034466 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:19.035704 25789 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb940 after lost signal to thread 25718
W20260709 12:11:19.098879 25789 debug-util.cc:398] Leaking SignalData structure 0x7b0800340fe0 after lost signal to thread 25719
I20260709 12:11:19.098172 29966 consensus_queue.cc:1059] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:19.098592 25615 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:19.038806 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.099857 29855 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.100251 29855 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.100343 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:19.101172 29855 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.042554 25640 debug-util.cc:398] Leaking SignalData structure 0x7b0800119da0 after lost signal to thread 25551
I20260709 12:11:19.102015 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:19.102671 25640 debug-util.cc:398] Leaking SignalData structure 0x7b0800150080 after lost signal to thread 25571
I20260709 12:11:19.046559 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.048254 29922 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.035279 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.103302 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.104745 25618 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:19.105499 25611 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.105847 25618 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.106318 29855 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.106777 25611 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:18.960340 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.108685 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.109408 25760 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:18.962044 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:19.109409 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08000dca00 after lost signal to thread 25643
W20260709 12:11:19.110675 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08000dca40 after lost signal to thread 25644
I20260709 12:11:19.111397 25613 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:19.112037 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08001a0da0 after lost signal to thread 25718
W20260709 12:11:19.113384 25640 debug-util.cc:398] Leaking SignalData structure 0x7b0800354e00 after lost signal to thread 25792
W20260709 12:11:19.113646 25640 debug-util.cc:398] Leaking SignalData structure 0x7b080025b7a0 after lost signal to thread 25793
I20260709 12:11:19.113907 25761 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:19.120656 29893 consensus_queue.cc:1059] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:19.054028 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.122105 29893 raft_consensus.cc:3055] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:19.122545 29893 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.082523 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.124073 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:19.125125 29893 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:15.594406 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:19.128099 26304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.084164 25732 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.170s (SENT)
W20260709 12:11:19.129624 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45491.3us
W20260709 12:11:19.130311 25732 leader_election.cc:336] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.190s (SENT)
I20260709 12:11:19.130939 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 53) took 6624 ms. Trace:
W20260709 12:11:19.131240 25732 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 2.204s (SENT)
I20260709 12:11:19.131911 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.031709 25686 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:19.134680 29901 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.094884 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:18.949337 29858 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.036082 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.098592 25767 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:19.114943 29966 consensus_queue.cc:1059] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:19.136653 29966 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.136771 29901 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.137034 29966 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.115350 25764 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:19.115994 25760 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:19.137094 25767 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:19.137779 29858 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.138870 25760 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:19.138994 25767 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:19.117825 29922 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.049224 25765 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.141403 25760 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:19.117262 29950 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:19.120639 25640 debug-util.cc:398] Leaking SignalData structure 0x7b0800398b20 after lost signal to thread 26364
W20260709 12:11:19.142479 25640 debug-util.cc:398] Leaking SignalData structure 0x7b08001432e0 after lost signal to thread 26365
W20260709 12:11:19.142927 25640 debug-util.cc:398] Leaking SignalData structure 0x7b080035af40 after lost signal to thread 29715
I20260709 12:11:19.118691 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.143862 25616 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:19.011147 29898 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.120925 29949 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.144304 29898 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.080034 25768 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.114048 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.146428 29898 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.127386 25513 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 10, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.146199 29966 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.110116 25789 debug-util.cc:398] Leaking SignalData structure 0x7b0800353180 after lost signal to thread 25792
I20260709 12:11:19.103149 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:11:19.147603 25789 debug-util.cc:398] Leaking SignalData structure 0x7b0800325b00 after lost signal to thread 25793
I20260709 12:11:19.050397 29963 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.149130 25789 debug-util.cc:398] Leaking SignalData structure 0x7b08003a95c0 after lost signal to thread 26364
W20260709 12:11:19.149420 25789 debug-util.cc:398] Leaking SignalData structure 0x7b0800209680 after lost signal to thread 26365
I20260709 12:11:19.149463 29963 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.065897 29921 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:19.056595 29917 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.137272 29901 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.146584 29888 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.126513 29893 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:19.131356 25516 rpcz_store.cc:276] 0709 12:11:12.506614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.506820 (+   206us) service_pool.cc:224] Handling call
0709 12:11:19.130834 (+6624014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:16.068100 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:16.068837 (+   737us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:16.068878 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:11:16.068897 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:16.069316 (+   419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:16.069371 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:16.069403 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:16.069729 (+   326us) tablet.cc:701] Row locks acquired
0709 12:11:16.069747 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:16.069920 (+   173us) write_op.cc:270] Start()
0709 12:11:16.070061 (+   141us) write_op.cc:276] Timestamp: P: 1783599076069861 usec, L: 0
0709 12:11:16.070083 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:16.071217 (+  1134us) log.cc:844] Serialized 924 byte log entry
0709 12:11:16.083453 (+ 12236us) op_driver.cc:464] REPLICATION: finished
0709 12:11:16.083919 (+   466us) write_op.cc:301] APPLY: starting
0709 12:11:16.084014 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:16.084131 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:16.084206 (+    75us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:16.084504 (+   298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:16.084642 (+   138us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:11:16.084671 (+    29us) write_op.cc:312] APPLY: finished
0709 12:11:16.084840 (+   169us) log.cc:844] Serialized 28 byte log entry
0709 12:11:16.085033 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:16.085122 (+    89us) write_op.cc:454] Released schema lock
0709 12:11:16.085170 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:16.085605 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:16.085632 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3444263,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":1622,"apply.run_wall_time_us":1621,"num_ops":2,"prepare.queue_time_us":950,"prepare.run_cpu_time_us":2966,"prepare.run_wall_time_us":3448,"replication_time_us":13185,"thread_start_us":3868,"threads_started":1}]]}
I20260709 12:11:19.147634 29966 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.155061 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.125994 25763 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:19.159859 25513 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 6 to 8, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.122231 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:19.161585 25513 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.164000 29547 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.164474 29547 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.164906 29547 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.164562 25513 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.166672 25658 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:19.167574 29898 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.168013 29898 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.167361 25513 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 7 to 11, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.168376 29898 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.169247 25513 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.171022 25513 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.171728 29949 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:19.172816 29950 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.173187 29950 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.174286 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:19.173982 29950 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.175369 29950 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.175457 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:19.182227 25690 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:19.188843 25766 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:19.189024 29697 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:19.189716 29697 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.190181 29921 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:19.190747 29921 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.190845 29697 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.185163 25768 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:19.192041 25768 pending_rounds.cc:85] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 7
I20260709 12:11:19.191668 29921 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:19.192310 25768 pending_rounds.cc:107] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:19.192629 25768 raft_consensus.cc:2889] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:19.189770 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 86702.9us
I20260709 12:11:19.196516 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.196180 25513 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.197752 29940 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.198364 29940 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.199319 29940 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.200281 25514 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 180) took 17113 ms (client timeout 15000 ms). Trace:
I20260709 12:11:19.197922 25513 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 12 to 13, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:19.204236 25513 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:19.204761 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.217128 29914 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:19.217933 29914 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.219028 29914 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.201295 25514 rpcz_store.cc:269] 0709 12:11:02.086698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.138915 (+ 52217us) service_pool.cc:224] Handling call
0709 12:11:19.200186 (+17061271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:13.704071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:13.704971 (+   900us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:13.705040 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:11:13.705064 (+    24us) tablet.cc:662] Decoding operations
0709 12:11:13.967250 (+262186us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:13.987186 (+ 19936us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:13.991294 (+  4108us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:11:14.148035 (+156741us) tablet.cc:701] Row locks acquired
0709 12:11:14.148091 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:11:14.148301 (+   210us) write_op.cc:270] Start()
0709 12:11:14.148480 (+   179us) write_op.cc:276] Timestamp: P: 1783599074148230 usec, L: 0
0709 12:11:14.148501 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:14.153589 (+  5088us) log.cc:844] Serialized 9146 byte log entry
0709 12:11:14.972972 (+819383us) op_driver.cc:464] REPLICATION: finished
0709 12:11:15.076605 (+103633us) write_op.cc:301] APPLY: starting
0709 12:11:15.076718 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:15.179746 (+103028us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:15.179899 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:15.262035 (+ 82136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:15.452079 (+190044us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:11:15.465729 (+ 13650us) write_op.cc:312] APPLY: finished
0709 12:11:15.537819 (+ 72090us) log.cc:844] Serialized 157 byte log entry
0709 12:11:15.538060 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:15.538302 (+   242us) write_op.cc:454] Released schema lock
0709 12:11:15.574374 (+ 36072us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:15.605273 (+ 30899us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:15.605314 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4140139,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":96247,"apply.run_cpu_time_us":9831,"apply.run_wall_time_us":521629,"num_ops":23,"prepare.queue_time_us":130895,"prepare.run_cpu_time_us":43513,"prepare.run_wall_time_us":608337,"raft.queue_time_us":78111,"raft.run_cpu_time_us":18671,"raft.run_wall_time_us":186603,"replication_time_us":755177,"thread_start_us":322864,"threads_started":5,"wal-append.queue_time_us":338387,"wal-append.run_cpu_time_us":30167,"wal-append.run_wall_time_us":2597744}]]}
I20260709 12:11:19.214450 25762 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:19.225611 29803 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:19.227938 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.227733 29803 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:19.228693 29935 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:19.239714 29901 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.241628 25765 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:19.242641 25761 raft_consensus.cc:1240] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:19.258081 29901 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.271953 29547 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.273975 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.285909 29547 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.288437 29919 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.276966 25582 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:19.278781 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 154790us
I20260709 12:11:19.169827 25658 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.294912 29697 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.307853 29697 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:19.308354 29697 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.309379 29949 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:19.309834 29949 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.310173 29949 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:19.312177 29855 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:19.312628 29855 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.312952 29855 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:19.317004 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.319427 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 149682us
I20260709 12:11:19.320605 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:19.296773 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 119737us
I20260709 12:11:19.323037 29858 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.331878 25690 raft_consensus.cc:1240] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 8481c5f6be5b4faa9fe7c83301759f65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.333251 29949 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.336357 29686 consensus_queue.cc:1059] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:19.337710 29974 raft_consensus.cc:3055] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.340981 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:19.342381 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.342515 25732 connection.cc:256] RPC call timeout handler was delayed by -2.8554699040000742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:11:19.343143 25732 connection.cc:256] RPC call timeout handler was delayed by -2.7906699040001968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 12:11:19.348126 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:19.348759 25732 connection.cc:256] RPC call timeout handler was delayed by -2.7492478039998787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32010000000000005s for a response
W20260709 12:11:19.349258 25732 connection.cc:256] RPC call timeout handler was delayed by -2.7303699040000993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:11:19.349656 25732 connection.cc:256] RPC call timeout handler was delayed by -2.518869904000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 12:11:19.350044 25732 connection.cc:256] RPC call timeout handler was delayed by -2.4662233659998947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:11:19.350435 25732 connection.cc:256] RPC call timeout handler was delayed by -2.4662233659998947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:11:19.351050 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0819233659999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 12:11:19.353312 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0585233659999176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:11:19.353739 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0522233659999074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:11:19.354137 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0468233659998987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 12:11:19.354584 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0207579180000721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:11:19.354995 25732 connection.cc:256] RPC call timeout handler was delayed by -2.0207579180000721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 12:11:19.355427 25732 connection.cc:256] RPC call timeout handler was delayed by -1.9820233660000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 12:11:19.356086 25732 connection.cc:256] RPC call timeout handler was delayed by -1.9793233660000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 12:11:19.356491 25732 connection.cc:256] RPC call timeout handler was delayed by -1.7147579180000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260709 12:11:19.244663 29898 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:19.356954 25732 connection.cc:256] RPC call timeout handler was delayed by -1.6886579179999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 12:11:19.357340 25732 connection.cc:256] RPC call timeout handler was delayed by -1.4690579180000896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22850000000000004s for a response
W20260709 12:11:19.357681 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1081233659999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3094s for a response
W20260709 12:11:19.358008 25732 connection.cc:256] RPC call timeout handler was delayed by -1.1081233659999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3094s for a response
W20260709 12:11:19.358383 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0613579180001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2738s for a response
W20260709 12:11:19.358769 25732 connection.cc:256] RPC call timeout handler was delayed by -1.0100579180000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2795s for a response
I20260709 12:11:19.359687 29898 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.361059 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.363070 25583 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:19.369086 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.372124 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.372637 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.374974 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.375281 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:19.344727 29974 raft_consensus.cc:740] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:19.346777 29963 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.344767 29888 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:19.404718 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.388379 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:19.450377 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 80993.1us
I20260709 12:11:19.450855 25762 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:19.450208 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:19.451860 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 63648.6us
I20260709 12:11:19.452427 25759 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.355995 29547 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.453387 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.449828 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.458369 29935 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:19.458849 29974 consensus_queue.cc:260] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:19.352694 29858 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:11:19.460510 29974 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.456832 29888 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.368353 29966 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:11:19.368429 29893 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:19.463980 29888 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:19.464030 29893 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.464638 29888 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.355415 29914 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:11:19.376833 29606 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:11:19.379663 29807 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 12:11:19.456430 29941 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:11:19.456260 29916 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:19.467897 29949 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.457134 29898 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.368088 29800 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:11:19.469869 29800 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.470809 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:19.472386 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:19.441615 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.412415 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:19.482769 25768 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.486980 29950 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:19.478171 29916 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:19.464635 29893 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.379541 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.392488 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:19.450585 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 85308.8us
I20260709 12:11:19.475080 25582 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:19.457396 29713 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:19.470235 29800 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:19.476840 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.379304 29901 consensus_queue.cc:1059] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:11:19.529652 29547 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.550994 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:19.480401 29941 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:19.551951 25693 raft_consensus.cc:2368] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:11:19.552316 29901 raft_consensus.cc:3055] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:19.501507 25759 raft_consensus.cc:2410] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:19.552721 29901 raft_consensus.cc:740] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.453493 29831 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.555035 25766 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.545298 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:19.559545 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84585.2us
I20260709 12:11:19.560264 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.560645 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.561313 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:19.562121 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.561386 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d430da6a4c644f538698b570759feb1e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.561950 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.563414 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.565516 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.566442 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.566529 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.567286 25694 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:19.567633 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.567729 25768 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:19.568017 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.568260 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.569339 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:19.569770 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 93006.2us
I20260709 12:11:19.570870 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.570788 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.553813 29941 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.553661 29901 consensus_queue.cc:260] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.574960 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.575484 29901 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.575275 29941 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.576105 25690 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:19.560307 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:19.594197 25658 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.595506 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:19.596223 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.596513 25691 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:19.597211 25764 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:11:19.610304 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.611706 29948 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:19.612386 29833 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.612645 29858 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.614115 25767 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:19.481413 29846 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.635452 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.490700 29949 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:19.636092 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.637799 25658 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.551671 29547 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.641764 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:19.643483 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:19.655148 25766 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:19.656523 25693 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:19.559110 29831 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.660466 25764 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: [8.6-11.8]
I20260709 12:11:19.615145 29853 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:19.661772 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 300769us
I20260709 12:11:19.657856 29949 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.614405 29807 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:19.673005 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.623224 29921 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.627075 29919 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.533676 29855 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.682592 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.681344 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.654392 29898 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.635252 29948 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:19.692696 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 154978us
I20260709 12:11:19.660248 29831 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.660256 29833 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:19.677284 29846 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.697314 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.713451 25689 raft_consensus.cc:2368] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:19.658288 29963 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:19.662580 29858 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:19.693226 29853 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.721707 25583 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.681174 29929 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:19.699689 29919 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.697599 29807 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.690052 29938 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:11:19.692181 29803 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:11:19.751433 25761 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:19.691180 29921 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.722905 29936 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.733641 29858 consensus_queue.cc:1243] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:19.717630 29846 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.690569 29800 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.750358 29939 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.731272 29917 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:19.747668 29995 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.744782 29990 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:19.759579 29996 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:19.792008 29547 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:19.807901 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 125412us
I20260709 12:11:19.817931 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.802477 29800 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.772233 29833 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.769695 29948 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.824842 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.826082 29990 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:19.823915 29994 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.845772 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:19.847170 29992 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:11:19.850904 29994 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:19.851271 30002 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:11:19.795053 29996 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.852839 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.856298 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.857887 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.860889 29994 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.862720 29893 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.864900 29855 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.865746 29919 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.867805 25692 raft_consensus.cc:2368] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14.
I20260709 12:11:19.864953 29893 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.860836 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:19.892117 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 254403us
I20260709 12:11:19.893554 29921 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.896799 29996 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:19.899277 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.869688 30000 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:19.902941 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.903172 29846 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:19.907861 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.908710 25610 raft_consensus.cc:2368] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:11:19.908991 29917 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.909720 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.910521 29803 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.911181 25612 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:19.910997 29803 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.909533 29917 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.912288 29962 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.912873 29713 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:19.912915 29962 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:19.914194 29713 tablet_bootstrap.cc:492] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
W20260709 12:11:19.914283 29697 consensus_meta.cc:287] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.003s
I20260709 12:11:19.914780 29697 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.915244 29713 ts_tablet_manager.cc:1403] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.228s	user 0.052s	sys 0.018s
I20260709 12:11:19.916702 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.918076 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.919770 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.920589 25610 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
W20260709 12:11:19.923285 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 62558.3us
I20260709 12:11:19.925534 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.927816 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.929381 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.870651 29990 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.930141 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.924252 29916 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.931038 29994 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.931108 29916 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.924242 29996 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.936781 29949 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:19.940965 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:19.945340 25610 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.945238 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.946906 25612 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:19.947286 25612 pending_rounds.cc:85] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 5
I20260709 12:11:19.947530 25612 pending_rounds.cc:107] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:19.947783 25612 raft_consensus.cc:2889] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.949684 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.950690 25614 raft_consensus.cc:2410] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:19.951736 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.952067 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.963107 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.963656 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.964694 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.964984 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.965507 25614 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.965845 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.966442 25619 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:19.966643 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.967253 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.968143 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:19.969022 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.969492 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.970724 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.963773 25617 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:19.970899 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.972085 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.967634 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.973543 25617 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:19.974642 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.974467 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.860508 29995 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.975876 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.978888 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.976325 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.980026 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:19.979192 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.980692 25767 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:19.975903 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.982016 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.982313 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:19.980822 25615 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:19.982703 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.979964 25763 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:19.983920 25619 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:19.984018 25760 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:19.979924 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.964172 29680 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:19.987190 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:19.962560 29846 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.988164 25614 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:19.972107 29996 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.978233 29994 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.977164 29990 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.998047 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:19.989230 29949 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.989627 30000 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.001505 29995 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:20.014142 29936 consensus_queue.cc:1059] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:20.015733 29993 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.998617 29921 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:20.017127 29921 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.017922 25694 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
W20260709 12:11:20.019138 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.004729 29916 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.021988 25614 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.996490 29938 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:19.923154 29962 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.045226 29785 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:20.046798 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60011.4us
I20260709 12:11:20.028491 29920 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:20.048657 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:20.045838 29785 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:20.053542 25614 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.062918 29606 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:20.063480 29606 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:20.063354 29785 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.064715 29785 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.065472 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:20.067090 25658 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:20.064378 29606 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.049419 29962 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.078630 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:20.053297 29922 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.021314 29713 raft_consensus.cc:359] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:20.042049 29938 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.076253 29901 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:20.090932 30006 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.091457 30006 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.091805 30006 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.092074 25614 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:20.083168 29680 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:20.103055 29680 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.103525 29680 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:20.104509 29680 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.105870 29680 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.087397 29939 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.119467 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.094609 25658 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:20.125801 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 134820us
I20260709 12:11:20.080770 29950 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:20.087271 29713 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:20.130467 29803 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.133569 29921 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.088917 29922 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.136034 29922 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.136185 29938 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.116727 29939 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.138821 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.139091 29939 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.126176 29949 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.140481 29949 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.140954 29949 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.144984 29606 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:20.151410 29990 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:20.153132 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:20.153695 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.130985 29713 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:20.157387 29917 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.157948 29713 ts_tablet_manager.cc:1434] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.242s	user 0.012s	sys 0.000s
I20260709 12:11:20.166705 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:20.169123 29831 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.170156 25760 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:20.175571 25613 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:20.176878 30006 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.179804 30006 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.184278 29831 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:20.186098 26306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.189484 29996 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.199054 29846 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.199674 29697 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.200460 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.209429 29800 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:20.219143 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:20.220530 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.221827 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:20.223840 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:20.224458 25767 raft_consensus.cc:3060] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.226476 29966 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:20.227236 29966 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.229841 29966 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.232138 29451 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.232645 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.233563 29451 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.233903 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.235064 25657 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:20.235368 29966 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:20.236129 29966 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.237619 25657 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.238415 29962 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.240259 25657 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:20.244103 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 120751us
I20260709 12:11:20.248543 25766 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:20.253202 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:20.263233 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 257618us
I20260709 12:11:20.264089 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.277526 25767 raft_consensus.cc:2468] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:20.279735 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:20.280213 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 127174us
I20260709 12:11:20.281623 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.284727 25658 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:20.291080 25657 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.265339 29807 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.301854 25657 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.297802 29800 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.287374 30006 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.298566 25732 leader_election.cc:400] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:11:20.305029 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:20.304522 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.305296 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:20.311053 25732 leader_election.cc:403] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.311880 25613 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.310178 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:20.283195 29948 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:20.297832 29451 raft_consensus.cc:2804] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:20.298704 29962 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.318800 25618 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:20.315711 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:20.305832 29893 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:20.330747 25732 leader_election.cc:400] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:11:20.331202 25732 leader_election.cc:403] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.332580 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:20.333150 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.307907 29999 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.340582 29888 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.314383 29547 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:20.326783 29996 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.354733 29996 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:20.355195 29996 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:20.357443 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47365us
I20260709 12:11:20.319739 29990 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:20.359620 29999 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:20.359946 29990 consensus_queue.cc:1243] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:20.319435 29995 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.360419 29990 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:20.371532 29990 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:20.372726 29990 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.321404 29800 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:20.390652 29831 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:20.357102 30013 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10.
I20260709 12:11:20.327416 29451 raft_consensus.cc:697] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:20.396765 29999 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.406908 29451 consensus_queue.cc:237] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.409842 29800 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.389887 29939 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:20.357457 29893 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:11:20.428232 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50990.6us
I20260709 12:11:20.329053 25767 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 7 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:11:20.447038 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 114565us
I20260709 12:11:20.448227 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.449868 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.459729 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.460493 25768 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:20.462862 25768 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:20.464179 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.468760 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:20.469069 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 157052us
I20260709 12:11:20.471156 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:20.472407 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.437881 29939 consensus_queue.cc:1059] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:20.479602 29939 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.417641 29893 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.446497 29990 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.484292 29939 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:20.468075 30013 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:20.488794 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.469765 29888 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.474149 29994 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:20.476078 29993 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:20.511408 25657 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:20.514539 29962 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.489046 29949 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.516162 30006 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.517765 30025 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.517917 29949 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.518316 30025 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.502616 29993 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:20.539572 29993 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.540880 30025 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:20.551476 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:20.552501 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:20.553268 25692 raft_consensus.cc:2368] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
I20260709 12:11:20.553164 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:20.553828 25611 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:20.552049 25694 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:20.556425 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:20.556983 25768 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.524266 29996 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.503778 29888 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.530387 29939 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.538404 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:20.563089 25689 raft_consensus.cc:2368] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
I20260709 12:11:20.586110 25619 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.564751 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.569705 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:20.576443 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.582957 25694 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.587788 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:20.583650 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:20.587615 25765 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:20.595487 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.604566 25689 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:20.608031 25685 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:20.608183 25690 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:20.615186 25613 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:20.619306 29939 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.619505 26334 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:11:20.619889 26334 pending_rounds.cc:85] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Aborting all ops after (but not including) 9
I20260709 12:11:20.620147 26334 pending_rounds.cc:107] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:20.620441 26334 raft_consensus.cc:2889] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:20.624711 29785 consensus_meta.cc:287] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.000s
I20260709 12:11:20.619324 25693 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:20.628379 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:20.629417 25686 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:20.632133 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.641427 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.644126 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.645727 25766 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:20.647852 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.649408 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:20.651595 25693 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:20.652738 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:20.653617 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:20.654404 25694 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:20.654472 25693 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:20.653560 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:20.656131 25765 raft_consensus.cc:2410] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:20.658021 25658 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:20.668326 25692 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:20.674017 25759 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.619439 29922 raft_consensus.cc:2764] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:20.630185 30025 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.701365 25691 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:20.707238 25505 tablet_replica.cc:1406] Time spent applying in-flights took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 12:11:20.775671 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.692620 29606 consensus_meta.cc:287] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.006s
I20260709 12:11:20.783130 25690 raft_consensus.cc:1240] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:20.688917 29846 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.801134 25768 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:20.804883 25759 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:20.687460 29901 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:20.812820 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 340453us
I20260709 12:11:20.817487 25732 leader_election.cc:304] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.821579 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:20.705917 30025 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.834921 25611 raft_consensus.cc:1240] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:20.836036 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:20.787309 29991 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.884752 26334 raft_consensus.cc:1217] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:11:20.871017 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:20.891112 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:20.893244 25685 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:20.867048 30002 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:20.811866 29888 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.827338 29994 raft_consensus.cc:2749] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:21.112841 25694 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:20.820194 29451 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.865401 30025 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.833377 25619 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:20.833268 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.117542 25615 raft_consensus.cc:2368] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
W20260709 12:11:21.010985 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 147350us
I20260709 12:11:20.898597 30013 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.825793 29901 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:20.897467 29846 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:11:21.055761 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.898882 29991 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:20.960192 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-460a9cbf9985461f9237f09b4f5ca854 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:11:21.024427 29916 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:11:20.888146 29800 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:21.085896 30023 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.057s	user 0.003s	sys 0.005s
W20260709 12:11:21.114733 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 279267us
W20260709 12:11:21.102560 29995 consensus_meta.cc:287] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.713s	user 0.014s	sys 0.000s
I20260709 12:11:21.119930 25582 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:21.151222 29995 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9.
I20260709 12:11:21.151633 29914 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.152125 29914 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.152244 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:21.089790 29858 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.125800 25687 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:21.125422 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.129469 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.154564 29858 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.155057 25688 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
W20260709 12:11:21.121788 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 255485us
W20260709 12:11:21.141793 30032 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:11:21.156877 29858 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:21.142750 30036 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:11:21.157815 30030 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:11:21.158766 30037 log.cc:927] Time spent T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:11:21.118772 29996 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:21.140856 30035 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:11:21.152519 29914 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.162097 25687 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:11:21.143649 30031 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:21.163447 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.163653 25694 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:21.179507 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.180765 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.121726 29451 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.121282 29950 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.178217 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.179507 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.184584 25732 leader_election.cc:400] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14.
I20260709 12:11:21.194690 25732 leader_election.cc:403] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.194514 29950 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.195848 25732 leader_election.cc:400] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:21.196170 25732 leader_election.cc:403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.196976 29969 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.197211 25732 leader_election.cc:400] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
I20260709 12:11:21.197685 29995 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14.
I20260709 12:11:21.197505 29969 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:21.190932 29996 raft_consensus.cc:2764] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:21.197511 25732 leader_election.cc:403] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.200627 29996 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
I20260709 12:11:21.201629 29996 consensus_queue.cc:1059] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.203440 29996 raft_consensus.cc:3055] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:21.112831 29888 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.203838 29996 raft_consensus.cc:740] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:21.204918 29996 consensus_queue.cc:260] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:21.208142 29990 consensus_meta.cc:287] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.000s
I20260709 12:11:21.208724 29996 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.209206 25764 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:21.170578 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-460a9cbf9985461f9237f09b4f5ca854 on tablet 460a9cbf9985461f9237f09b4f5ca854 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:21.206166 25732 leader_election.cc:400] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
I20260709 12:11:21.170200 30034 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:21.210244 29846 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.210669 30034 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.212940 30034 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.207660 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.214716 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:21.215855 25688 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:11:21.216586 29993 consensus_meta.cc:287] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.676s	user 0.012s	sys 0.004s
I20260709 12:11:21.217096 29993 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.215267 25732 leader_election.cc:403] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.218312 29994 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.218636 25686 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:21.193782 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:21.205907 29888 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.187673 29800 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:21.226186 29697 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.226980 29800 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.227766 29697 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:21.229395 29991 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:11:21.231887 29451 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.234122 30016 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:21.234642 30016 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:21.235551 30016 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.240587 25686 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:21.242172 25686 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:21.247085 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:21.276962 25764 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:21.245697 25767 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:21.180361 29803 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:21.244571 30000 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.283362 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:21.264010 30034 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:21.302981 29969 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.302448 30034 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.305576 30034 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.307260 29993 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.309105 29950 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.315382 29901 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.316075 25687 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:21.321430 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:21.326099 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.327512 30000 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.330641 25687 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 8.
I20260709 12:11:21.334976 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:21.336833 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:21.328642 29939 consensus_meta.cc:287] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.000s
I20260709 12:11:21.353353 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:21.341684 29962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.013s	sys 0.021s
I20260709 12:11:21.332355 30000 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:21.339854 29993 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:21.356401 29962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.014s	sys 0.021s
I20260709 12:11:21.342387 30034 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:21.377291 25766 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.008s
I20260709 12:11:21.358350 29994 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12.
W20260709 12:11:21.379462 25766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.008s
I20260709 12:11:21.374331 30000 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.356392 30045 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.373694 29993 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:21.393200 29914 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.407768 29993 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:21.456089 30053 log.cc:927] Time spent T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.065s	user 0.003s	sys 0.001s
I20260709 12:11:21.445355 30025 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:21.009886 25505 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.302s	user 0.000s	sys 0.000s
I20260709 12:11:21.256376 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:21.504465 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 247999us
I20260709 12:11:21.507813 25618 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:11:21.508679 25618 pending_rounds.cc:85] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 7
I20260709 12:11:21.509034 25618 pending_rounds.cc:107] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:11:21.509537 25618 raft_consensus.cc:2889] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.517506 25694 raft_consensus.cc:2393] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:11:21.520004 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.521446 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 168078us
I20260709 12:11:21.529326 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:21.496289 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:21.545086 26304 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:21.555087 29846 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:21.556555 29800 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:21.556789 29846 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:21.559314 29686 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.559962 29686 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.557778 29800 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.565690 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.567170 25764 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:21.539572 25516 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 7 to 10, term changed from 11 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.569010 29807 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.565948 29846 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.581039 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 389676us
I20260709 12:11:21.570053 29888 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:21.560426 29686 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.590914 29846 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.606698 30058 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:21.608011 30058 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:21.612092 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 83098.3us
I20260709 12:11:21.615834 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:21.617455 30034 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.614787 30061 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:21.625408 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.626847 25766 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 13.
I20260709 12:11:21.629496 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.574148 29807 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:21.586668 29800 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.597880 29846 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.461063 30025 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.632385 30016 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.647956 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.654120 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.655628 25614 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:21.660905 29807 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.663969 29807 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.640339 29995 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.646618 25766 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 7.
I20260709 12:11:21.669747 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.670971 25613 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:21.642940 29990 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:21.677757 29914 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.678727 25615 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:21.687893 25615 pending_rounds.cc:85] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 7
I20260709 12:11:21.688359 25615 pending_rounds.cc:107] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:21.688660 25615 raft_consensus.cc:2889] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:21.688753 25761 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:21.695048 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.698751 29846 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.703349 29846 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.705896 29846 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.706423 25694 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:21.706768 30058 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.706897 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.707834 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.711036 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.715687 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:21.716203 25764 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:21.716989 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.723984 25658 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:21.726809 30025 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.727619 30025 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:21.721577 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.716992 25759 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:21.719903 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:21.729997 25765 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.731820 29831 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:21.732582 29831 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:21.735955 29831 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:21.739660 29451 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.740492 29451 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.743142 29451 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:21.743788 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 489535us
I20260709 12:11:21.747179 30000 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.748775 25762 raft_consensus.cc:2410] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:21.749691 30000 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.755648 30067 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.756564 30067 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.758736 29993 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.760257 25767 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.760452 30057 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.761294 25658 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:21.762089 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:21.763576 30067 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.763713 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:21.764634 25694 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:21.726930 25761 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:21.766712 29996 consensus_meta.cc:287] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.012s
I20260709 12:11:21.729426 30025 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:21.767939 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.768411 29993 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.771521 29888 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:21.772953 29888 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.774515 29901 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.774765 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.775022 29901 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.775453 29901 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.776332 29888 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.776459 25618 raft_consensus.cc:1275] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:21.778367 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:21.779233 25618 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.786837 29929 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.788228 29901 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.789674 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:21.797755 29991 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:21.798297 25513 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 182) took 10197 ms. Trace:
I20260709 12:11:21.781903 29686 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:21.798378 29991 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.797695 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.799052 29991 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.802186 29901 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:21.789471 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 43912.2us
I20260709 12:11:21.805476 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.810389 25767 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:21.806298 29888 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.812805 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:21.812091 29888 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.813725 25694 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.816747 29888 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.817417 29888 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:21.819464 29888 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:21.817829 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:21.822661 29686 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.807353 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:21.828109 29831 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:21.832474 29901 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.839998 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 68912.5us
I20260709 12:11:21.840219 29901 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.841121 29846 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.842988 29901 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:21.792665 29995 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:21.835475 29451 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:21.836632 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:21.852175 25765 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:21.851554 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:21.854686 25694 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 9.
I20260709 12:11:21.854918 29996 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:21.859939 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 180480us
I20260709 12:11:21.860082 26304 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:21.861577 25618 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:21.809257 29991 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:11:21.871052 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60316us
I20260709 12:11:21.866027 29929 raft_consensus.cc:2764] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:21.873073 29686 raft_consensus.cc:2804] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:21.873682 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.873705 29686 raft_consensus.cc:697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:21.875347 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.875238 29686 consensus_queue.cc:237] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:21.876215 25613 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:11:21.855792 29996 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:21.885042 29993 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.886103 29893 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:21.890350 29846 consensus_queue.cc:1048] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:21.896867 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:21.900053 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.904318 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.885615 29993 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.908142 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:21.908910 25763 raft_consensus.cc:3060] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:21.907541 25583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.597s (SENT) [suppressed 9 similar messages]
I20260709 12:11:21.915686 25613 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:21.910274 29993 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.850594 25513 rpcz_store.cc:276] 0709 12:11:11.601141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.604460 (+  3319us) service_pool.cc:224] Handling call
0709 12:11:21.798019 (+10193559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:19.516981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:19.578595 (+ 61614us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:19.578641 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:11:19.578661 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:19.611883 (+ 33222us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:19.611963 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:19.612008 (+    45us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:11:19.613083 (+  1075us) tablet.cc:701] Row locks acquired
0709 12:11:19.613105 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:11:19.623121 (+ 10016us) write_op.cc:270] Start()
0709 12:11:19.653767 (+ 30646us) write_op.cc:276] Timestamp: P: 1783599079613222 usec, L: 0
0709 12:11:19.657087 (+  3320us) op_driver.cc:348] REPLICATION: starting
0709 12:11:19.711204 (+ 54117us) log.cc:844] Serialized 4063 byte log entry
0709 12:11:20.049114 (+337910us) op_driver.cc:464] REPLICATION: finished
0709 12:11:20.237988 (+188874us) write_op.cc:301] APPLY: starting
0709 12:11:20.238135 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:20.239493 (+  1358us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:20.239627 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:20.521765 (+282138us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:20.522119 (+   354us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=20
0709 12:11:20.522171 (+    52us) write_op.cc:312] APPLY: finished
0709 12:11:20.686115 (+163944us) log.cc:844] Serialized 138 byte log entry
0709 12:11:20.705434 (+ 19319us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:20.803173 (+ 97739us) write_op.cc:454] Released schema lock
0709 12:11:20.822045 (+ 18872us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:20.951190 (+129145us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:20.958811 (+  7621us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1072986,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":185203,"apply.run_cpu_time_us":23068,"apply.run_wall_time_us":642433,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18837,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":1,"lbm_read_time_us":21856,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":6,"num_ops":10,"prepare.queue_time_us":258865,"prepare.run_cpu_time_us":11234,"prepare.run_wall_time_us":225219,"raft.queue_time_us":138030,"raft.run_cpu_time_us":18831,"raft.run_wall_time_us":238554,"replication_time_us":375313,"thread_start_us":409099,"threads_started":4,"wal-append.queue_time_us":50699}]]}
I20260709 12:11:21.935756 29996 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.943856 29914 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:21.948118 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 111648us
I20260709 12:11:21.924235 29888 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.969651 29995 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:21.977923 25657 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:21.978888 29995 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.005234 29995 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.008965 29995 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.009936 29995 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.012676 29995 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:21.980818 30016 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.970894 30057 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:22.006031 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:21.996219 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:22.028579 25615 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.994128 29914 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:22.037966 29929 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.042029 25505 maintenance_manager.cc:643] P 522441a6317141cea1e624f44af51018: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.351s	user 0.158s	sys 0.081s Metrics: {"bytes_written":29596,"cfile_init":1,"dirs.queue_time_us":320276,"dirs.run_cpu_time_us":543,"dirs.run_wall_time_us":1360,"drs_written":1,"lbm_read_time_us":2748,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":94839,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":63,"thread_start_us":330490,"threads_started":1}
I20260709 12:11:22.047472 30016 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.033175 25693 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:22.026531 25763 raft_consensus.cc:2468] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 9.
W20260709 12:11:22.062743 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 85405.1us
I20260709 12:11:22.050218 30016 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.080032 29831 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.082640 29929 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:22.083145 29929 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:22.084204 29929 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.085662 29929 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:22.060606 29893 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.087378 25613 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:22.090191 25658 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:22.091696 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:22.092165 29966 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:22.092736 29966 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:22.092840 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:22.074635 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 98063.9us
I20260709 12:11:22.095829 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:22.096158 30057 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:22.096781 30057 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.097219 30057 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:22.057861 29991 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
W20260709 12:11:22.104293 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47373.6us
I20260709 12:11:22.100342 29807 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.093778 29966 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:22.132961 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51138.1us
I20260709 12:11:22.101063 29993 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.126782 29807 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.129608 29451 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.119081 29901 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:22.122427 30067 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:11:22.162878 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 64813.1us
I20260709 12:11:22.163815 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:22.149968 29807 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.128683 29893 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:22.156805 30025 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.173782 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:22.175953 25765 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:22.181195 25506 maintenance_manager.cc:419] P 522441a6317141cea1e624f44af51018: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8679 bytes on disk
I20260709 12:11:22.162186 29888 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.170353 29996 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.210592 30045 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.211491 30045 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.213922 30045 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.218554 29888 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.243351 29888 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.219642 29996 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.192382 29914 consensus_queue.cc:1059] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:22.230762 29962 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.247449 29962 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.236224 30088 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:11:22.237416 30025 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.252691 25505 maintenance_manager.cc:643] P 522441a6317141cea1e624f44af51018: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.070s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":66159,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 12:11:22.258687 30025 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.259573 29996 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.260509 29962 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.261647 29962 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.263705 29993 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.271149 29893 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.272145 29893 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.277207 29893 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.277897 29993 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:22.279495 29993 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.280993 30093 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:22.297138 29888 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.265007 29962 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.260442 25615 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:22.305322 25765 raft_consensus.cc:2468] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 14.
W20260709 12:11:22.327407 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 170599us
I20260709 12:11:22.335191 30045 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.382975 26303 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:22.385016 30052 raft_consensus.cc:2804] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:22.385774 30052 raft_consensus.cc:697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:11:22.387073 30052 consensus_queue.cc:237] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:22.389304 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.327813 30093 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:22.393424 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.393503 25658 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:22.373947 29995 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.310250 29996 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.376150 30016 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:22.373744 29999 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:22.380900 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 267148us
I20260709 12:11:22.394533 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.380414 30000 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.404752 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 250153us
I20260709 12:11:22.374310 29962 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.395193 30045 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.422276 29697 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:22.422461 30000 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.423149 29697 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:22.424710 30000 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.425374 29697 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:22.414641 30098 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.430408 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.437326 30091 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:22.446715 30091 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:22.449803 30091 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:22.450799 30099 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.409130 29995 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.408131 29996 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.432556 29999 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.408728 29888 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.455348 30064 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:22.432665 30016 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:22.458984 29962 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.451646 30099 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.467684 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.468329 29995 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.471880 29993 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.474169 29996 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.478390 30025 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.478766 30099 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.479148 30025 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:22.480639 30025 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.492221 25616 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:22.486182 30025 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.484699 30098 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:22.495962 29996 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.503734 29996 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.503880 30098 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.494156 29451 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.515447 29999 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.522871 30045 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.476186 30093 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.500211 30099 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.541098 25693 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:22.513118 30057 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.552855 29451 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.559374 29451 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.559926 29888 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:22.560833 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.561684 29451 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.563839 30057 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.565471 30093 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:22.568382 30045 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.569186 30045 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:22.571125 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 85077.9us
I20260709 12:11:22.572006 29807 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.577242 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.586664 30099 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.589799 30099 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.595233 29807 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.572271 30045 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:22.604369 30083 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.429s	user 0.004s	sys 0.000s
I20260709 12:11:22.605075 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.605453 25614 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:22.606916 29929 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:22.608075 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 54) took 3450 ms. Trace:
W20260709 12:11:22.614629 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 450900us
I20260709 12:11:22.608317 29888 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.611492 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.616641 25765 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:22.611357 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:22.630932 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:22.631621 25761 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:22.631649 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 103472us
I20260709 12:11:22.621201 29999 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.639014 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:22.641196 25614 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:22.637213 29901 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.643160 26334 consensus_queue.cc:237] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:22.643738 29901 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.614979 25516 rpcz_store.cc:276] 0709 12:11:19.157452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.165759 (+  8307us) service_pool.cc:224] Handling call
0709 12:11:19.235686 (+ 69927us) spinlock_profiling.cc:243] Waited 67.8 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:11:22.607990 (+3372304us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:22.008680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:22.009679 (+   999us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:22.009742 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:11:22.009763 (+    21us) tablet.cc:662] Decoding operations
0709 12:11:22.010246 (+   483us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:22.010388 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:22.010422 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:22.010729 (+   307us) tablet.cc:701] Row locks acquired
0709 12:11:22.010778 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:11:22.055732 (+ 44954us) write_op.cc:270] Start()
0709 12:11:22.070142 (+ 14410us) write_op.cc:276] Timestamp: P: 1783599082032846 usec, L: 0
0709 12:11:22.073254 (+  3112us) op_driver.cc:348] REPLICATION: starting
0709 12:11:22.074186 (+   932us) log.cc:844] Serialized 602 byte log entry
0709 12:11:22.450032 (+375846us) op_driver.cc:464] REPLICATION: finished
0709 12:11:22.525834 (+ 75802us) write_op.cc:301] APPLY: starting
0709 12:11:22.532140 (+  6306us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:22.540214 (+  8074us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:22.540332 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:22.572946 (+ 32614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:22.573282 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:22.573355 (+    73us) write_op.cc:312] APPLY: finished
0709 12:11:22.573687 (+   332us) log.cc:844] Serialized 24 byte log entry
0709 12:11:22.573908 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.574000 (+    92us) write_op.cc:454] Released schema lock
0709 12:11:22.574066 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:22.574526 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:22.574562 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4871,"reported_tablets":2,"spinlock_wait_cycles":155878144,"child_traces":[["op",{"apply.queue_time_us":73520,"apply.run_cpu_time_us":5985,"apply.run_wall_time_us":49666,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":349751,"prepare.run_cpu_time_us":16237,"prepare.run_wall_time_us":148660,"raft.queue_time_us":169419,"raft.run_cpu_time_us":14049,"raft.run_wall_time_us":57924,"replication_time_us":376596,"thread_start_us":533344,"threads_started":4,"wal-append.queue_time_us":203560}]]}
I20260709 12:11:22.620661 30064 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:22.646042 29901 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.658957 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:22.655134 30091 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:22.654938 29831 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:22.668955 29831 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.671154 29831 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.675819 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.677765 25583 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:22.679472 25583 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:22.680729 25583 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:22.680764 29697 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.681875 30103 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.659008 29914 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.682963 30103 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.682488 29697 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.621136 29888 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.682199 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:22.639366 30099 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.688340 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.693843 25765 raft_consensus.cc:2410] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:22.692394 25614 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:11:22.694890 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:22.631511 30097 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:22.693991 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:22.698760 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:22.700398 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.683035 29914 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.707607 25765 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:22.719118 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:22.719971 25768 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.706302 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:22.697963 29831 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.653164 29999 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.728657 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:22.707341 29914 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.730569 30092 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.731530 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.655519 30052 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:11:22.733745 26338 raft_consensus.cc:1240] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:22.734302 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.736022 30110 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.743562 25614 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.730223 30098 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:22.718638 30057 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.747413 25765 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:22.744788 29993 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:22.746794 29901 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.757869 25583 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:22.759212 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:22.763907 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.765154 25765 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:22.769086 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.770006 25616 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:22.776731 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.724426 30099 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.746517 30091 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.752085 30069 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:22.795164 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:22.758941 30098 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.799981 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.766656 29993 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.805487 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:22.805709 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:22.777295 30067 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.808898 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:22.809844 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:22.813866 25693 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:22.814750 25765 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:22.817778 25692 raft_consensus.cc:2368] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:22.819144 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:22.820272 25766 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:11:22.823064 25690 raft_consensus.cc:2368] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 17. Current term is 18.
I20260709 12:11:22.803192 29831 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.776476 30057 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.807802 29993 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:22.804028 30098 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:22.810451 29451 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.825538 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:22.835597 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 66221us
I20260709 12:11:22.812206 30045 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.838235 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:22.795809 29901 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.801862 30091 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.852203 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:22.856907 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:22.847085 30045 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:22.799319 30110 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.857671 25692 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:22.871021 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:22.871845 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:22.960906 29901 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.955632 25693 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 7.
W20260709 12:11:22.958356 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.962956 30045 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.031297 29901 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.031929 29901 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.969183 25614 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:22.958480 30057 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:22.960422 30109 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:11:22.963887 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:23.035781 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:22.962404 30113 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:11:22.959108 25687 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:22.972348 25768 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:22.827925 30069 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:22.839316 30097 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 12:11:22.959199 29888 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:22.960696 30099 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:22.827816 30067 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:22.851531 30092 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.008400 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46758.9us
I20260709 12:11:22.859267 30101 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 12:11:23.013950 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:23.015517 30115 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:11:23.011570 25689 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:23.016189 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.017251 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.075789 25763 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
W20260709 12:11:23.061759 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.067071 25686 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:23.080361 25761 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:23.081264 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:23.037243 30100 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.527s	user 0.000s	sys 0.004s
I20260709 12:11:23.006841 29995 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:22.954068 29451 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.079067 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.034624 29901 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.089962 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.093571 25692 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:23.102864 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.097581 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.108008 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.108594 25614 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.112433 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.065248 29888 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.120195 30092 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.120669 29888 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.115274 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.109608 25658 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.115986 25692 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.117313 25583 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:23.117552 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.118515 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.118650 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.125509 25617 raft_consensus.cc:2368] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 17. Current term is 18.
I20260709 12:11:23.127094 25619 raft_consensus.cc:2410] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:11:23.107442 30025 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.003s
I20260709 12:11:23.091280 29999 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.120126 30091 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.134831 25691 raft_consensus.cc:2393] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:23.111254 29831 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.129827 30045 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.134006 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.140277 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.132174 29846 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:23.149966 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.157891 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.158250 25614 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:23.161834 25692 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:23.164067 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.147668 30093 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.170640 25694 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:23.170696 25610 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:23.171663 25617 raft_consensus.cc:2368] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:23.172572 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:23.296016 25689 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.173282 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.174228 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.130057 29995 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.179613 29888 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.182466 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.151521 29831 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.183960 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.185294 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.187908 29996 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.174420 30124 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:23.253392 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.270730 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.271186 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.272683 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.272943 25764 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.148196 30045 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:23.274006 30130 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:23.285969 25766 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:11:23.298406 25688 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
W20260709 12:11:23.298313 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44775.2us
I20260709 12:11:23.317448 25690 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:23.310039 25687 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:23.314721 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.323184 25691 raft_consensus.cc:2393] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 16: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:23.275987 29846 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:11:23.325129 26305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.325878 25766 raft_consensus.cc:1275] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:23.326323 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.327028 25688 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:23.328346 30045 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.330425 25686 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:23.330348 30124 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.331511 30132 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.332091 30132 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.332723 30124 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.332957 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.332279 25764 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:23.334936 25762 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:23.325904 29846 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.338049 30125 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.338722 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.338653 30125 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.339433 25687 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:23.340539 30093 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:23.341712 30093 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.342237 29993 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.349980 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.348026 25692 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:23.350836 25693 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:23.353410 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.354028 25693 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:23.316256 30000 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.360309 30000 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.375968 25615 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
W20260709 12:11:23.388720 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 258145us
I20260709 12:11:23.401371 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.316715 30098 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.362784 30110 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.381094 30131 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:23.411844 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.381567 30016 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:23.385675 29993 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.418442 30067 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.419044 30131 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.421362 30131 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.421226 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:23.429642 30098 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.430044 29831 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.428963 25689 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:23.418344 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.414675 30069 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:23.435318 25610 raft_consensus.cc:1240] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.421379 30000 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:23.436928 30126 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
I20260709 12:11:23.444147 25761 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:23.445446 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.448163 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.434844 30098 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.449668 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.449762 29846 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.450690 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.451663 25764 raft_consensus.cc:2410] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:23.452505 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.453379 25764 raft_consensus.cc:2410] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:23.471202 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.473892 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.479797 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.488922 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.493280 25764 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:23.493487 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.486588 30099 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:23.459285 30125 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.489641 29846 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:23.489099 30123 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:23.497656 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:23.507566 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 213051us
I20260709 12:11:23.497963 30098 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.510546 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:23.521621 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 89716.2us
I20260709 12:11:23.509815 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.497265 30099 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.518860 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.527418 29995 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.527645 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:23.517088 29914 consensus_meta.cc:287] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.005s
I20260709 12:11:23.531816 29914 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.533058 25616 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:23.516607 30057 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.534601 30057 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.535182 30057 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.529310 30099 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:23.539932 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.542956 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.543933 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.546232 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.550173 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:23.548539 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.551635 25610 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.554206 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.559959 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.566788 30131 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.567667 30131 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.570557 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.571689 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.553678 29846 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:23.575462 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.576053 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.577884 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.576696 25619 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:23.578783 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.558249 29914 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.574524 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.585590 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.583539 25613 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:23.586724 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.575493 29893 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:23.589867 25610 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:23.591600 25732 leader_election.cc:400] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:23.592033 25732 leader_election.cc:403] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:23.592767 29995 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:23.594033 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.594966 29995 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.595405 29995 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.595768 29995 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.602741 30092 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.605609 29995 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:23.606887 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.607262 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.609093 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.615837 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.612640 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.615829 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.618546 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:23.610622 29993 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:23.622617 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.620940 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:23.623787 25689 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:23.617264 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.624759 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.619939 30137 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.628778 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.629065 30137 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.629522 25762 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:23.630311 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.628087 25687 raft_consensus.cc:2393] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:23.631980 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.628389 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:23.629556 30137 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:23.633896 30127 log.cc:927] Time spent T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.365s	user 0.000s	sys 0.006s
I20260709 12:11:23.633157 29995 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.634660 30138 consensus_queue.cc:1059] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:23.634958 29888 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.635433 29888 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.635653 30138 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.635831 29888 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.636101 30138 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:23.637178 30138 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.609799 30125 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:11:23.627111 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.607599 29807 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:23.643708 25761 raft_consensus.cc:2410] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:11:23.626205 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:23.633984 25691 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:23.646881 25693 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:23.648182 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.658298 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.615923 30136 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:23.662902 30136 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.663337 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.666360 25765 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:23.643445 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.668916 30045 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.669570 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.669847 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.670307 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.673308 25612 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:23.675136 25688 raft_consensus.cc:2393] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:23.679143 30131 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.628425 29996 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:23.627461 29993 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.677685 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.614738 29962 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:23.688064 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.670822 30138 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.663394 30136 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:23.702788 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.708763 25688 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:23.712415 30137 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.715065 30137 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:23.672786 30045 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.719971 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.725091 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.737015 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.701088 29993 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:23.689913 29996 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.716185 29995 raft_consensus.cc:493] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.744218 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:23.748404 25694 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.724053 30045 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.738451 25612 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:23.720942 30131 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.755129 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.748404 29996 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:23.804430 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.754457 30131 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:23.750923 29995 raft_consensus.cc:515] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:23.756713 30057 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:23.821300 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 125066us
I20260709 12:11:23.822755 25694 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:23.809864 30131 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.835927 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.837186 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.839432 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:23.851321 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:23.851730 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.852634 25688 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:23.853044 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:23.853567 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.844054 30120 consensus_queue.cc:1048] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:23.854722 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:23.856616 29914 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:23.857354 29914 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:23.857882 29914 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:23.858951 25688 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:23.858875 29914 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.863011 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:23.846366 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:23.877126 30093 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.881248 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:23.835099 30101 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:11:23.883952 25692 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.823190 30052 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:11:23.895454 25694 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:23.903748 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:23.915629 25619 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:23.919600 25616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1743) took 1095 ms. Trace:
I20260709 12:11:23.920269 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.920238 25616 rpcz_store.cc:276] 0709 12:11:22.807284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.807443 (+   159us) service_pool.cc:224] Handling call
0709 12:11:22.815776 (+  8333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.533442 (+717666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.902622 (+369180us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540008dc54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:23.902867 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649190272}
I20260709 12:11:23.914582 29846 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.930970 29846 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.933441 29846 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:23.934777 25611 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:23.911286 30148 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:11:23.935221 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.935708 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:23.941754 25618 raft_consensus.cc:2410] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:11:23.894246 30099 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:23.921046 30093 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.933949 29996 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.001052 29914 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.937813 29831 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:24.011855 29996 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.008092 29914 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:24.013881 30157 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 12:11:24.015060 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.015672 30151 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 12:11:24.016645 30155 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:23.923539 30101 consensus_queue.cc:1243] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer 8481c5f6be5b4faa9fe7c83301759f65 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:24.027889 30148 log.cc:927] Time spent T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:11:24.070096 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 392524us
I20260709 12:11:24.073577 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.052788 29807 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:24.079432 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.088711 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:24.092438 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 206852us
I20260709 12:11:24.072698 30057 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.054150 29831 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.098238 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2294) took 1362 ms. Trace:
I20260709 12:11:24.079085 29996 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.100557 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.078940 30138 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.091500 29807 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:24.104815 29995 leader_election.cc:290] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:24.093245 30125 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:24.110733 30160 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:11:24.129685 25616 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:24.098721 25759 rpcz_store.cc:276] 0709 12:11:22.735512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.141481 (+405969us) service_pool.cc:224] Handling call
0709 12:11:23.150452 (+  8971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.385405 (+234953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.385440 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.415671 (+ 30231us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.086301 (+670630us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b18000c0c40. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb0d1
0709 12:11:24.086469 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:24.086518 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.086596 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.086637 (+    41us) raft_consensus.cc:1685] finished
0709 12:11:24.086657 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.098163 (+ 11506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4033,"raft.queue_time_us":155613,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":30565,"spinlock_wait_cycles":3484928,"thread_start_us":302604,"threads_started":2,"wal-append.queue_time_us":90124}
I20260709 12:11:24.110379 29996 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.118727 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:24.112875 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.118860 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.097450 30137 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:24.155014 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.135074 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:24.134989 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:24.135818 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:24.135910 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:24.136574 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:24.137202 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:24.138581 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:24.148061 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:24.161872 25615 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 9.
I20260709 12:11:24.153673 25768 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:24.092648 29888 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.124155 30000 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.112252 30138 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.101735 30052 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:11:24.129434 30125 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.160480 30137 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:24.231935 30143 log.cc:927] Time spent T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:24.160647 30101 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.173491 30000 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.165987 30170 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.243722 30138 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.263270 30125 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.269043 29996 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.264767 30137 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:24.278641 30132 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.280185 29831 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:24.274868 30167 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:11:24.275192 29807 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:24.275847 30000 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.253798 29451 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.263514 30099 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.267107 30101 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:24.296034 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 144509us
I20260709 12:11:24.297130 30178 consensus_queue.cc:1059] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:24.301013 30125 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.304919 30125 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.342585 30138 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.344216 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:24.348836 30136 consensus_meta.cc:287] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 12:11:24.349427 30136 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.349707 30123 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:24.285331 30170 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:24.312062 30173 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:11:24.305238 30137 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.314965 30064 raft_consensus.cc:3055] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:24.325659 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 212854us
I20260709 12:11:24.389000 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.295606 29914 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.326354 29888 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.294107 30101 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.297701 30131 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.329727 30172 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:24.332201 29996 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:24.333173 30045 consensus_meta.cc:287] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:11:24.351028 29966 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.408033 29966 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.408463 29966 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.409336 30137 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:24.320701 29993 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.002s
I20260709 12:11:24.412894 29993 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.415283 29993 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.382475 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:24.311829 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:24.397639 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.418015 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.403761 29996 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.418850 30137 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.418990 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.419412 30137 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.419852 30137 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.420610 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:24.403030 30172 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.421430 30172 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:24.424023 29995 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.424660 29995 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:24.424818 30124 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.426470 29888 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.426884 29888 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.427217 29888 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.429328 30137 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.425668 29995 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.431066 30045 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.421352 29996 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.433848 30045 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.431608 30137 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.437625 30170 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.388236 30064 raft_consensus.cc:740] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:24.399297 30125 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.388604 29831 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:24.458976 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.471347 30064 consensus_queue.cc:260] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:24.473630 30064 raft_consensus.cc:3060] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.451715 30125 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.481025 30183 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.456014 30138 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.449671 29996 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:24.486809 25658 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.490482 25658 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.493564 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.494604 30123 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.486756 30125 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.504011 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:24.504568 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:24.504210 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:24.505463 25767 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:24.493323 30102 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.507551 30102 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:24.508888 30102 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.491322 29831 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.512164 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:24.513278 30131 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.518245 25658 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.519884 25761 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:24.486330 30124 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:24.529142 25658 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:24.532255 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:24.522342 30102 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.544765 25766 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:24.525530 30123 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:24.525637 30183 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:24.551158 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 100528us
I20260709 12:11:24.530977 30110 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.563478 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.564308 25693 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.571019 25694 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:24.572409 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.574539 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.576434 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.576583 25658 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.573545 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.573096 25685 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:24.588371 25658 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:24.590783 30057 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:24.591192 30057 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.591532 30057 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:24.593942 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.572345 29807 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.603426 29807 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:24.604429 29807 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.605254 29966 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:24.615613 30165 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.355s	user 0.004s	sys 0.000s
I20260709 12:11:24.566527 30000 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.619758 30000 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.624681 30101 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.626377 25687 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 10 to 12, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:24.633597 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:24.634637 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44408.3us
I20260709 12:11:24.632404 30110 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.638619 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.644562 30177 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:24.645340 30177 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.537569 30172 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:24.647269 30182 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:11:24.569527 30098 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:11:24.648226 29901 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.676321 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.688019 25685 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 15: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:24.670629 30099 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:24.690703 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7b82e0d41f14cc2baa1e889ed4c7312" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:24.692447 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.695469 30125 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.688424 29888 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.699525 30101 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.702770 29966 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.705790 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.654042 30000 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.706311 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.706905 30000 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.707847 25693 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 8.
I20260709 12:11:24.708278 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.727216 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.727571 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.718552 29966 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.672382 30124 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.734690 25657 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:24.735612 30057 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.736721 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.737320 25685 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.737845 30057 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.742754 29966 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.745419 29966 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.745690 30172 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.747357 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.749015 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 2040) took 1099 ms. Trace:
I20260709 12:11:24.749409 25691 rpcz_store.cc:276] 0709 12:11:23.649903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.670034 (+ 20131us) service_pool.cc:224] Handling call
0709 12:11:23.693613 (+ 23579us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.701728 (+  8115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.701779 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.719228 (+ 17449us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.056836 (+337608us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:24.075249 (+ 18413us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.341609 (+266360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.341709 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.708804 (+367095us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b18001f52e0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:11:24.748667 (+ 39863us) raft_consensus.cc:1685] finished
0709 12:11:24.748774 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.748928 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274705,"prepare.queue_time_us":18450,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":1855,"raft.queue_time_us":274398,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":15241,"spinlock_wait_cycles":38781312,"thread_start_us":304436,"threads_started":1,"wal-append.queue_time_us":360395}
W20260709 12:11:24.754312 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 442554us
I20260709 12:11:24.757671 25685 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:24.759171 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:24.762769 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.763273 25767 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.732146 30186 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:24.761365 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.764637 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.765931 25691 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:24.783969 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 68082.4us
I20260709 12:11:24.785238 25689 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:24.795096 29995 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.798339 30068 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.787159 30102 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:24.799829 30102 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.784801 30067 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.797521 29995 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:24.804046 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 130619us
I20260709 12:11:24.807163 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.807772 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.810657 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.813064 25658 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.814446 25658 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.804046 30102 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.827780 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.828603 25688 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:24.787663 30186 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.831624 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:24.812337 30177 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.821218 30057 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:24.846738 25658 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.826372 29999 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.826418 29807 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.861533 25582 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.866465 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:24.831887 30170 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:24.866865 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:24.867166 25686 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.849386 29901 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.871055 29901 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.871570 29901 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.872386 30170 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.874748 30170 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.868024 30099 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.852816 30187 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:24.826401 30092 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:24.879063 30187 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:24.845191 29846 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:11:24.881388 30187 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.846661 29451 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:24.884017 30181 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.328s	user 0.000s	sys 0.003s
I20260709 12:11:24.884130 29995 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.887960 25767 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:24.888188 29888 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.845577 30172 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:24.889012 30172 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:24.889660 30084 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 10 to 12, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:11:24.895412 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47215.4us
I20260709 12:11:24.896341 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:24.898113 30057 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:24.898381 30172 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:24.901562 25690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:24.902367 25690 raft_consensus.cc:606] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:24.902705 25690 raft_consensus.cc:614] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:24.904835 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:24.905565 25617 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:24.905736 30125 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.909355 30136 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:24.849568 30188 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.927752 30186 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:24.939538 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.943347 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:24.945207 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47868.1us
I20260709 12:11:24.950060 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:24.950930 25613 raft_consensus.cc:3060] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.953444 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:24.949513 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 88097.7us
I20260709 12:11:24.957849 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:24.958384 30136 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.958837 25612 raft_consensus.cc:2410] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8481c5f6be5b4faa9fe7c83301759f65 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:24.961274 25612 raft_consensus.cc:1275] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:24.968178 25686 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:24.969978 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.972697 25616 raft_consensus.cc:1275] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:24.973115 25616 pending_rounds.cc:85] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 9
I20260709 12:11:24.973323 25616 pending_rounds.cc:107] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:24.973536 25616 raft_consensus.cc:2889] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.976186 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:24.976735 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:24.978739 25766 raft_consensus.cc:1240] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:24.987948 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.988399 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:24.990475 25761 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:24.976863 25611 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:24.996106 25760 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:24.997093 30125 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.999217 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.001878 25767 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.002839 30153 consensus_queue.cc:1048] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:25.004114 30198 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.004696 30198 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:24.996133 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:25.008165 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.929992 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 7 to 10, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.011597 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.012135 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.018888 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.019630 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.021544 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:25.022390 25763 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.027772 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.032068 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.034222 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.032207 25582 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:24.990083 30136 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:25.037823 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.075426 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.094693 25613 raft_consensus.cc:2468] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:25.059098 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.100124 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.037588 25515 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.019946 30172 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.005645 30198 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.119408 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.026489 29888 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.032866 29995 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:25.128973 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 69965.7us
I20260709 12:11:25.039330 30187 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.136643 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.119912 30124 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:11:25.147557 25761 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:25.041571 30136 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:25.055305 29996 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.162801 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.163655 25689 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:25.149979 25768 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.160363 25658 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.167292 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.117522 30131 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.168326 25687 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 11: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:25.169287 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:25.134357 30155 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:11:25.152199 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:25.136946 25515 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.170362 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:25.171291 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:25.177338 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.179327 30124 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.179818 30124 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:25.142019 29831 consensus_queue.cc:1059] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:25.180833 30124 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.144192 30170 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:25.169584 30136 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:25.183081 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.183718 25685 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.147202 30093 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.189558 25765 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:25.189846 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.205852 25685 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:25.173578 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:25.151434 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.172952 25763 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:25.209833 25764 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:25.172152 30183 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:25.230077 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 166982us
I20260709 12:11:25.232297 25763 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:25.241569 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 209471us
I20260709 12:11:25.242849 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.209880 29966 raft_consensus.cc:2804] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.231328 30124 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.253842 25765 raft_consensus.cc:1240] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:25.229880 30183 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.255926 25763 raft_consensus.cc:1240] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:25.285215 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 180815us
I20260709 12:11:25.250450 30098 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:25.250913 30067 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:25.347838 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 114268us
W20260709 12:11:25.348489 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 105774us
I20260709 12:11:25.256904 29893 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:25.350075 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.350778 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.352032 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.262835 30183 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.359225 25614 raft_consensus.cc:2376] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10. Re-sending same reply.
I20260709 12:11:25.358392 25619 raft_consensus.cc:2376] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9. Re-sending same reply.
I20260709 12:11:25.400866 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.262403 29966 raft_consensus.cc:697] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:25.401082 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.410764 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.410516 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.410943 25515 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.422802 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.424561 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.427104 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.371471 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:25.412477 30196 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:11:25.434545 25619 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:25.436018 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:25.440337 25618 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:25.442226 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.442595 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.436306 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.355458 30185 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:25.368232 30214 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:25.409355 29995 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.460592 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 124224us
I20260709 12:11:25.355720 30098 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.357141 30067 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.479780 30016 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.450135 30214 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:25.500605 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.400283 29893 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.492515 25515 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 6 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:25.480110 30188 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.511541 30188 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:25.515882 30210 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 12:11:25.517763 30212 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 12:11:25.518883 30213 log.cc:927] Time spent T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:11:25.520182 30208 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:11:25.520363 30067 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.477557 29831 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:25.530580 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.537206 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.555757 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.566119 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.473992 29995 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.612293 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60795798854e400987349043af926b8a"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:25.614426 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.613071 25618 raft_consensus.cc:606] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:25.532712 30016 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:25.632921 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.638320 30098 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.638917 30000 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:25.628304 25515 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 9 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:25.570055 30188 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.646994 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.641109 25515 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:11:25.623823 30211 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:11:25.621901 30177 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.654372 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:11:25.642705 30181 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:11:25.657315 25618 raft_consensus.cc:2393] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:25.655795 25515 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 9, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 9 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:25.658373 25732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.000s	sys 0.015s
I20260709 12:11:25.662858 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:25.643796 25617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.003s	sys 0.010s
W20260709 12:11:25.663610 25617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.003s	sys 0.010s
W20260709 12:11:25.665499 25732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.016s
W20260709 12:11:25.662216 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 210837us
I20260709 12:11:25.667172 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.668712 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.669484 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.670200 25618 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.666967 25515 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:25.672788 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.654461 30000 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:25.678777 30000 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.666290 30214 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.681063 30000 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:25.681831 30214 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:25.682013 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.682777 25611 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.683125 30016 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:25.666684 25585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.026s	sys 0.033s
W20260709 12:11:25.684216 25585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.026s	sys 0.033s
I20260709 12:11:25.686304 25618 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
W20260709 12:11:25.689177 29901 consensus_meta.cc:287] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.816s	user 0.013s	sys 0.003s
I20260709 12:11:25.689610 29901 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.532418 29966 consensus_queue.cc:237] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.691012 25611 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:25.655493 30177 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:25.692442 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.703079 25618 raft_consensus.cc:2376] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14. Re-sending same reply.
I20260709 12:11:25.702943 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.704203 25611 raft_consensus.cc:2468] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:25.705528 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.705385 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 9 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.711445 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.712488 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.717761 25768 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:25.719962 29901 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.720781 25691 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:25.721038 30216 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.721869 25767 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:25.721596 30216 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:25.722965 30218 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:11:25.735010 25768 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:25.723863 25610 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:25.738248 25768 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.741276 25614 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:25.735525 30188 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:25.743165 30188 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.741032 30125 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.744105 30125 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:25.744545 30125 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.745573 30188 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.747278 25515 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:25.724436 30084 consensus_meta.cc:287] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.003s
I20260709 12:11:25.751519 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.751732 30228 consensus_queue.cc:1048] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:25.752286 25768 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:25.752282 25515 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:25.749897 25732 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.756779 30000 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:25.761243 30207 log.cc:927] Time spent T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.575s	user 0.008s	sys 0.006s
I20260709 12:11:25.762702 25732 leader_election.cc:304] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.761147 25515 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 12 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:25.772464 30221 log.cc:927] Time spent T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.277s	user 0.003s	sys 0.000s
I20260709 12:11:25.778577 30172 raft_consensus.cc:2749] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.737231 29914 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.782506 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.820201 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:25.822925 29893 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.824676 30000 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:25.825593 30000 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:25.825876 30235 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.826972 30235 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:25.826731 30000 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:25.827893 30235 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:25.789279 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.862597 25515 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 4 to 10, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:25.864140 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.868716 30222 consensus_queue.cc:1059] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:11:25.869411 30216 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.871284 30222 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:25.871744 30222 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:25.872696 30222 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:25.880548 25582 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.897037 25515 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.878563 29995 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:25.904850 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.915980 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.874233 30222 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.928563 25582 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.903653 30215 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:25.881989 30136 consensus_meta.cc:287] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.002s
I20260709 12:11:25.930456 25582 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.927251 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.921245 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:25.938635 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.875207 30243 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.942817 25767 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:25.932850 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:25.944381 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 206527us
I20260709 12:11:25.880216 29893 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:25.813254 30177 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:25.950229 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44509.4us
I20260709 12:11:25.950789 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.876679 29831 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:11:25.954653 25764 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 11: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:25.959839 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:25.960992 25764 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:25.937328 30102 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.963833 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:25.983103 25612 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.983767 29831 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.984297 29831 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:25.931857 30216 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.971575 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:25.960017 29893 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:25.963510 30064 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:25.972577 25610 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:25.988399 25610 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:25.988564 29893 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.989259 25610 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:25.990923 30206 log.cc:927] Time spent T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.725s	user 0.003s	sys 0.000s
W20260709 12:11:25.991132 30238 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:25.993184 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41126 (request call id 351) took 1182 ms. Trace:
I20260709 12:11:25.978988 30225 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.979976 30190 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.980602 30231 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.994849 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:25.993569 25759 rpcz_store.cc:276] 0709 12:11:24.810986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.811191 (+   205us) service_pool.cc:224] Handling call
0709 12:11:24.820694 (+  9503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.828280 (+  7586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.828338 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.836094 (+  7756us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.030281 (+194187us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.099592 (+ 69311us) log.cc:844] Serialized 14 byte log entry
0709 12:11:25.206713 (+107121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.206827 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.990178 (+783351us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:11:25.992862 (+  2684us) raft_consensus.cc:1685] finished
0709 12:11:25.992973 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.993101 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63928,"prepare.queue_time_us":69315,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":6903,"raft.queue_time_us":24208,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":17833,"spinlock_wait_cycles":33945472,"thread_start_us":238063,"threads_started":2,"wal-append.queue_time_us":359939}
I20260709 12:11:26.001197 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.003342 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:26.004072 25617 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:26.004454 25617 raft_consensus.cc:614] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.010738 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:26.005613 30183 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.007s
I20260709 12:11:26.012827 30183 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.013417 25759 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.015476 30183 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:25.953416 30243 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.020426 30243 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:26.021051 30243 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.953171 30178 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:25.985522 29831 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.059350 25765 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:26.087980 25765 pending_rounds.cc:85] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 6
I20260709 12:11:26.088289 25765 pending_rounds.cc:107] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:26.088550 25765 raft_consensus.cc:2889] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.954962 30016 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:11:26.092198 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:26.093060 25615 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.059726 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.009580 29995 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.060786 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.096616 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.097465 25692 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:26.062323 25694 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.067265 25689 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.067471 25686 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.949088 30136 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.048836 25687 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:26.026183 30092 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:26.059636 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.104517 25690 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:26.101940 25613 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:26.091568 30084 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37142 (request call id 4) took 3448 ms. Trace:
I20260709 12:11:26.114714 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.147588 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.148384 25685 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:26.157369 29831 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.162220 25766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2350) took 1148 ms. Trace:
I20260709 12:11:26.162998 25766 rpcz_store.cc:276] 0709 12:11:25.013739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.159273 (+145534us) service_pool.cc:224] Handling call
0709 12:11:25.180280 (+ 21007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.691234 (+510954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.691267 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.691311 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:25.691353 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.161692 (+470339us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54002a8d54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:26.161895 (+   203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.162122 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174609280}
I20260709 12:11:26.176710 25613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
W20260709 12:11:26.182157 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.189800 25612 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:11:26.191433 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:26.193933 30099 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.194509 30099 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:26.195389 30099 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:26.199339 30240 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:26.200811 25615 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:26.095366 30125 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.204640 25658 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:26.117928 30092 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.209879 30092 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.235030 25616 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:26.210625 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.212541 30125 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:26.169858 29901 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:26.219323 30136 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:26.223011 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.112438 30084 rpcz_store.cc:276] 0709 12:11:22.612021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.612271 (+   250us) service_pool.cc:224] Handling call
0709 12:11:22.887831 (+275560us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b2c001557b8. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb1654a11 00007fbdb1663a0a 00007fbdb1663693 00007fbdb1663631 00007fbdb2d963f1 00007fbdb2ccf9fe 00007fbdb2d56749 00007fbdb2d5776a 00007fbdb2d5691b 00007fbdb2d6203c 00007fbdb2d616b3
0709 12:11:23.078465 (+190634us) log.cc:844] Serialized 508 byte log entry
0709 12:11:23.632352 (+553887us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b18002f1880. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafbe8c0a 00007fbdb9328219 00007fbdafc70a40 00007fbdafc6b4e4 00007fbdafc6b455 00007fbdb2cb4b0b 00007fbdb2d39b63 00007fbdb2d61752 00007fbdb2d599fa
0709 12:11:26.060468 (+2428116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238754,"raft.queue_time_us":285008,"raft.run_cpu_time_us":1650,"raft.run_wall_time_us":56868,"spinlock_wait_cycles":28228224,"thread_start_us":224659,"threads_started":1,"wal-append.queue_time_us":301164,"wal-append.run_cpu_time_us":2182,"wal-append.run_wall_time_us":1052921}
W20260709 12:11:26.227171 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 282458us
I20260709 12:11:26.228422 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1901) took 1153 ms. Trace:
I20260709 12:11:26.225553 30183 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.243726 25691 rpcz_store.cc:276] 0709 12:11:25.075261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.078396 (+  3135us) service_pool.cc:224] Handling call
0709 12:11:25.126186 (+ 47790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.721215 (+595029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.228129 (+506914us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54003e3d54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:26.228362 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366815488}
I20260709 12:11:26.244597 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:26.249419 30124 consensus_meta.cc:287] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.986s	user 0.008s	sys 0.007s
I20260709 12:11:26.245558 30190 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.259171 30225 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.246670 30096 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:26.255131 30183 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:26.278878 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:26.292068 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:26.261327 30068 consensus_queue.cc:1059] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:26.261483 29914 consensus_queue.cc:1059] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:26.259020 30170 consensus_queue.cc:1059] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:26.318177 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:26.298095 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5b02303361d43d1903c3e943b866b64 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:26.278635 30189 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:26.307176 30183 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.294064 30185 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:26.281759 30102 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:26.281565 30232 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:26.281992 30101 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:26.271624 30225 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:26.332216 30225 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.332470 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.269893 30190 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:26.335512 30190 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:26.336155 30110 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:26.336746 30110 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.325278 29893 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.311825 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.339067 30110 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.340204 30170 raft_consensus.cc:3055] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.340782 30170 raft_consensus.cc:740] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.341701 30246 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:26.342295 30246 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:26.342842 25501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 44895.2us
I20260709 12:11:26.343267 30068 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:26.343760 30068 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.344156 30102 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:26.344563 30102 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.344669 30068 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.343359 30246 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.341804 30170 consensus_queue.cc:260] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.347303 30170 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.347582 30246 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.350102 29914 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:26.350590 29914 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.322407 25765 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.351516 29914 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.321121 30092 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.353951 30232 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:26.354424 30232 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.355526 30232 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.346347 30185 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.365300 25760 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:26.322737 25657 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:26.345466 30102 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.361003 25765 raft_consensus.cc:1240] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:26.367343 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44683.3us
I20260709 12:11:26.361881 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.364010 25764 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:26.370672 25761 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
W20260709 12:11:26.368832 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:26.371816 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.353178 29914 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:26.346055 30068 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.373698 25657 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:26.379742 30098 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:26.380172 29999 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.384363 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:26.376596 25759 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:26.386070 25759 pending_rounds.cc:85] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 5
I20260709 12:11:26.386375 25759 pending_rounds.cc:107] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:26.386615 25759 raft_consensus.cc:2889] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.394208 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.395431 25760 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:26.387051 30099 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:26.372962 30110 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:26.398980 30102 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.400008 25691 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.368343 30185 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.403394 30064 consensus_queue.cc:1059] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:26.404223 30064 consensus_queue.cc:1243] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Peer c781e437472a42e2a6162b67b1c7bbbd log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:26.387413 30232 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.408660 30186 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.408968 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:26.409227 30186 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.410220 30186 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.410820 30190 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:26.411453 30190 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.411721 30186 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.411806 30190 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:26.420320 30231 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:26.420835 30231 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.422752 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.423708 30124 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.424253 30124 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.398837 30096 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.425928 30096 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.428212 30096 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.429510 30092 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.431304 25613 raft_consensus.cc:606] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:26.431756 25613 raft_consensus.cc:614] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.432510 30189 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.433010 30189 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.435288 30189 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.437376 25610 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.438975 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.442885 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.444070 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.447770 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.451687 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:26.452802 25582 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.455118 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.458029 25766 raft_consensus.cc:1240] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.455083 25611 raft_consensus.cc:2955] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 10 to 12, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:26.470721 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.421737 30231 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.454463 30096 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.480047 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.482314 30214 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:26.457444 30069 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.473538 29893 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.472033 29831 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:11:26.504357 29831 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.504809 29831 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.506968 30237 consensus_queue.cc:1059] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:26.508651 30237 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.509112 30237 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.473237 30190 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.485258 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:26.459632 30222 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:26.505749 29831 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.525429 29831 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.509467 30225 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.490042 30178 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:11:26.535202 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 55053us
I20260709 12:11:26.523465 30231 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:26.544230 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.548636 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:26.549170 25689 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:26.553771 30214 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.521054 30237 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.571022 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:26.571768 25766 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:26.546567 30170 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:26.555224 30110 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:26.584986 25732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.006s	sys 0.010s
W20260709 12:11:26.588759 25732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.011s
W20260709 12:11:26.589644 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 588613us
I20260709 12:11:26.594792 25618 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.594851 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.593538 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.603324 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.613787 25761 raft_consensus.cc:1275] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:26.559396 30190 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.615610 25689 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:26.615902 25766 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:26.616983 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.618146 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:26.618866 25617 raft_consensus.cc:606] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:26.621236 25583 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:26.590209 30246 raft_consensus.cc:993] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:26.614414 25761 pending_rounds.cc:85] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 7
W20260709 12:11:26.624300 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51702.6us
I20260709 12:11:26.626492 25761 pending_rounds.cc:107] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:26.627146 25761 raft_consensus.cc:2889] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:26.633634 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.643517 30068 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:26.644255 30068 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.645220 30068 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.647956 30186 raft_consensus.cc:1081] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:26.649363 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:26.651837 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:26.652153 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48914.1us
I20260709 12:11:26.653154 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.654460 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.654687 30198 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:26.655787 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.656900 25759 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.658063 30215 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.658248 30136 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.658452 30125 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.658517 30235 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:26.658185 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.626396 25619 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:26.667375 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.610284 30250 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.658074 30198 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.626598 30000 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:26.720052 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52738.2us
I20260709 12:11:26.701123 30235 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.716809 29831 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.711936 30237 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.698904 25761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:26.624332 30185 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.713851 29995 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.738595 25761 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:26.741072 25761 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:26.717810 30198 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:26.721771 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.715345 30132 consensus_queue.cc:1048] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:26.759263 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.776482 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.739722 29831 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.798499 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:26.800441 30177 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.778822 29995 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.760610 30235 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:26.811110 30124 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:26.782929 30198 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:26.784577 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.816190 30185 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.820370 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:26.820726 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:26.821667 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:26.828133 25762 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.829221 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.773185 25761 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.824088 30235 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.824671 29831 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.840147 25761 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:26.847201 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:26.835148 30124 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.854377 30124 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:26.855429 30124 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.846983 30125 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:26.859519 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.861965 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.862933 30136 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.870904 25617 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.873042 30190 raft_consensus.cc:993] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:26.870612 30235 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.874747 30190 raft_consensus.cc:1081] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:26.875751 30216 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.876178 30216 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.861622 30068 consensus_queue.cc:1059] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:26.859656 30250 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.884737 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.885485 30250 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:26.886803 30250 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.887792 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.839860 30261 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.897490 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:26.893800 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.893980 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:26.896317 25610 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:26.896438 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:26.899185 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:26.897523 25762 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:26.901185 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:26.905652 25614 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:26.906003 25614 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.906438 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:26.908159 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.910115 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.916625 30235 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.916683 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:26.919534 30271 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:26.919914 30125 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.909267 30131 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.912417 25614 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.925558 25614 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:26.915515 30215 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:26.910214 30064 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:26.938112 30064 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:26.938827 30198 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.939153 30064 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:26.909157 30136 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:26.909288 29995 raft_consensus.cc:2764] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:11:26.950244 30225 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:26.960944 25614 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
W20260709 12:11:26.977802 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67772.6us
I20260709 12:11:26.979043 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:26.979449 25610 pending_rounds.cc:85] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 8
I20260709 12:11:26.979804 25610 pending_rounds.cc:107] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:26.980033 25610 raft_consensus.cc:2889] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.985124 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:26.970872 30215 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.977092 30274 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:11:26.986577 25612 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:26.990545 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:26.993959 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:26.994016 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.994583 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:26.994904 25690 raft_consensus.cc:2368] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17.
I20260709 12:11:26.996040 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:26.996978 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:26.997627 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:26.998406 25685 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:27.005776 25767 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.006474 25767 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:26.994181 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.016242 25619 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:27.010164 25691 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:27.020640 25685 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:27.007547 25767 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.022432 25767 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.023310 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:26.985332 30250 raft_consensus.cc:2764] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:11:27.028205 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:27.006121 30125 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.121563 25767 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:27.006485 30092 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.984663 30136 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:11:26.986894 30131 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:11:27.033244 29901 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.134238 30273 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:11:27.063011 30096 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:27.112948 30260 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:11:27.135109 30281 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:11:27.135710 30223 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.182710 25764 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:27.183225 25764 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.122171 25767 pending_rounds.cc:85] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 5
I20260709 12:11:27.021922 30183 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.155565 29807 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.161010 29901 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.170398 30096 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.009902 30215 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.183977 25767 pending_rounds.cc:107] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 12:11:27.184693 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.153591 30270 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:27.189978 25767 raft_consensus.cc:2889] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:27.186213 30263 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:11:27.188783 30214 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.194741 30272 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.345s	user 0.001s	sys 0.002s
I20260709 12:11:27.229888 30068 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.231856 30215 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:27.187438 30183 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.189873 29807 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.190630 30096 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.155019 30092 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:11:27.246325 30240 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:27.183622 30279 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:11:27.253458 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 129982us
I20260709 12:11:27.187124 30124 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:27.188424 30223 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:27.259671 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 231518us
I20260709 12:11:27.261353 25685 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:27.263227 25691 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.263269 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.263972 25610 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:27.265198 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:27.265672 25691 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:27.267421 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:27.267108 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.267582 25732 leader_election.cc:400] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17.
I20260709 12:11:27.268268 25732 leader_election.cc:403] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:11:27.268070 25688 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:27.266623 30110 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.270941 29901 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.271538 30110 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.273677 30110 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.274658 25691 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:11:27.274889 30215 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17.
I20260709 12:11:27.277037 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:27.278914 30215 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:27.282177 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 294925us
I20260709 12:11:27.247092 30214 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.286665 25616 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:27.290192 25688 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:27.380373 25618 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:27.380684 29807 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.382973 30214 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.384433 30223 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.292321 29893 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:11:27.388109 30092 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.408645 30216 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.446785 30136 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:27.447178 30216 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.447273 30170 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.447383 30136 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.447862 30170 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.449924 30136 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:27.413637 30278 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.502s	user 0.014s	sys 0.000s
I20260709 12:11:27.419847 30131 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.423840 25610 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:27.252494 30068 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.439654 25759 raft_consensus.cc:1240] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:27.441280 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 153072us
I20260709 12:11:27.446292 30215 raft_consensus.cc:493] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:27.452625 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:27.441686 25764 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.284243 30124 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:27.479238 25763 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:27.481298 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.482079 25765 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
W20260709 12:11:27.486431 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 200555us
I20260709 12:11:27.496081 25732 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:27.470228 30131 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:27.501835 25611 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:27.489151 30214 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.509828 25658 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:27.499336 30235 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:27.517009 30286 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:27.500902 26338 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEARNER]: Advancing to term 8
I20260709 12:11:27.489333 30215 raft_consensus.cc:515] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:27.499240 30284 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:11:27.517932 30235 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.533063 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.533993 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.534677 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.535800 29451 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.534775 25617 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:27.536304 29451 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.536757 29451 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.535672 25618 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:27.537967 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:27.524753 30198 consensus_meta.cc:287] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.008s
I20260709 12:11:27.543596 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.543850 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.546526 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.548211 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.549172 25767 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:27.521795 30292 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.560863 25610 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:27.562871 25685 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:27.557719 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.511921 30214 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:27.558971 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:27.553862 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.535048 30235 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:27.553786 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.565109 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:27.570658 25618 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:27.597406 30298 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.597901 30298 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:27.598944 30299 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.599908 30299 raft_consensus.cc:2764] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:27.565838 29831 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:27.528542 30131 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.606230 25617 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 8.
W20260709 12:11:27.632673 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 92929.7us
I20260709 12:11:27.554946 30102 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:27.525879 30124 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.634022 29451 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:27.649113 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 90279.3us
W20260709 12:11:27.635605 30265 log.cc:927] Time spent T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:27.603675 30298 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:27.658442 30260 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:27.639325 30170 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.650353 30123 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.635442 29831 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.659986 30099 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.656845 30110 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.680122 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.692582 25616 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:27.665103 25658 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.708433 29451 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.708374 25658 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.710625 25582 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:27.661710 30068 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.714195 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:27.709931 30296 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:11:27.694198 30250 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:27.731123 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.731850 25768 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:27.706717 30098 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.740304 30098 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.742658 30215 leader_election.cc:290] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:27.742815 30098 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.745934 29831 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.715226 30305 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:27.706072 30125 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:27.750005 30183 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.774801 25688 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.778650 30183 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.779203 30183 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.781862 30183 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.746207 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:27.749615 30295 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:27.758036 25759 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:27.757844 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44784.8us
I20260709 12:11:27.803753 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.804363 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.715652 30110 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.714232 30099 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.707752 30123 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.732438 30170 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.762688 30286 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:27.764802 30096 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.798848 30305 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.814178 30214 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.757377 30297 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:27.770525 26338 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:27.719195 30198 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:27.719224 30190 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:27.773659 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.774859 25690 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:27.775013 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.715351 29893 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.792474 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:27.795114 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 300808us
I20260709 12:11:27.795599 25764 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:27.799419 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:27.727311 30292 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:27.802083 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.804728 29451 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.851446 29451 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.806885 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.853298 25688 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
W20260709 12:11:27.853598 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61265us
I20260709 12:11:27.851488 25766 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:27.810222 25685 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:27.810371 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.812127 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.831696 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.826575 30305 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:27.807765 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.858230 25762 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:27.835441 30110 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.809540 29966 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.814486 30170 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.871789 30170 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:27.871922 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 59874.5us
I20260709 12:11:27.866241 30301 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.876165 30301 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.837869 30096 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.878742 30096 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.845269 29893 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.832679 30099 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.828912 30123 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.879489 29893 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.809648 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:27.879662 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.859123 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:27.869014 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:27.879182 30096 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.869832 29831 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:27.870900 29966 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.881505 29831 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.881940 29831 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:27.882858 29451 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.883039 29966 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.878871 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.883855 25615 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:27.865833 25694 raft_consensus.cc:2393] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:27.881000 30096 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.842600 30198 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.885334 30198 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:27.840512 30098 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.891404 30098 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.891232 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.891896 30098 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.890969 29831 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.892226 25615 raft_consensus.cc:2393] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:27.881065 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:27.895962 25611 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.896584 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.897410 25618 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:27.902403 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.903425 25615 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
W20260709 12:11:27.904466 30300 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.259s	user 0.001s	sys 0.004s
I20260709 12:11:27.904050 30170 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.906706 25611 raft_consensus.cc:2468] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:27.913201 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:27.913923 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.914852 25618 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:27.926338 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.929559 25618 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:27.933615 25612 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:27.845220 30298 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.907929 30292 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.939566 29831 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:27.940429 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 75500us
I20260709 12:11:27.941618 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.942865 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:27.814495 30235 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:27.947054 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 80242.6us
W20260709 12:11:27.947471 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 134376us
I20260709 12:11:27.950565 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:27.909502 30131 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.843549 30250 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 12:11:27.944521 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 70020.3us
I20260709 12:11:27.953298 25611 raft_consensus.cc:2368] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13.
I20260709 12:11:27.960330 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.964196 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.965454 29451 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:27.965907 29451 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:27.966316 29451 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:27.966445 30068 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:27.967978 30214 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.968357 30214 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:27.969270 30214 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.956951 30301 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:27.970680 30183 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:27.970404 30096 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:27.972505 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:27.959483 29846 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:27.976344 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:28.008502 25616 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:27.978602 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:28.009151 25760 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:27.965590 25658 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:27.985252 25615 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.987105 25612 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 12:11:28.010752 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45264.1us
I20260709 12:11:28.011176 29451 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:27.987649 25762 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:27.991304 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:28.013458 25766 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:27.965029 30124 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:11:28.011513 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:28.018603 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:27.991267 30289 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.043467 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:28.049023 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:27.995206 30183 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:28.065796 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:28.064057 30301 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.007815 29846 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:28.040211 30214 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.075057 29451 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.042670 29966 raft_consensus.cc:2804] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.049454 30188 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:28.079151 30188 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.043677 30064 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.065135 30307 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.072546 30183 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:28.081413 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 63036.2us
I20260709 12:11:28.074891 29807 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:28.042495 30250 consensus_queue.cc:1059] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:28.077994 30309 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.079602 30188 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:28.042670 30237 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:28.077212 29846 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.076259 30223 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.040458 29995 consensus_queue.cc:1059] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:28.087239 30307 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:28.074000 30301 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.107123 30098 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.132782 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:28.090459 29807 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:28.142520 25616 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:28.134013 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59652.6us
I20260709 12:11:28.086750 30064 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.121157 30309 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:28.134011 30307 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:28.158684 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 85070.8us
I20260709 12:11:28.160842 25658 leader_election.cc:400] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13.
I20260709 12:11:28.161216 25658 leader_election.cc:403] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:28.146452 29807 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:28.207767 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44335.4us
I20260709 12:11:28.213207 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:28.244465 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:28.245340 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:28.246704 25761 raft_consensus.cc:2393] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:28.247642 25583 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:28.249327 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:28.254070 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:28.258836 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:28.259804 25766 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:28.162916 30092 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.163239 30298 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.264377 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:28.265241 25767 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:28.268628 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:28.234721 30190 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.229696 30235 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:28.290186 25615 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:28.265061 30237 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:28.301503 30321 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:28.303494 30310 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:28.307797 25616 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:28.310493 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:28.313971 25767 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:11:28.316125 30317 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:11:28.283881 30190 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.280668 30096 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.327514 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:28.322510 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:28.329514 25767 raft_consensus.cc:2393] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:28.265704 29966 raft_consensus.cc:697] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:28.334652 25761 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 15: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:28.306785 30235 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.330077 30310 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.382941 30310 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:28.391040 30314 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
W20260709 12:11:28.393463 30319 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:11:28.396416 30292 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.378752 30237 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:28.397204 30292 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:28.398479 30237 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:28.407070 30323 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 12:11:28.412397 30301 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:28.402125 30313 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:11:28.378366 29966 consensus_queue.cc:237] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.396569 30190 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:28.469568 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 138678us
I20260709 12:11:28.470775 25583 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:28.512444 30190 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:28.513793 30297 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.514351 30297 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:28.515655 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 45023.6us
I20260709 12:11:28.516412 30297 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:28.516556 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:28.517539 30190 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:28.529454 25760 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.004s
I20260709 12:11:28.518211 30190 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.532055 25760 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:28.514547 30092 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13.
I20260709 12:11:28.555768 25618 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:28.280933 30309 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.526810 30123 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:28.635737 25690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.025s	sys 0.012s
W20260709 12:11:28.636454 25690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.025s	sys 0.012s
I20260709 12:11:28.568789 30327 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.659240 30300 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:11:28.636690 30198 consensus_meta.cc:287] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.000s
I20260709 12:11:28.625654 30098 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:28.685057 30325 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:11:28.658519 30297 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.687024 30297 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.689800 30297 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:28.691493 30310 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:28.654625 30064 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.556413 30292 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.623549 30123 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.660383 30237 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:28.706780 30320 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.435s	user 0.003s	sys 0.014s
I20260709 12:11:28.711549 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:28.662448 30327 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.699395 30310 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:28.714360 25644 heartbeater.cc:646] Failed to heartbeat to 127.23.222.190:33735 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.222.190:33735 timed out after 15.000s (SENT)
I20260709 12:11:28.682685 30198 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:28.717365 30131 consensus_meta.cc:287] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.760s	user 0.013s	sys 0.000s
I20260709 12:11:28.748956 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:28.757558 25763 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:28.758014 25763 pending_rounds.cc:85] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 5
I20260709 12:11:28.758229 25763 pending_rounds.cc:107] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:28.717860 30292 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.758617 25763 raft_consensus.cc:2889] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.765368 25692 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 16: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
W20260709 12:11:28.766223 30183 consensus_meta.cc:287] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.006s
I20260709 12:11:28.766703 30183 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.768869 30183 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.769371 30315 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:28.782352 30331 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:11:28.719587 30237 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:28.786896 30334 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:11:28.789206 30237 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:28.790105 30188 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.000s
W20260709 12:11:28.900122 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 90978.1us
I20260709 12:11:28.791016 30315 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:28.753767 30310 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.934859 30327 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.941274 30310 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:28.926064 29846 consensus_meta.cc:287] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.004s
I20260709 12:11:28.942849 29846 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.946125 29995 raft_consensus.cc:1064] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:28.918637 30237 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.931609 29807 consensus_meta.cc:287] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.004s
I20260709 12:11:28.951790 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca1ee2242e042518b1c8986c3bd8955" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:28.918843 30131 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.952040 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:28.952307 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:28.844677 30299 raft_consensus.cc:3055] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.954202 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:28.977377 25685 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:28.954568 25688 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:28.977632 25689 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:28.924346 30235 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.013721 30235 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.014424 30292 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.015094 30292 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.016002 30124 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.016587 30124 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.862756 30188 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.020474 30188 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.975983 25694 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.954768 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:28.979547 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:28.979655 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:29.026811 25691 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 9: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:29.026705 25614 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:29.026993 25689 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 16: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:28.981155 25693 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 13: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:28.982151 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54032 (request call id 2400) took 1445 ms. Trace:
I20260709 12:11:29.030228 25763 rpcz_store.cc:276] 0709 12:11:27.536724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.536917 (+   193us) service_pool.cc:224] Handling call
0709 12:11:27.559238 (+ 22321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.759206 (+1199968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.981825 (+222619us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400249fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:28.982067 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2754957056}
I20260709 12:11:28.979286 30237 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.033119 30237 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.033871 25690 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:29.034966 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:28.982627 30339 log.cc:927] Time spent T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:11:28.983054 30336 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:11:28.989545 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:28.977070 30299 raft_consensus.cc:740] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:28.994378 29807 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:28.995141 30123 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:28.995326 30131 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.049341 29807 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.049863 30131 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:28.975268 29893 consensus_meta.cc:287] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 1.095s	user 0.014s	sys 0.000s
I20260709 12:11:29.050558 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.050655 29893 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.051436 25614 raft_consensus.cc:2368] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.052907 29893 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.052596 30299 consensus_queue.cc:260] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:28.980068 29995 raft_consensus.cc:1068] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Unable to promote non-voter 8481c5f6be5b4faa9fe7c83301759f65: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:11:29.053655 30223 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.053802 25687 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.998282 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.054051 29995 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.054289 30223 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.054610 29995 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.056676 30223 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.056823 25687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39692 (request call id 1926) took 1282 ms. Trace:
I20260709 12:11:29.001924 30315 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.043077 30297 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.059043 30297 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.003750 30198 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:29.004963 25692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39702 (request call id 2126) took 1197 ms (client timeout 1580 ms). Trace:
W20260709 12:11:29.062970 25692 rpcz_store.cc:269] 0709 12:11:27.807714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.809412 (+  1698us) service_pool.cc:224] Handling call
0709 12:11:29.004709 (+1195297us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400345dd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:29.004869 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035393920}
I20260709 12:11:29.006543 30170 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:29.011684 30307 consensus_meta.cc:287] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.000s
I20260709 12:11:29.020368 25685 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:29.032998 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:28.963796 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:28.982527 29846 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.038199 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:29.035647 25689 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:29.045540 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.046175 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.074532 25690 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:29.054561 25688 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:29.061856 30297 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.057226 25687 rpcz_store.cc:276] 0709 12:11:27.774170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.784700 (+ 10530us) service_pool.cc:224] Handling call
0709 12:11:27.785074 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.055283 (+1270209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.056571 (+  1288us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003ffa54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:29.056755 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917349632}
I20260709 12:11:29.042447 30250 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.069662 25694 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:28.999296 30308 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:29.095849 25686 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.083488 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.067800 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.093027 25614 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:29.097090 25767 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.097165 25685 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:29.053689 30299 raft_consensus.cc:3060] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.100827 25612 raft_consensus.cc:1240] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.102371 30235 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.103729 30308 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.056833 29995 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.075325 30307 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.110085 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.112134 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.112874 25614 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:29.115064 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.115721 25612 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:29.117050 25618 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:29.117563 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.120609 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.120699 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:29.121302 25616 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:29.121472 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.124138 25618 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:29.126017 25760 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:29.096266 30131 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.139163 30131 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.099958 30170 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.134927 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.107439 30250 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.136669 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.141608 25759 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:29.145256 25691 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:29.147954 25767 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:29.111094 30237 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.151659 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.108150 30308 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.155990 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.164202 25760 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:29.123461 29995 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.181095 25764 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:29.157341 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:29.161686 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:29.185786 25612 raft_consensus.cc:2368] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.186602 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.189337 25616 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:29.206765 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:29.128885 30190 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:11:29.162424 30305 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.216531 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.164639 30297 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:29.225365 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 103133us
I20260709 12:11:29.226167 25583 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:29.229737 25617 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:29.156312 30170 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.205488 30308 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.163679 30237 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.240754 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.247836 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.252276 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.190696 29995 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.253852 29451 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:29.254457 29451 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.254890 29451 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:29.270756 25614 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:29.272889 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:11:29.278705 25583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.222.130:39349 timed out after 1.580s (SENT) [suppressed 15 similar messages]
I20260709 12:11:29.285436 25763 raft_consensus.cc:2368] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.311169 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.312155 25765 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:29.221494 30305 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.253168 30177 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.231784 30297 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:29.325721 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 203533us
I20260709 12:11:29.327684 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:29.333061 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.330830 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:29.342079 25764 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:29.349198 29451 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.343710 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.351320 25764 raft_consensus.cc:2393] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:11:29.351226 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 144548us
I20260709 12:11:29.352324 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.245898 30308 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:29.355777 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 74584.2us
I20260709 12:11:29.356956 25658 leader_election.cc:400] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.357333 25658 leader_election.cc:403] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.374642 29451 leader_election.cc:290] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.354928 25763 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:29.395539 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.396621 25764 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:29.397254 29451 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
W20260709 12:11:29.403033 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 124270us
I20260709 12:11:29.396720 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.406862 25658 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.410475 29451 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:29.411343 29451 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.414095 25658 leader_election.cc:400] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.414448 25658 leader_election.cc:403] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:29.413221 30099 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:29.416792 30099 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:29.417387 30132 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:29.382035 30223 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.425251 29451 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.393060 30307 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.415026 30131 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.450759 29995 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.429091 30343 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:29.423257 30330 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:29.468489 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 116118us
I20260709 12:11:29.415711 29893 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:29.443163 30250 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.444591 30346 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:29.417781 30099 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.453681 29966 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:29.484040 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:29.461185 30350 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.470000 30235 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.470324 30131 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.497574 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:29.502241 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:29.467185 30330 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.507408 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:29.510746 25614 raft_consensus.cc:606] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:29.511236 25614 raft_consensus.cc:614] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.472091 30343 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:29.515722 25657 leader_election.cc:400] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.518003 25765 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
W20260709 12:11:29.520354 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.496269 29807 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.524034 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:29.526871 25617 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:29.499120 30190 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.475210 30337 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:11:29.526700 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.498653 30250 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:29.529507 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.521814 30315 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.515748 30330 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.498534 30357 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.505940 30344 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.524622 30305 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.533038 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:29.507874 30131 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.553328 25617 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:11:29.519932 30124 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.500820 30350 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.548825 30237 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.506116 30235 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.532258 30310 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.553412 30349 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:29.498867 29966 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.571056 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:29.586608 25617 raft_consensus.cc:606] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:29.587024 25617 raft_consensus.cc:614] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.547660 30250 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.528615 30346 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:29.551627 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:29.563544 30297 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.537879 30190 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.571841 30362 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:29.598124 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46617.6us
I20260709 12:11:29.605614 25614 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:29.611997 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.612674 25691 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:29.576951 30292 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:29.609408 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 112049us
I20260709 12:11:29.614418 25732 leader_election.cc:304] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:29.639568 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:29.640232 30348 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:11:29.599730 29999 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:29.639606 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.640480 25691 raft_consensus.cc:2393] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 17: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:29.644192 30250 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.582656 30310 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:29.607712 30345 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:11:29.640338 25693 raft_consensus.cc:1240] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:29.654102 30250 raft_consensus.cc:2749] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:29.567131 30344 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.608556 30361 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.564942 30357 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.656872 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:29.659968 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 332351us
I20260709 12:11:29.586238 30349 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.668620 30170 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.650336 30362 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:29.580888 30237 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:29.678812 30131 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:29.683066 29995 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.685372 25691 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:29.572045 30343 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.695420 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:29.682858 30355 log.cc:927] Time spent T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:29.704221 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:29.706291 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44028.1us
I20260709 12:11:29.708074 25582 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:29.713944 30188 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.660482 30250 consensus_queue.cc:1059] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:11:29.719887 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.722571 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.706059 30170 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.714504 30188 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:29.661984 30361 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.734375 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.734076 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.696130 30237 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:29.721102 30346 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.760912 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.779762 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.780591 25767 raft_consensus.cc:2368] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.780920 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.761430 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.786682 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.787606 25765 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:29.762655 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.789114 25689 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:29.763770 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.764334 30362 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.767629 29966 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.769480 30349 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:29.771097 30358 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:11:29.771737 30235 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.774827 30190 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:29.734012 30170 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.776927 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.719976 30131 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:29.720501 30310 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.794693 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.820011 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.795138 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.782672 25516 catalog_manager.cc:5697] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.823781 25764 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:29.785686 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.796461 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.824714 25763 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:29.796630 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:29.799042 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.802611 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.803179 30132 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:29.795944 30099 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.806622 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.809566 30292 consensus_queue.cc:1059] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:29.811088 30350 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:29.812297 30357 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.814460 30361 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:29.827145 30131 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.852842 30131 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:29.853506 25760 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:29.855633 25764 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:29.857173 29995 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:29.820515 25685 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:29.860143 30308 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:29.861748 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 76166.7us
I20260709 12:11:29.823205 25688 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:29.831566 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.836840 30349 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.837818 25762 raft_consensus.cc:2393] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:29.842594 30099 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.863729 25763 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:11:29.862984 25583 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.861510 25516 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index -1 to 6, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 7 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:29.870007 30188 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.871619 30099 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.868021 30190 raft_consensus.cc:2764] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:29.874982 30349 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.892006 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:29.893846 30360 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:29.894512 30360 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:29.899955 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6640372ef1e64554b6b1025b28173499"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:29.900647 25614 raft_consensus.cc:606] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:29.901824 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.902076 25693 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
W20260709 12:11:29.840610 30177 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.000s
I20260709 12:11:29.907272 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.866910 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.915935 25692 raft_consensus.cc:2393] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 16: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:29.909510 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.911463 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:29.919188 25618 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
W20260709 12:11:29.933355 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.938604 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:29.938834 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 71995.5us
I20260709 12:11:29.939369 25685 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:29.941184 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:29.942714 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:29.942714 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.821978 30250 consensus_queue.cc:1059] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:11:29.951887 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.940225 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.943041 30344 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:29.955638 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 240145us
I20260709 12:11:29.957372 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:29.959183 25658 leader_election.cc:304] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.909000 30131 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:29.868921 30372 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.914721 30356 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:29.953375 30361 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:29.937680 30177 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.963037 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:30.009994 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47016.1us
I20260709 12:11:29.999145 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:29.986791 25516 catalog_manager.cc:5697] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:30.000967 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.000968 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.002550 25582 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:30.011693 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:29.959676 30327 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:30.017612 30327 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:29.967370 30372 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.022583 30372 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.023070 30327 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.024545 30170 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:29.912813 29995 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:30.026677 30292 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.964668 30131 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.027268 30292 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.027555 30131 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:30.027947 30292 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.006620 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.030025 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.018523 30214 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:30.031224 30214 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:30.031261 30309 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:30.031803 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.031984 30309 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:30.032202 30214 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.033003 30309 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:30.034622 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.038324 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.042062 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.961229 30350 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:29.967262 30096 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:29.967307 30356 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:30.019598 30360 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.060693 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.045776 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.065438 25762 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:30.055171 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:29.962371 30357 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.007464 30361 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.059187 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:30.080716 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:30.074048 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.086687 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.087453 25618 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:30.087872 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.089398 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.090818 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.091439 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.109393 25616 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:30.091486 25612 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:30.093262 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.110244 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.107098 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.095875 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.091877 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.115936 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.116647 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:30.117372 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.118067 25618 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:30.119043 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.120154 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.120262 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.122109 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:30.076067 30223 consensus_meta.cc:287] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.007s
I20260709 12:11:30.114902 25613 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:30.133522 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.126569 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.128789 25612 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.137382 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.088680 30361 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.088447 30354 raft_consensus.cc:2764] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:30.084311 30297 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.128925 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.108390 30364 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:30.140920 30358 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:11:30.084024 30357 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.131167 30350 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:30.133854 30223 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.142882 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:30.171936 25612 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:30.153702 30364 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.091315 30346 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:30.085112 30096 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:30.138204 25761 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:30.174929 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.140461 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:30.183679 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.185359 25759 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:30.185863 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.188252 25686 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:30.192938 30250 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:30.194773 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 65364.3us
I20260709 12:11:30.212829 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:30.166031 30237 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:30.214550 30250 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:30.223292 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:30.214712 30377 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:30.229122 30360 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.231755 30357 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.199270 30364 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:30.219368 30064 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:30.215468 30299 consensus_meta.cc:287] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 1.100s	user 0.006s	sys 0.029s
I20260709 12:11:30.275890 25657 leader_election.cc:400] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16.
I20260709 12:11:30.224666 30302 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.221626 30349 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:30.302920 30383 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:30.304287 30096 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.281055 25768 raft_consensus.cc:1275] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 12:11:30.280471 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 217711us
I20260709 12:11:30.309036 25768 pending_rounds.cc:85] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 8
I20260709 12:11:30.309401 25768 pending_rounds.cc:107] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 12.9
W20260709 12:11:30.287061 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 154419us
I20260709 12:11:30.309793 25768 raft_consensus.cc:2889] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.310876 25582 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:30.289206 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 65981.3us
W20260709 12:11:30.289462 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 72790.5us
I20260709 12:11:30.235898 30237 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:30.294849 30376 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:30.315225 30237 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.315685 30237 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:30.320866 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:30.322314 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:30.309427 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:30.329716 30291 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.321628 30393 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.327863 30368 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.329810 30198 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:30.338687 30291 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.359905 30291 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.265987 30350 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.368760 30131 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.352653 30368 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.407222 30368 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.412071 30372 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.418897 25617 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:30.327193 30250 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.423175 30250 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.347856 30391 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:11:30.374344 30330 consensus_meta.cc:287] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.809s	user 0.007s	sys 0.002s
I20260709 12:11:30.372311 30198 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.402376 30131 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.403790 30366 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.406461 30310 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.353117 30327 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:11:30.449023 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:30.428548 30356 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:30.447304 30198 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:30.463037 25610 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:30.466089 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:30.469583 25617 raft_consensus.cc:606] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:30.449854 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 111780us
I20260709 12:11:30.472213 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:30.480028 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:30.482591 30123 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:30.452627 30310 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:30.436434 25582 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.471046 30372 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:30.547049 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 110699us
I20260709 12:11:30.448592 30330 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.551770 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.457520 30366 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.553759 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.544660 29831 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:30.555605 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:30.561666 25619 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:30.501667 30099 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:30.560186 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60481.2us
I20260709 12:11:30.447484 30391 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.568558 25691 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:30.579802 30237 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.589443 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
W20260709 12:11:30.595628 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 239915us
I20260709 12:11:30.596544 30346 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.569675 30310 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.599942 25759 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:30.601783 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.603350 25767 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:30.604736 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
W20260709 12:11:30.604965 30397 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:11:30.590205 25617 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:30.607003 25617 raft_consensus.cc:614] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:30.597114 30346 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.613015 25766 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:11:30.609651 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 137550us
I20260709 12:11:30.618606 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.621759 25582 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.625501 30344 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:30.625897 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.629827 30359 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.630636 30359 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.633076 30359 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.628955 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:11:30.644832 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 164923us
I20260709 12:11:30.645681 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:30.646736 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.598126 30310 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:30.673731 30405 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:30.565599 30099 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.678023 30235 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.680255 30235 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.683533 30366 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.684437 30237 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:30.685491 30292 consensus_meta.cc:287] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.000s
I20260709 12:11:30.685637 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.686863 30349 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:30.687433 30361 consensus_meta.cc:287] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: Time spent flushing consensus metadata: real 0.534s	user 0.005s	sys 0.006s
I20260709 12:11:30.687754 30357 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:30.688125 30361 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.675691 30344 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.689824 25611 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:30.690354 29995 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:30.690804 29995 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.691128 29995 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:30.693887 30391 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.694732 30131 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.695374 30131 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.653667 30337 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:30.699329 30223 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.699872 30223 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.700356 30368 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.683320 30198 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.702394 30286 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.702958 30286 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.704264 30198 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.687366 25732 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:30.707288 30299 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.708251 30291 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:30.710460 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 96118us
I20260709 12:11:30.712698 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:30.714346 29846 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.714879 29846 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.715188 29846 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:30.715893 30396 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:11:30.720557 30356 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.722916 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:30.725713 25691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39692 (request call id 1940) took 1022 ms. Trace:
I20260709 12:11:30.726101 25691 rpcz_store.cc:276] 0709 12:11:29.703753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.703924 (+   171us) service_pool.cc:224] Handling call
0709 12:11:30.725505 (+1021581us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b5400195fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:11:30.725647 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981143424}
I20260709 12:11:30.727355 30299 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.727926 30299 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:30.728438 30299 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.729285 30330 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.729417 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:30.730278 30343 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:30.654501 30327 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.731973 30327 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.735085 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.742542 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:30.743412 25618 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 17: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:30.748759 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.749790 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:30.747393 25619 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:30.751469 25613 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:30.752599 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:30.753511 25619 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:30.754359 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:30.755686 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.654798 30132 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:30.734045 30327 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.705099 30286 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.702011 30223 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.789350 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.786810 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.793776 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.797107 25688 raft_consensus.cc:1240] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:30.797230 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:30.783548 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45787us
I20260709 12:11:30.655512 30359 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.655633 30250 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.786955 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.835542 25691 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:30.802925 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:30.807363 25687 raft_consensus.cc:1240] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: [9.7-12.8]
I20260709 12:11:30.808350 30099 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.754987 30235 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.809738 30291 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.810154 29846 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.814770 30361 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:30.815629 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.727648 30364 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.686013 30292 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.834658 30368 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.830168 30131 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.849066 30299 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.872072 30299 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.873541 29846 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.841156 30350 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.834167 25693 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:11:30.840224 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.847502 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:30.847671 25690 raft_consensus.cc:1240] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:30.766747 30132 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:11:30.858516 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 83880.9us
I20260709 12:11:30.834380 30400 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.833226 30337 consensus_queue.cc:1048] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:30.885797 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:30.862108 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.886592 25762 raft_consensus.cc:3060] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.862143 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:30.834470 30310 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:30.820138 30346 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.866707 25583 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.834363 30359 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.867486 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.854102 29893 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:11:30.868585 25515 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 178) took 17661 ms (client timeout 15000 ms). Trace:
I20260709 12:11:30.789672 30188 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:30.880126 30132 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:30.888559 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:30.890416 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:30.932674 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:11:30.945766 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 210795us
I20260709 12:11:30.893625 25764 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 14: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
W20260709 12:11:30.923105 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 56487.2us
I20260709 12:11:30.923364 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.923846 25765 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:30.914991 30198 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:30.928524 30359 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.931361 25762 raft_consensus.cc:2468] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:11:30.931486 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.933986 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:30.934360 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:30.947698 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.955282 25611 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:30.882344 30400 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:30.971786 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:30.972714 25759 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:30.973496 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:30.939945 29893 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:30.981845 29893 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:30.997572 25583 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.999223 25583 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:30.982807 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:30.988942 25759 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:30.991829 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44230us
I20260709 12:11:31.001773 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:30.926153 25515 rpcz_store.cc:269] 0709 12:11:13.207332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.218514 (+ 11182us) service_pool.cc:224] Handling call
0709 12:11:30.868468 (+17649954us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:26.414532 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:26.415212 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:26.415257 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:11:26.415276 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:26.416967 (+  1691us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:26.417067 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:26.417099 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:26.418184 (+  1085us) tablet.cc:701] Row locks acquired
0709 12:11:26.418203 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:11:26.436300 (+ 18097us) write_op.cc:270] Start()
0709 12:11:26.436435 (+   135us) write_op.cc:276] Timestamp: P: 1783599086436240 usec, L: 0
0709 12:11:26.436459 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:26.485454 (+ 48995us) log.cc:844] Serialized 6009 byte log entry
0709 12:11:26.731012 (+245558us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdafc510ac 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b
0709 12:11:27.599679 (+868667us) op_driver.cc:464] REPLICATION: finished
0709 12:11:27.746889 (+147210us) write_op.cc:301] APPLY: starting
0709 12:11:27.747039 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:27.834973 (+ 87934us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:27.834996 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:28.160158 (+325162us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:28.259249 (+ 99091us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:11:28.259314 (+    65us) write_op.cc:312] APPLY: finished
0709 12:11:28.371345 (+112031us) log.cc:844] Serialized 138 byte log entry
0709 12:11:28.417720 (+ 46375us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.417954 (+   234us) write_op.cc:454] Released schema lock
0709 12:11:28.418029 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:28.418600 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.418638 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8426,"reported_tablets":57,"spinlock_wait_cycles":3840,"child_traces":[["op",{"apply.queue_time_us":146902,"apply.run_cpu_time_us":24049,"apply.run_wall_time_us":671648,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":226331,"prepare.run_cpu_time_us":61990,"prepare.run_wall_time_us":409413,"raft.queue_time_us":316879,"raft.run_cpu_time_us":58922,"raft.run_wall_time_us":117229,"replication_time_us":1163047,"spinlock_wait_cycles":5178752,"thread_start_us":759638,"threads_started":4,"wal-append.queue_time_us":339596,"wal-append.run_cpu_time_us":44907,"wal-append.run_wall_time_us":2562903}]]}
I20260709 12:11:30.992647 30310 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.925985 30343 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.996814 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:30.940349 30391 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.955760 30407 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:11:30.989964 30292 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:30.991094 30400 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.925918 29995 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.015281 30344 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:11:31.021494 30408 log.cc:927] Time spent T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:31.006805 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.009671 30365 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:31.039427 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.039803 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.044006 29995 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.048372 29995 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.053020 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:31.016721 30391 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.054742 30364 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.056205 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.056921 25762 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:31.057605 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.062326 30364 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:31.064419 30364 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:31.065629 30364 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.066510 29893 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.055428 30391 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.035301 30368 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:31.040736 30310 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.074484 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.074625 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.075167 25685 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.076915 25691 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:31.077950 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.078487 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.079316 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:31.080220 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.081404 25689 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.082343 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.078809 25692 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:31.083827 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.085315 25691 raft_consensus.cc:2393] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:31.087110 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.088091 25688 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 17: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:31.084527 25692 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:31.096637 25693 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:31.101994 25685 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:31.116827 25686 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:31.117488 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59988.7us
I20260709 12:11:31.118909 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.121343 25690 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:31.123896 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.130578 25687 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.149119 25732 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.172569 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:31.189210 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.131785 30356 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.192644 25616 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:31.192781 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.193445 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.195482 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.198184 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.198987 25613 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:31.138661 29995 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:31.098094 30190 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:11:31.202064 25611 raft_consensus.cc:1240] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:11:31.202302 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.204571 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.174717 30250 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.211006 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.211134 25612 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:11:31.188032 30349 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.147176 30411 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:11:31.190850 30131 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.174787 30346 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.222757 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
W20260709 12:11:31.223379 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 76262us
I20260709 12:11:31.236721 25686 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:31.206743 29995 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:31.233618 30356 consensus_queue.cc:1059] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:11:31.245718 30250 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:31.243775 29995 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.285472 30356 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:31.286202 30356 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:31.287489 30356 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.289280 30356 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:31.293676 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 46324.9us
W20260709 12:11:31.308097 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.308195 25613 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:31.232024 30299 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:11:31.322793 30291 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.329241 30132 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.330219 30330 consensus_queue.cc:1059] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:31.336437 30400 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.361761 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:31.364562 25766 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.374097 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:31.376271 25766 raft_consensus.cc:1240] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:31.379266 25763 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:31.338235 30422 log.cc:927] Time spent T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:11:31.385330 30359 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.387458 30400 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.350903 30291 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:11:31.388636 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.390690 25691 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.391242 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.339619 30393 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:31.395982 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.396334 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.397636 25616 raft_consensus.cc:2410] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:31.355798 30299 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:31.402977 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:31.406735 30299 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.409513 30299 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.415774 29995 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.400691 30368 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:31.404716 30365 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.419978 25764 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.420890 25760 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:31.422838 25616 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.427416 25583 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.429090 30359 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.390154 30291 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.437875 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.398803 30393 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:31.436581 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:31.429745 30132 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.430598 29995 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.434933 30365 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.432808 30350 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.453099 30237 raft_consensus.cc:993] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:31.421734 30343 consensus_queue.cc:1059] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:31.456368 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.452332 30393 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.463081 30368 raft_consensus.cc:1081] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:31.463953 30393 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:31.464257 30368 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:31.455713 30366 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:31.465150 30366 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.465539 30366 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:31.469540 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:31.446688 30309 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:31.454818 30365 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.474584 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.460012 30391 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:31.483211 30343 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.484305 29831 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:31.485565 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 132703us
W20260709 12:11:31.471123 30418 log.cc:927] Time spent T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.160s	user 0.000s	sys 0.003s
I20260709 12:11:31.490849 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.485350 29831 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:31.473675 30237 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:31.475965 30365 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.495092 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.489102 30400 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.491096 30343 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:31.498178 30400 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:31.494776 29995 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.499467 30400 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.492894 30344 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:11:31.501452 30131 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.501999 30131 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.502481 30237 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.504200 30131 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.504714 30237 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.510156 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.511528 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.512881 25657 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.517685 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.518026 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:31.518659 25613 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.518606 30350 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:31.516093 30309 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:31.521183 29995 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.515995 30428 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:31.516309 30123 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.524680 30123 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.527100 30123 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.526837 29831 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:31.518193 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.501194 30400 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.541109 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.541772 25657 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.542172 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.537993 30309 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.568620 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:31.551594 30365 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.560509 30391 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.573896 30391 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:31.572335 25657 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:31.574333 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52302.9us
I20260709 12:11:31.575711 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.576548 25613 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:31.571641 30393 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.580413 30309 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.583911 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:31.585340 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:31.586232 30356 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.586825 30356 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:31.589054 25617 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:31.590194 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6640372ef1e64554b6b1025b28173499"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:31.590828 25760 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:31.591198 25760 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.572289 29995 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.605311 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:31.605808 25613 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.606406 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:31.581245 30291 raft_consensus.cc:2804] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.607015 25768 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:31.609102 29995 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:31.578559 30391 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.616365 25686 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:31.616581 29995 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.616834 30391 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:31.617141 30368 consensus_queue.cc:1175] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "04e6206f9e924fb3931891bf3a64b392" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 12:11:31.618536 25762 raft_consensus.cc:2410] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:31.612015 30415 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:11:31.619603 30415 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.619961 30415 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:31.620810 30415 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.621965 30415 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.626363 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:31.627737 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:31.630664 25685 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:11:31.625506 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.632915 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.633231 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.633526 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.635159 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.613878 25760 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.594522 30369 raft_consensus.cc:3055] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.638015 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.638402 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.639708 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.640345 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.641430 25689 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:31.652145 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.652302 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.652985 25689 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:31.652168 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.653807 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.662833 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.663100 25692 raft_consensus.cc:2393] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:31.669745 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.669629 25760 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:31.671051 25685 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:11:31.671142 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.671555 25685 pending_rounds.cc:85] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 8
I20260709 12:11:31.671794 25685 pending_rounds.cc:107] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:11:31.672021 25685 raft_consensus.cc:2889] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.672389 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.631949 30291 raft_consensus.cc:697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:11:31.674391 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 66397.5us
I20260709 12:11:31.674903 30291 consensus_queue.cc:237] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.681746 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.683022 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.686507 30299 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:31.689836 30436 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:31.649464 30369 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:31.606040 30366 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.676934 30292 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.679749 30131 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.713183 30366 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.713394 30343 consensus_queue.cc:1059] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:31.681402 30411 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.715497 30346 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:31.716094 30346 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.681205 30359 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.721109 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.724102 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:31.724323 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.719570 25615 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:11:31.670007 29995 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:31.736990 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.737357 30344 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:31.737758 30344 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:31.738417 29999 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.738687 30344 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.726465 25691 raft_consensus.cc:2393] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:31.699698 30250 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:31.739995 30131 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:31.742141 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.741695 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.749238 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.752475 25657 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.761349 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.745230 30364 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.742621 30411 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:31.756698 30359 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:31.756379 30309 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.745080 30099 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:31.764670 30299 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.701807 30356 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.761682 30131 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.758749 29999 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:31.768445 30364 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.785600 30364 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.788017 30440 raft_consensus.cc:993] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:31.788594 30440 raft_consensus.cc:1081] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:31.762154 30292 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:31.779641 30369 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.758286 30096 consensus_queue.cc:1059] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:31.769034 30365 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:31.794704 29999 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:31.795214 29999 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:31.795049 30096 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:31.796222 30096 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:31.796075 29999 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.797346 29999 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.797039 30096 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:31.869534 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 217106us
W20260709 12:11:31.870272 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 194945us
W20260709 12:11:31.875896 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 123315us
I20260709 12:11:31.878856 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:31.909305 30344 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.911738 30099 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.913934 25689 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:11:31.917397 30096 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:31.919150 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:31.927613 30365 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.929313 30372 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.952116 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.893272 30346 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:31.958042 30364 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:31.983824 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.949870 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:31.998716 25686 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:11:31.999020 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 80191.9us
I20260709 12:11:32.005177 30346 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.000204 30330 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.012352 30327 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.021054 30369 raft_consensus.cc:3060] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.025913 30327 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:32.038230 30364 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.040611 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 55) took 8644 ms. Trace:
I20260709 12:11:32.043272 30454 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:32.044109 30454 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:32.050644 30327 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:32.052016 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 173412us
I20260709 12:11:32.053074 30327 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.054705 30455 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.055265 30455 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:32.055807 30455 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.041129 25516 rpcz_store.cc:276] 0709 12:11:23.396689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.405039 (+  8350us) service_pool.cc:224] Handling call
0709 12:11:32.040285 (+8635246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:30.582305 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:30.582953 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:30.582992 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:11:30.583008 (+    16us) tablet.cc:662] Decoding operations
0709 12:11:30.583595 (+   587us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:30.583658 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:30.583689 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:11:30.584019 (+   330us) tablet.cc:701] Row locks acquired
0709 12:11:30.584037 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:30.584186 (+   149us) write_op.cc:270] Start()
0709 12:11:30.584307 (+   121us) write_op.cc:276] Timestamp: P: 1783599090584135 usec, L: 0
0709 12:11:30.584328 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:30.588548 (+  4220us) log.cc:844] Serialized 1370 byte log entry
0709 12:11:31.240600 (+652052us) op_driver.cc:464] REPLICATION: finished
0709 12:11:31.463464 (+222864us) write_op.cc:301] APPLY: starting
0709 12:11:31.463565 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:31.465801 (+  2236us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:31.465906 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:31.509389 (+ 43483us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:31.509615 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:11:31.509670 (+    55us) write_op.cc:312] APPLY: finished
0709 12:11:31.510030 (+   360us) log.cc:844] Serialized 40 byte log entry
0709 12:11:31.527632 (+ 17602us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.527735 (+   103us) write_op.cc:454] Released schema lock
0709 12:11:31.527787 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:31.528212 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.528241 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":766325,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":222585,"apply.run_cpu_time_us":7163,"apply.run_wall_time_us":64755,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":133560,"prepare.run_cpu_time_us":90478,"prepare.run_wall_time_us":249150,"raft.queue_time_us":169248,"raft.run_cpu_time_us":87855,"raft.run_wall_time_us":199761,"replication_time_us":656095,"thread_start_us":559818,"threads_started":4,"wal-append.queue_time_us":243602}]]}
I20260709 12:11:32.070133 30343 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.070853 30343 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:32.071933 30343 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.033587 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:32.075198 30350 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.074137 30343 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:32.092638 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 64203.9us
I20260709 12:11:32.098708 30372 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:32.099201 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:32.103363 30198 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.104636 30330 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:32.099671 30372 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:32.109144 30372 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:32.115304 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:32.130120 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:32.045907 30454 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.147735 30454 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:32.166606 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.080525 30350 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:32.192531 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:32.195958 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:32.198304 30315 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.208477 30250 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:11:32.212935 30250 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.212862 30364 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:32.213740 30250 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.214802 30356 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.215198 30356 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:32.216344 30250 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.216398 30356 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.214084 30364 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:32.218999 30364 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:32.220427 30364 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.221920 30364 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.224731 25765 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:32.227918 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:32.226531 30356 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.230197 30350 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:32.231137 30372 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:32.231751 30372 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.238104 30372 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:32.238966 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.239131 30350 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:32.239729 30350 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:32.244469 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.257259 25763 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:32.268369 25764 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:32.268930 25764 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.280393 30350 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:32.287998 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:32.290517 30346 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:32.292629 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:32.294811 30131 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.295300 30131 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.295643 30131 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.286868 30455 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:32.313608 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.317114 30346 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.328290 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:32.320626 30346 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.331101 25615 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:32.338510 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:32.339239 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:32.340225 25618 raft_consensus.cc:2393] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:32.338531 25617 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.339394 25686 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.348295 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:32.348974 25688 raft_consensus.cc:1240] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:32.348809 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:32.349598 25616 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.359683 25618 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:11:32.370775 30455 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:32.375658 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:32.376554 25689 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.390441 30096 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.391325 30096 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.392325 25764 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.395967 29995 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:32.396472 25616 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:32.399688 30346 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.365605 25513 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.436923 25689 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:32.446648 25686 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:32.452824 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:32.453682 25760 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:32.467074 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:32.467972 25763 raft_consensus.cc:2368] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14.
I20260709 12:11:32.438089 30356 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:32.483348 25764 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.485690 25613 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:32.485822 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:32.487246 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:32.493892 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.495816 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:32.498422 25616 raft_consensus.cc:2410] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:32.503715 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.504706 25686 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 9.
I20260709 12:11:32.495132 25513 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.491482 30096 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:32.463829 29995 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.511510 25693 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:32.527554 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.528697 25689 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:32.523595 25513 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 9 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.500962 30356 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.509943 30364 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:32.532639 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:32.544426 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.544031 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:32.527390 30350 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:32.551929 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:32.562695 25693 raft_consensus.cc:2393] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 13: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:32.553938 30372 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.533731 30131 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:11:32.568221 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48868.6us
I20260709 12:11:32.569810 25582 leader_election.cc:400] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14.
I20260709 12:11:32.567612 25513 catalog_manager.cc:5697] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.570230 25582 leader_election.cc:403] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:32.581266 25762 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 10: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:32.566938 30372 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:11:32.581475 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 103744us
I20260709 12:11:32.587639 30369 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 13. Current term is 14.
I20260709 12:11:32.592569 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:32.575139 29995 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.584806 30372 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.600000 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:32.600239 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:32.600706 25687 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:32.601886 25616 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:32.605233 25615 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:32.605667 25615 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:32.607046 25732 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:32.592658 30364 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:32.618755 25691 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:11:32.622437 30364 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.622159 25615 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.631335 30364 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.627082 29995 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.641201 25615 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.654490 25513 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.663220 30315 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:32.658389 29995 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:32.669723 29995 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.658108 29999 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:32.672384 30198 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.672760 30198 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:32.673234 25513 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.673820 30356 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.687227 25612 raft_consensus.cc:2468] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:32.690853 30198 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.703100 30198 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.692451 25513 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 10, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.707716 25513 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 10, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.709481 25513 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 11 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:32.712685 25733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.714934 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:32.717275 25513 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.720306 25693 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.722730 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:32.723706 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 62334.1us
I20260709 12:11:32.724067 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:32.726369 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:32.740716 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.725924 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:32.744642 25617 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.755249 25615 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:32.749523 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:32.761397 25686 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:11:32.761890 25686 pending_rounds.cc:85] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 5
I20260709 12:11:32.762151 25686 pending_rounds.cc:107] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:11:32.762486 25686 raft_consensus.cc:2889] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.784021 25617 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:32.721748 30356 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:32.788596 25732 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:32.807529 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.765420 25513 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:11:32.808512 25582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.809891 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.810616 25691 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:32.828262 25513 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 12 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.831060 25513 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:11:32.847916 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 59457.1us
I20260709 12:11:32.849797 29995 raft_consensus.cc:2804] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.842247 25513 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.866184 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:32.866873 25691 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.864044 30131 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.874989 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.875595 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.875855 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:32.872249 29995 raft_consensus.cc:697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:32.891062 29995 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.872818 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:32.909512 30346 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:32.906971 25732 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:32.915378 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:32.916379 30350 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:32.916945 25583 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:32.917171 30350 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:32.917891 30344 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.918491 30344 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:32.919808 30356 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:32.920406 30356 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.920800 30350 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.919440 30344 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.922793 25694 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:32.923437 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:32.929032 25693 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:32.928627 25513 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.929800 25583 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:32.930833 30364 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:32.931473 30364 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:32.933626 30364 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.934104 30369 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:32.934932 30198 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:32.934964 30463 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.943763 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:32.948851 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:32.937361 25513 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 7 to 8, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 8 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.953150 25760 raft_consensus.cc:2410] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:32.948575 30343 raft_consensus.cc:2764] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:32.963059 30343 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:32.991657 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47941.6us
W20260709 12:11:32.994673 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 87818.2us
I20260709 12:11:32.948741 30454 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:32.972841 30364 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:32.989326 30250 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.017206 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.017531 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.000788 30343 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.002553 25513 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:33.019349 25691 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:33.003393 30315 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.991101 30356 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:32.946663 30463 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.034569 25513 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:33.021791 30364 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:33.042985 25513 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:33.048810 25513 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:32.991823 30346 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:33.036672 30131 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.032208 30343 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.063269 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:33.079037 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 83495.9us
I20260709 12:11:33.091269 29995 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.058362 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:33.102226 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 74454.7us
I20260709 12:11:33.103184 25619 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:33.106038 30131 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.037230 30250 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.112253 30471 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.112923 30471 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.121744 30470 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:33.122676 30470 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.125175 30470 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.064949 30372 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.052840 30315 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.110687 30356 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:11:33.161648 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 57553.5us
W20260709 12:11:33.158294 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46287.9us
I20260709 12:11:33.157029 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.165299 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.171085 25618 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
W20260709 12:11:33.178308 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 81428.1us
I20260709 12:11:33.107697 29995 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.059926 30364 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:33.188135 25765 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:33.185465 30250 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.193420 30250 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.193888 30250 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.194276 30250 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.176376 30346 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.201164 30471 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.202162 30131 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:33.232698 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67538.1us
I20260709 12:11:33.182201 30356 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:11:33.237507 30346 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.237004 30474 log.cc:927] Time spent T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:11:33.249580 30372 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.245376 30346 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.246853 30463 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.265861 30463 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.256460 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.279453 25615 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:33.253783 25619 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:33.249079 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.254197 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.285167 25613 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
W20260709 12:11:33.256031 30479 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:11:33.293593 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.288153 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:33.297643 25617 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:33.298270 30356 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.295493 30372 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.298769 30356 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.299233 30356 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.298930 30372 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.302678 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.288969 30477 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.303799 30477 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.259871 29999 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.266202 30346 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.250375 29995 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.318485 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.306079 30477 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.313086 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.323621 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.321950 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.324457 25617 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
W20260709 12:11:33.321297 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 149482us
I20260709 12:11:33.328181 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:33.346508 30372 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.346923 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.347697 25687 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:33.346545 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.319382 30463 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.351619 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.354817 25583 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:33.320444 29999 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.331543 30327 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.358986 25760 raft_consensus.cc:1275] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:33.360049 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.360684 25761 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:33.361150 30486 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:33.361584 30486 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:33.361941 30486 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:33.362553 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.363219 25686 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:33.360049 30492 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.365620 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.356931 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.368430 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.371224 25764 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:33.372383 25688 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:33.350450 30198 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.373495 29999 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.374135 25687 raft_consensus.cc:2393] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 12: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:33.365855 30327 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.378145 30327 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.379415 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.389149 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.389554 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.390149 25686 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.391253 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.392033 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.392836 25691 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:33.392836 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.393637 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.394764 25692 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:33.394680 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.396466 25691 raft_consensus.cc:2393] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:33.394099 25689 raft_consensus.cc:2393] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 15: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:33.402082 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:33.405076 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.412756 25732 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.380831 30131 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.421481 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.422495 25689 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:33.426295 25686 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:33.421274 25765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.421360 30350 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:33.428778 25765 raft_consensus.cc:2410] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:11:33.428929 30350 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.429015 30346 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:33.429525 30350 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:33.430403 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82995.9us
I20260709 12:11:33.433048 25613 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:33.426723 29995 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:33.434466 29995 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:33.437310 30346 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.437909 30346 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.441560 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.443017 30350 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.421000 30492 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:33.445786 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:33.433832 30469 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.454360 30315 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.454185 29999 consensus_queue.cc:1048] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:33.455924 30350 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.449575 29995 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:33.462842 30491 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.465895 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:33.457114 30356 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.472287 30463 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.472597 30356 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.474022 30250 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.453728 25657 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.480600 30480 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:33.481073 30480 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.481443 30480 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:33.484653 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:33.484997 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.485324 25616 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.487635 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:33.482558 30250 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.496246 30346 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.502930 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.526333 25613 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:33.526883 25617 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:11:33.510811 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.528971 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.519212 30343 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.524920 25616 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:33.525492 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.531143 25764 raft_consensus.cc:2410] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 12:11:33.531477 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45232.8us
I20260709 12:11:33.536978 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.537684 25689 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:33.542724 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.548461 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.544402 30346 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:33.551676 30346 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.552114 30346 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:33.552250 30364 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.554311 30471 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:33.554670 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:33.555392 25767 raft_consensus.cc:2368] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13.
I20260709 12:11:33.556206 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.558720 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:33.559973 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:33.556860 25759 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:33.562227 30471 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.562793 30364 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.563208 30364 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.563298 25766 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 12:11:33.563719 25766 pending_rounds.cc:85] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 7
I20260709 12:11:33.564085 25766 pending_rounds.cc:107] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:11:33.564330 25766 raft_consensus.cc:2889] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.570600 30483 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:33.572702 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:33.574344 25761 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:33.574784 25761 pending_rounds.cc:85] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 6
I20260709 12:11:33.575012 25761 pending_rounds.cc:107] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:33.575243 25761 raft_consensus.cc:2889] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.563632 30364 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.572711 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:33.578917 25689 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:33.576998 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.523948 30492 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:33.585875 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.585306 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:33.591455 30356 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.592270 30198 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:33.593086 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.592741 30198 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.593896 30198 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:33.594687 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.601887 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.607527 25694 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.609783 25693 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:33.611084 25732 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:33.611999 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.612737 25691 raft_consensus.cc:2393] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:33.612905 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:33.614365 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.615237 25689 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:33.616291 30356 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.616725 29999 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.616840 30356 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:33.617296 29999 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.542111 30327 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.617929 30356 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.638077 25582 leader_election.cc:400] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13.
I20260709 12:11:33.638832 25582 leader_election.cc:403] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.610718 30343 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:33.646792 30482 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13.
I20260709 12:11:33.659960 30343 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.660571 30343 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:33.663861 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:33.664605 29999 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.666489 30477 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.622493 30327 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.632969 30491 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.619724 30250 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:33.668915 30491 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.669340 30491 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.646356 30492 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.669309 30250 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:33.672437 30250 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.666034 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:33.689635 25618 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:33.698042 30483 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.698760 30483 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.700502 30471 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.701056 30471 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.701140 30483 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.712496 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.721365 25694 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:33.729955 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.734969 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:33.735726 25691 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:33.742209 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.745625 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:33.747929 25693 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:33.752538 25689 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:33.747128 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:33.757257 30485 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.762537 29995 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:33.764200 30482 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:33.639302 30486 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.752872 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.700407 30198 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.777550 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.787171 30493 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:33.787545 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:33.787875 30493 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.778317 25611 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:33.788332 25612 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.736011 30469 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:33.771811 30131 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.798851 30131 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.799263 30131 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.800356 30198 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.801214 30506 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:33.801831 30490 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.796845 25658 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.802651 30490 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.803164 30470 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:33.803886 30470 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.805061 30490 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.771348 30356 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:33.805925 30356 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.806439 30356 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:33.801771 30506 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.812041 30506 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.813767 30198 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.787171 30346 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.816075 30346 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.816960 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:33.819487 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:33.820477 25611 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:33.805994 30470 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.819051 30198 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.829923 30364 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.833217 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.831162 30198 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.843851 25764 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:33.845125 30364 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.843215 30480 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.803098 30486 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.851285 30330 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.851761 30330 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.852121 30330 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.857488 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:33.858354 25611 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:33.790218 30493 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.837597 30491 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.871879 25612 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:33.881606 25658 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:33.879492 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 81520.7us
I20260709 12:11:33.889341 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:33.890580 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:33.895541 25764 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 18: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:33.893821 30096 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.914304 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 149403us
I20260709 12:11:33.929057 25611 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:33.932199 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:11:33.929180 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 212896us
I20260709 12:11:33.892299 30482 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:33.879848 30343 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.913882 30480 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.939762 30514 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:11:33.927096 30096 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.942528 26334 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 8 LEARNER]: Advancing to term 10
I20260709 12:11:33.943501 30096 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.950115 30501 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:33.952324 30491 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:33.944478 25692 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:33.969079 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:33.953755 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.971963 25690 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 18: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:33.954990 25694 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:33.955541 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:33.975201 25617 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 18: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:33.975268 26334 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:33.979924 30198 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.981341 30131 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:33.986853 25689 raft_consensus.cc:2368] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15.
I20260709 12:11:33.991636 30343 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:33.973301 30096 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:33.998823 30096 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.002116 30501 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:33.926386 30515 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.165s
I20260709 12:11:34.003232 30501 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:34.005087 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71053.5us
I20260709 12:11:34.005774 30517 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:34.006291 30518 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:34.011049 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:34.011979 25612 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
W20260709 12:11:34.020828 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51856.8us
I20260709 12:11:34.011123 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:34.026701 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:34.027526 25616 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:34.024101 25658 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:34.034090 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.034852 25766 raft_consensus.cc:2368] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12.
I20260709 12:11:34.036015 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.002009 30096 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:34.038672 25611 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:34.039837 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.041128 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.041641 25611 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.056953 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.057472 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.062069 30198 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:34.063025 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:34.063922 25610 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 12: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:34.038153 30330 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.068385 30330 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:34.070202 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 97970.1us
I20260709 12:11:34.074370 25764 raft_consensus.cc:2393] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:34.058548 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:34.077535 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:34.078456 25767 raft_consensus.cc:2393] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 15: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:34.079555 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.080318 25760 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 18: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:34.080585 25768 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:34.080698 30198 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:34.081324 30198 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:34.081435 30516 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.081770 30198 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.082139 30516 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.084836 30516 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:34.091275 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.092034 25768 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.092856 25611 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:34.095722 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:34.096700 25761 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:34.100656 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.101974 25611 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.102082 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.107368 25767 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.107857 30482 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.035401 29999 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:34.103029 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.056918 30463 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.111703 30463 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.112104 30463 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.115717 30356 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.117362 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:34.056125 30491 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:11:34.124367 30471 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.118230 25760 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:34.130728 25767 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:34.131163 30131 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:34.131493 25611 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:34.117985 30356 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:34.161350 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.164459 25686 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.137902 29999 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:34.154095 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.151811 25768 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:34.132373 30198 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.169962 29999 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.160068 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:34.149607 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:34.135726 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:34.148762 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:34.149111 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.142994 25764 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:11:34.166294 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:34.168921 25687 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 in current term 18: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:34.183749 30494 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:34.191082 25658 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:34.201687 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 66083.8us
I20260709 12:11:34.205179 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.219506 25685 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:11:34.230016 25691 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
W20260709 12:11:34.227090 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 183381us
I20260709 12:11:34.236716 25686 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:11:34.236873 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:34.237504 25768 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:34.241396 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.249140 25619 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:34.224946 30250 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:34.234197 30490 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:34.258400 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:34.238224 30491 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.292961 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:34.242431 30471 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:34.297746 25732 leader_election.cc:400] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15.
I20260709 12:11:34.298519 25732 leader_election.cc:403] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:34.285245 30250 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:34.297549 30492 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:34.285917 30515 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:34.321345 25582 leader_election.cc:400] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12.
I20260709 12:11:34.344671 25582 leader_election.cc:403] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:34.299808 30490 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:34.345997 30490 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.300326 30131 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.315873 30483 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15.
I20260709 12:11:34.298978 30491 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:34.382799 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 156411us
I20260709 12:11:34.387532 25690 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
W20260709 12:11:34.388461 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 91873.5us
I20260709 12:11:34.419332 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.429217 25619 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:11:34.431308 25658 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:34.374322 30131 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:34.374763 30343 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12.
I20260709 12:11:34.353411 30469 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:11:34.443331 30494 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:34.462949 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 228181us
I20260709 12:11:34.441116 30131 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.410534 30486 consensus_queue.cc:1059] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:34.462468 30494 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:34.475904 30250 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.437273 30516 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:34.473753 30198 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:34.520154 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 141729us
I20260709 12:11:34.518181 30454 raft_consensus.cc:3055] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.548863 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:34.555333 30343 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:34.555847 30343 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.556195 30343 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:34.551266 30454 raft_consensus.cc:740] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:34.562103 30454 consensus_queue.cc:260] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:34.524818 30525 log.cc:927] Time spent T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:11:34.570169 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 104723us
I20260709 12:11:34.580942 25657 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:34.596745 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 222057us
W20260709 12:11:34.598079 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45716.7us
I20260709 12:11:34.603220 25611 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:34.617956 25611 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:34.618315 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:34.616756 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.652585 25760 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 16: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:34.661855 25613 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:34.669183 30529 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:11:34.669656 30530 log.cc:927] Time spent T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:11:34.670924 30539 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:11:34.665727 30526 log.cc:927] Time spent T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:34.678347 30491 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:34.677728 30463 consensus_meta.cc:287] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.565s	user 0.014s	sys 0.000s
I20260709 12:11:34.682571 30463 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.684865 30463 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:34.684932 30131 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.692960 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:34.604075 30494 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.696693 30514 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:34.704228 25760 raft_consensus.cc:1240] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:34.666369 30538 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:34.713925 30538 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:34.715042 30538 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.718324 25583 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:34.724071 30522 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.350s	user 0.000s	sys 0.006s
I20260709 12:11:34.729182 30250 consensus_queue.cc:1059] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:34.731019 30534 raft_consensus.cc:3055] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:34.731452 30534 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:34.732349 30534 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.733655 30534 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.721580 30343 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.735337 25617 raft_consensus.cc:2393] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 17: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:34.740123 30482 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:34.742615 25583 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:34.743252 30517 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:34.743462 30482 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:34.743758 30517 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:34.744132 30482 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:34.744728 30517 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.745103 30482 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.745965 30517 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:34.751362 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:34.775817 25615 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.751915 25768 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:11:34.760336 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.766620 30454 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.767817 30491 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:34.768430 25611 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:34.723721 30493 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:34.773708 30131 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:34.773940 25610 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:34.777527 25761 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:34.738091 30343 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:34.802031 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:34.802959 25618 raft_consensus.cc:606] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:34.803383 25618 raft_consensus.cc:614] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:34.791435 30469 consensus_queue.cc:1059] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:34.811142 30515 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:34.811571 30515 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:34.812403 30515 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:34.813601 30515 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.826618 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.842918 25689 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:34.826951 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.827384 25691 raft_consensus.cc:1240] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:34.827468 25690 raft_consensus.cc:1240] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:34.832715 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:34.825547 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.835736 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.850162 25694 raft_consensus.cc:2368] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 15. Current term is 16.
I20260709 12:11:34.836050 25692 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:34.841467 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 229836us
I20260709 12:11:34.839181 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:34.853669 25767 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.839679 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:34.821780 25761 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:34.859081 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:34.859469 25687 raft_consensus.cc:2368] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:34.859804 25618 raft_consensus.cc:606] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:34.860181 25618 raft_consensus.cc:614] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:34.870723 25766 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:34.830116 30548 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
W20260709 12:11:34.891355 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.905593 25615 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:34.905579 25767 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:34.907799 25689 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:11:34.911880 25687 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:11:34.836225 30463 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:11:34.958369 25585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.966639 25612 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:11:34.993260 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 208922us
I20260709 12:11:34.999823 25582 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:35.004328 25760 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:11:35.004846 25760 pending_rounds.cc:85] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 8
I20260709 12:11:35.005076 25760 pending_rounds.cc:107] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:11:35.005429 25760 raft_consensus.cc:2889] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.005698 25766 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.005101 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:35.010632 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:35.012089 25618 raft_consensus.cc:2368] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:35.024716 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:35.025441 25615 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:35.025825 25615 raft_consensus.cc:614] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:35.030789 30535 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.046689 25766 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:35.007575 30493 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:35.065002 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 59208.2us
I20260709 12:11:35.067907 30485 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:35.070636 30535 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:35.072533 30532 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.073071 30535 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:35.073136 30532 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:35.061693 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6640372ef1e64554b6b1025b28173499"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:35.079589 25616 raft_consensus.cc:606] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:35.073935 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 68925.7us
I20260709 12:11:35.098634 25616 raft_consensus.cc:614] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:34.987705 30538 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:35.092486 25610 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:35.091042 30493 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:35.140043 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:35.140764 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.141650 30356 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.143015 30515 raft_consensus.cc:1064] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:35.141974 25732 leader_election.cc:400] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 15. Current term is 16.
I20260709 12:11:35.148641 25732 leader_election.cc:403] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.150599 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:35.152866 25732 leader_election.cc:400] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:35.153262 25732 leader_election.cc:403] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.139593 30463 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:35.199165 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:35.076545 30532 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:35.206274 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:35.210984 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 62269us
I20260709 12:11:35.213074 25732 leader_election.cc:400] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Vote denied by peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875) with higher term. Message: Invalid argument: T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:35.195240 30534 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13.
I20260709 12:11:35.145512 30515 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:35.194991 30535 raft_consensus.cc:2749] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:35.220566 25768 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:11:35.247568 25768 pending_rounds.cc:85] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Aborting all ops after (but not including) 8
I20260709 12:11:35.247874 25768 pending_rounds.cc:107] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:11:35.248202 25768 raft_consensus.cc:2889] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.236470 25688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:35.241264 30493 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:35.243257 25687 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:35.202167 30346 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349) with higher term. Message: Invalid argument: T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for earlier term 15. Current term is 16.
I20260709 12:11:35.246109 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:35.327471 25694 raft_consensus.cc:2410] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:35.311697 25688 raft_consensus.cc:606] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:35.211488 30356 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:11:35.313786 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 66821.2us
I20260709 12:11:35.194694 30506 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:11:35.324481 25693 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:35.329324 30482 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:35.243660 30250 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 12:11:35.341506 30564 log.cc:927] Time spent T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.121s	user 0.003s	sys 0.005s
I20260709 12:11:35.357663 25760 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:35.431900 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.434511 30568 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:11:35.449780 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 118177us
W20260709 12:11:35.453763 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 128783us
I20260709 12:11:35.461575 25616 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.458405 30356 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:11:35.556425 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72698.7us
I20260709 12:11:35.623740 25616 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:35.623829 30356 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:35.638854 30571 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:11:35.714318 30096 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:35.714963 30096 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:35.717160 30096 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:35.820919 25766 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:35.823163 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:35.824106 25615 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:35.824549 25615 raft_consensus.cc:614] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:35.846477 25610 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:35.858172 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:35.859166 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 74863.5us
W20260709 12:11:35.861632 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 82076.1us
I20260709 12:11:35.871423 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:35.834527 30505 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.857525 30486 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:35.886276 30505 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:35.907819 30505 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:35.912855 30494 raft_consensus.cc:993] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:35.913540 30494 raft_consensus.cc:1081] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:35.935880 26334 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:35.942211 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51133.7us
I20260709 12:11:35.939349 30576 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:35.947070 30484 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.947746 30484 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:35.962363 25619 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:35.964392 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:35.965090 25767 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:35.950112 30484 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:35.975682 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:35.979056 30518 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:35.979502 30518 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.979820 30518 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:35.996544 30506 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:35.998225 25516 catalog_manager.cc:5697] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 10 to 12, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 12 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:36.008105 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 114226us
I20260709 12:11:36.000821 25516 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 7 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 8 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:36.001315 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:36.038654 30518 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.019563 30532 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:36.039702 30551 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:36.051972 30518 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.061352 30488 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.062199 30488 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.065945 30488 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:36.069960 30096 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:36.070986 25768 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:36.071019 30096 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:36.071550 25732 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:36.053825 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 44821.5us
I20260709 12:11:36.039839 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.095382 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:36.097643 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:36.098320 25768 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.102440 30558 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.103003 30558 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.102176 30506 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:36.105378 30558 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.074591 30576 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:36.071589 30096 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:36.102239 30490 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:36.111927 30535 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:36.108500 30470 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:36.122574 30515 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:36.123291 30515 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.125893 30515 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:36.127483 30553 consensus_queue.cc:1059] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:36.128381 30553 consensus_queue.cc:1243] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:36.133996 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.148962 25768 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:36.153834 25617 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 12:11:36.156993 25617 pending_rounds.cc:85] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Aborting all ops after (but not including) 7
I20260709 12:11:36.157354 25617 pending_rounds.cc:107] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 12:11:36.157750 25617 raft_consensus.cc:2889] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:36.159490 25687 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:36.160058 25685 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:11:36.166682 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.180609 25685 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:36.167167 25617 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:36.186743 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:36.187879 25611 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:36.188005 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:36.175160 25582 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:36.197578 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.204036 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:36.150352 30535 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:36.208353 25614 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:36.211484 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:36.208999 30510 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:36.232988 30510 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:36.233933 30510 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.170828 30330 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:36.255371 30330 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.163290 30490 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.273388 25760 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:36.276854 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:36.219667 30369 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.281316 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:36.283090 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:36.283838 25692 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 18.
I20260709 12:11:36.258005 30330 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.285380 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.290900 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:36.291716 25760 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.292321 25760 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.237933 30535 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.287310 30369 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.320014 30369 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.290189 30470 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:36.204988 30096 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.322034 25619 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:36.281469 30515 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:36.359073 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:36.360199 25759 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:36.292021 30315 consensus_queue.cc:1059] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:36.373194 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:36.295557 30454 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:11:36.378057 25765 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:36.297626 30495 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:36.386961 25767 raft_consensus.cc:2393] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 13: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:36.365726 30535 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:36.412837 25582 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:36.361168 30463 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.430598 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:36.433568 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 193371us
I20260709 12:11:36.457033 30544 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.416715 30582 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:36.423767 30535 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.465895 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.462813 25760 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.431605 30558 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.503412 25762 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:36.510404 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 43755.9us
I20260709 12:11:36.425434 30485 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:11:36.521658 25760 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:36.429400 30463 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.467069 30582 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:36.503750 30558 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.563544 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 273930us
I20260709 12:11:36.560164 30558 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.504093 30535 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.563717 30486 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.609782 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 98238.1us
W20260709 12:11:36.610543 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60609.4us
I20260709 12:11:36.612159 25657 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:36.615248 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:36.613073 30597 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:11:36.599637 30486 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.621970 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:36.655500 30494 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.656416 30486 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.612221 30490 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.617532 30364 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:11:36.663141 30607 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:11:36.666819 30600 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:11:36.667850 30608 log.cc:927] Time spent T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:11:36.669652 30601 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:11:36.703399 30598 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 12:11:36.670288 30602 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:11:36.670933 30618 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:36.703896 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:36.678906 30616 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:36.682020 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60577.4us
I20260709 12:11:36.682080 26334 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:11:36.718152 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 101571us
I20260709 12:11:36.716370 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:36.722210 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:36.722746 30604 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:36.722936 25762 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:36.728950 30604 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:11:36.730036 30604 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:36.734086 30604 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:36.736785 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:36.741447 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:36.744711 25615 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.605098 30582 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.766289 30535 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:36.766466 30622 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:36.767280 30622 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.762094 30490 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:36.770711 30490 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.772914 30490 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:36.767299 30609 log.cc:927] Time spent T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:11:36.770023 30622 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.783082 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.800385 25615 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
W20260709 12:11:36.806331 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 102516us
W20260709 12:11:36.810410 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 199149us
I20260709 12:11:36.823596 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.824687 25615 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
W20260709 12:11:36.829739 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71767us
I20260709 12:11:36.833709 25732 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:36.835381 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:36.846781 30603 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:36.847546 30603 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.852399 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:36.859496 30356 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.865478 30356 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:36.837270 30551 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:36.866778 30356 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:36.879078 30506 consensus_meta.cc:287] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Time spent flushing consensus metadata: real 0.775s	user 0.017s	sys 0.000s
I20260709 12:11:36.849706 30604 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.883273 30535 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:36.886716 30603 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:36.901146 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.893961 30535 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.905090 30470 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:36.915529 30535 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:36.923463 30558 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:36.943413 30558 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:36.955830 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:36.956739 25768 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.956084 25658 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:36.978193 30538 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.978749 30538 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:36.979120 30538 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.985700 25616 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:36.989056 30595 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.562s	user 0.002s	sys 0.000s
I20260709 12:11:36.992674 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:36.993523 25612 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
W20260709 12:11:36.955780 30510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.020s	sys 0.026s
W20260709 12:11:36.994706 30510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.020s	sys 0.026s
W20260709 12:11:36.998484 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 45672.7us
I20260709 12:11:36.976908 30096 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:37.007038 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.007280 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.005928 25768 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:36.999292 30535 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.064191 30535 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:37.066627 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:37.075229 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:37.077293 30463 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:37.078799 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 243223us
I20260709 12:11:37.081746 25612 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:37.102341 30605 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.102919 30605 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:37.103390 30605 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.106829 30589 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:37.108640 25612 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 19.
I20260709 12:11:37.118125 25766 raft_consensus.cc:1240] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:11:37.114598 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.115669 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.083039 30470 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:37.114156 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.119694 25762 raft_consensus.cc:1240] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:37.123708 30470 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:37.125772 25660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.151777 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.152809 25759 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 19: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:37.130211 25582 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:37.157387 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.159288 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:37.124148 30582 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:37.161207 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 50704.8us
I20260709 12:11:37.161918 25658 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:37.169652 30538 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:37.178146 30637 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:37.182541 30315 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:37.183045 30315 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.183399 30315 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:37.184300 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.187794 30589 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:37.188380 30613 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.188752 30589 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:37.189121 30613 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.178952 30542 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:37.175840 30534 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:37.190832 30542 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:37.190940 30534 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:37.191866 30542 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.192056 30534 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.194092 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.200268 30538 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:37.201171 25686 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:37.203123 30613 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:37.205093 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 56) took 4970 ms. Trace:
I20260709 12:11:37.212960 30638 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:37.213470 30638 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:37.206838 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet d5b02303361d43d1903c3e943b866b64 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54016
I20260709 12:11:37.208683 25516 rpcz_store.cc:276] 0709 12:11:32.235233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.235483 (+   250us) service_pool.cc:224] Handling call
0709 12:11:37.204989 (+4969506us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:36.425097 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:36.474024 (+ 48927us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:36.503436 (+ 29412us) write_op.cc:435] Acquired schema lock
0709 12:11:36.511341 (+  7905us) tablet.cc:662] Decoding operations
0709 12:11:36.589847 (+ 78506us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:36.596677 (+  6830us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:36.599160 (+  2483us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:36.618186 (+ 19026us) tablet.cc:701] Row locks acquired
0709 12:11:36.619740 (+  1554us) write_op.cc:260] PREPARE: finished
0709 12:11:36.645523 (+ 25783us) write_op.cc:270] Start()
0709 12:11:36.658059 (+ 12536us) write_op.cc:276] Timestamp: P: 1783599096643070 usec, L: 0
0709 12:11:36.658095 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:11:36.659081 (+   986us) log.cc:844] Serialized 988 byte log entry
0709 12:11:36.818848 (+159767us) op_driver.cc:464] REPLICATION: finished
0709 12:11:37.009284 (+190436us) write_op.cc:301] APPLY: starting
0709 12:11:37.080115 (+ 70831us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:37.165170 (+ 85055us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:37.165280 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:37.190953 (+ 25673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:37.191182 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:11:37.191234 (+    52us) write_op.cc:312] APPLY: finished
0709 12:11:37.191467 (+   233us) log.cc:844] Serialized 32 byte log entry
0709 12:11:37.191709 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:37.191825 (+   116us) write_op.cc:454] Released schema lock
0709 12:11:37.191879 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:37.192367 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:37.192405 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":335345,"reported_tablets":4,"spinlock_wait_cycles":17792,"child_traces":[["op",{"apply.queue_time_us":89807,"apply.run_cpu_time_us":13140,"apply.run_wall_time_us":238060,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":259633,"prepare.run_cpu_time_us":11378,"prepare.run_wall_time_us":330023,"raft.queue_time_us":39619,"raft.run_cpu_time_us":8152,"raft.run_wall_time_us":81615,"replication_time_us":160514,"spinlock_wait_cycles":12032,"thread_start_us":355866,"threads_started":4,"wal-append.queue_time_us":117770}]]}
W20260709 12:11:37.221153 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 59303us
I20260709 12:11:37.221748 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54016
I20260709 12:11:37.223146 25760 raft_consensus.cc:606] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Received request to transfer leadership
W20260709 12:11:37.221474 25513 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 183) took 12033 ms (client timeout 15000 ms). Trace:
I20260709 12:11:37.241891 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.290787 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.302618 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:37.303354 25686 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.305052 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:37.220219 30638 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:37.234009 25513 rpcz_store.cc:269] 0709 12:11:25.182687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.209856 (+ 27169us) service_pool.cc:224] Handling call
0709 12:11:37.216283 (+12006427us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.296955 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.297680 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.297736 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:11:33.297756 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:33.337642 (+ 39886us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.337777 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.337820 (+    43us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:11:33.339636 (+  1816us) tablet.cc:701] Row locks acquired
0709 12:11:33.339685 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:11:33.339906 (+   221us) write_op.cc:270] Start()
0709 12:11:33.340092 (+   186us) write_op.cc:276] Timestamp: P: 1783599093339830 usec, L: 0
0709 12:11:33.340133 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.341055 (+   922us) log.cc:844] Serialized 7973 byte log entry
0709 12:11:33.640654 (+299599us) op_driver.cc:464] REPLICATION: finished
0709 12:11:34.029971 (+389317us) write_op.cc:301] APPLY: starting
0709 12:11:34.030140 (+   169us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:34.698139 (+667999us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:34.698298 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:35.066646 (+368348us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:35.067303 (+   657us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=0,mrs_lookups=0
0709 12:11:35.067372 (+    69us) write_op.cc:312] APPLY: finished
0709 12:11:35.068097 (+   725us) log.cc:844] Serialized 179 byte log entry
0709 12:11:35.201737 (+133640us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:35.222263 (+ 20526us) write_op.cc:454] Released schema lock
0709 12:11:35.226526 (+  4263us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:35.227539 (+  1013us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:35.227578 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75767,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":369667,"apply.run_cpu_time_us":57039,"apply.run_wall_time_us":1216492,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87847,"num_ops":20,"prepare.queue_time_us":63328,"prepare.run_cpu_time_us":12629,"prepare.run_wall_time_us":123801,"raft.queue_time_us":161997,"raft.run_cpu_time_us":17601,"raft.run_wall_time_us":294116,"replication_time_us":300339,"spinlock_wait_cycles":23808,"thread_start_us":538756,"threads_started":5,"wal-append.queue_time_us":317669,"wal-append.run_cpu_time_us":24798,"wal-append.run_wall_time_us":2303892}]]}
I20260709 12:11:37.288173 25514 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 6 to 8, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 8 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:37.347561 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.350595 30644 tablet_replica.cc:333] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:11:37.352564 30315 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.358212 25694 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:11:37.358878 25694 pending_rounds.cc:85] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 9
I20260709 12:11:37.359212 25694 pending_rounds.cc:107] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:11:37.359531 25694 raft_consensus.cc:2889] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.358639 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:37.326517 30495 consensus_queue.cc:1059] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:11:37.382144 25686 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:37.407905 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54016
I20260709 12:11:37.408792 25764 raft_consensus.cc:606] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Received request to transfer leadership
I20260709 12:11:37.360868 30605 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.407827 25694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39702 (request call id 2265) took 1160 ms. Trace:
I20260709 12:11:37.438804 25616 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:37.437171 25694 rpcz_store.cc:276] 0709 12:11:36.219778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.219977 (+   199us) service_pool.cc:224] Handling call
0709 12:11:36.226382 (+  6405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.359989 (+1133607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.379797 (+ 19808us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003e3fd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:11:37.380018 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601827584}
W20260709 12:11:37.442548 30643 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:11:37.446674 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.423897 30589 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:37.458806 30470 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.460224 25612 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:37.463936 25514 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:11:37.466162 25501 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 460a9cbf9985461f9237f09b4f5ca854 already in progress [suppressed 1 similar messages]
I20260709 12:11:37.483124 30605 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:37.483665 30641 log.cc:927] Time spent T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:37.496376 30470 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:37.498782 30315 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:37.498646 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.504082 30638 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.507009 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.511212 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:37.510458 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:37.519730 30617 raft_consensus.cc:993] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
W20260709 12:11:37.520002 30640 log.cc:927] Time spent T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:11:37.520401 30617 raft_consensus.cc:1081] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:37.520741 30644 raft_consensus.cc:2243] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:37.521631 30644 raft_consensus.cc:2272] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:37.522430 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:37.525430 30644 ts_tablet_manager.cc:1916] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:37.445904 30488 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:37.535866 25688 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 19: Already voted for candidate c781e437472a42e2a6162b67b1c7bbbd in this term.
I20260709 12:11:37.547734 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.548832 25613 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:37.551932 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:37.552848 25616 raft_consensus.cc:2393] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 19: Already voted for candidate 04e6206f9e924fb3931891bf3a64b392 in this term.
I20260709 12:11:37.558683 25611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:11:37.559335 25611 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:37.559947 25611 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.571569 30488 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:37.572314 30488 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.575026 30488 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:37.578336 30590 consensus_queue.cc:1059] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:37.586297 30488 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:37.586985 30488 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.594730 30506 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:37.596009 30356 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:37.596441 30356 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:37.597445 30356 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.599144 30356 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:37.606721 30506 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:37.607563 30506 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.610064 30506 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:37.612901 25611 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:37.615592 30535 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:37.616197 30535 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.622015 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:37.624737 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55879.1us
I20260709 12:11:37.653177 25611 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:37.658561 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.658361 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.674687 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.674474 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:37.690752 30605 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:37.693457 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.696095 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:37.696743 26334 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.697414 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:37.698115 25766 raft_consensus.cc:2368] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14.
I20260709 12:11:37.699054 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.702605 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:37.704646 25763 raft_consensus.cc:3055] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:37.705001 25763 raft_consensus.cc:740] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:37.708657 30622 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:37.709142 30622 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:37.705870 25763 consensus_queue.cc:260] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:37.717753 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.723714 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:37.711717 30534 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:37.728724 25689 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:11:37.711134 30535 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:37.743280 26334 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:37.710044 30622 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.778227 25657 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.779713 25657 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.783761 30485 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.752982 30589 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:37.785068 30589 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.785768 25657 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.786480 30480 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:37.787434 30582 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:37.742728 30590 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:37.788820 30590 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.791160 30590 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:37.792646 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.797659 30488 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:37.744047 30534 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:37.800786 25657 leader_election.cc:400] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14.
I20260709 12:11:37.801192 25657 leader_election.cc:403] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:37.805099 30590 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14.
I20260709 12:11:37.807742 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.808650 30582 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:37.811093 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.813462 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.815526 30551 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:37.821555 25760 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:37.826115 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:37.801880 30534 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:37.835811 25693 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:37.837095 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.837075 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:37.838625 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:37.775269 25690 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:37.842665 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:37.842617 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:37.848294 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
W20260709 12:11:37.845399 25501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 379389us
I20260709 12:11:37.847493 30493 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:37.861614 30493 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:37.863547 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:37.865125 30480 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:37.898527 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 231046us
W20260709 12:11:37.945636 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 256562us
I20260709 12:11:37.947011 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:37.914994 30629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.037s
I20260709 12:11:37.939227 30582 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:37.961902 30629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.016s	sys 0.037s
I20260709 12:11:37.964111 30488 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:37.991258 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 137005us
W20260709 12:11:38.000974 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 158498us
I20260709 12:11:38.006237 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.013548 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54016
W20260709 12:11:38.020042 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.031966 30618 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.045426 25690 pending_rounds.cc:85] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Aborting all ops after (but not including) 8
I20260709 12:11:38.045921 25690 pending_rounds.cc:107] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:11:38.046231 25690 raft_consensus.cc:2889] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.046129 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.048719 25732 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.066226 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:38.068274 25611 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:11:38.082041 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:38.053442 30534 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.055685 30356 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:38.102491 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:38.057494 30506 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:11:38.137715 30589 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:38.107033 30618 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:38.175592 25763 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:38.184235 30653 log.cc:927] Time spent T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.196s	user 0.002s	sys 0.000s
W20260709 12:11:38.212729 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.215927 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 95996.8us
I20260709 12:11:38.225694 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:38.227353 25763 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:38.231666 25762 raft_consensus.cc:606] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 12:11:38.232156 25762 raft_consensus.cc:614] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:38.217801 30644 ts_tablet_manager.cc:1929] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 12:11:38.242780 30644 log.cc:1199] T d5b02303361d43d1903c3e943b866b64 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/d5b02303361d43d1903c3e943b866b64
I20260709 12:11:38.243932 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2842bb8137e14414992e2306de44989b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:38.244645 30644 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54016 (request call id 64) took 1040 ms. Trace:
I20260709 12:11:38.244678 25614 raft_consensus.cc:606] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:38.259593 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:38.263976 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:38.265424 25690 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:11:38.245234 30644 rpcz_store.cc:276] 0709 12:11:37.204178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.206515 (+  2337us) service_pool.cc:224] Handling call
0709 12:11:37.350125 (+143610us) ts_tablet_manager.cc:1151] Deleting tablet d5b02303361d43d1903c3e943b866b64
0709 12:11:37.350238 (+   113us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:11:37.878650 (+528412us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:38.210457 (+331807us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:38.244535 (+ 34078us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22902,"tablet-delete.queue_time_us":129264,"thread_start_us":75566,"threads_started":1}
I20260709 12:11:38.284118 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet d5b02303361d43d1903c3e943b866b64 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:38.284842 30510 raft_consensus.cc:993] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:38.285377 30628 raft_consensus.cc:1081] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:38.289610 30622 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.296197 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff1240c7107404994c96234274c5e64"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:38.297088 25616 raft_consensus.cc:606] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:38.297479 25616 raft_consensus.cc:614] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:38.303776 25611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:38.304452 25611 raft_consensus.cc:606] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:38.308955 25611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:38.309885 25611 raft_consensus.cc:606] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:38.311395 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:38.309784 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2842bb8137e14414992e2306de44989b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:38.319376 25762 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:38.319888 25762 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:38.315318 25611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:38.320986 25611 raft_consensus.cc:606] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:38.321987 25611 raft_consensus.cc:614] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:38.333879 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:38.336011 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:38.336876 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:38.341840 30484 raft_consensus.cc:993] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:11:38.342324 25565 auto_rebalancer.cc:893] Removing replace marker failed: Replica 04e6206f9e924fb3931891bf3a64b392 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:38.342438 30484 raft_consensus.cc:1081] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:11:38.342933 25565 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:11:38.343264 25565 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:11:38.367632 25582 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.372035 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.373515 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.380522 30535 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:38.381248 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.386202 30656 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.375870 30668 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.399629 30618 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:38.376196 30493 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:38.410784 25763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:38.411312 30493 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:38.411545 25763 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:38.411998 25763 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.412420 30493 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:38.414058 25688 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:38.418641 25513 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 6 to 9, term changed from 8 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:38.436685 25762 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.440099 30620 raft_consensus.cc:993] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:38.440776 30620 raft_consensus.cc:1081] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:38.447947 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:38.448653 25768 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:38.449079 25768 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.450623 25763 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.448545 25762 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:38.451342 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:38.451978 25611 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:38.452245 25611 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:38.453222 25767 raft_consensus.cc:1240] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:38.456619 25611 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.461251 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:38.462023 25611 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:38.462078 25618 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:38.463917 25618 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:38.462610 25768 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.469646 25657 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:38.470618 30670 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.481751 25763 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:38.475487 25618 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.486951 25513 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 57) took 1136 ms. Trace:
I20260709 12:11:38.492759 25688 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:38.502928 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:38.503567 25688 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:38.487438 25513 rpcz_store.cc:276] 0709 12:11:37.350659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.374214 (+ 23555us) service_pool.cc:224] Handling call
0709 12:11:38.486854 (+1112640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:38.422317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:38.422951 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:38.422997 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:11:38.423018 (+    21us) tablet.cc:662] Decoding operations
0709 12:11:38.423429 (+   411us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:38.423490 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:38.423528 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:38.423743 (+   215us) tablet.cc:701] Row locks acquired
0709 12:11:38.423764 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:11:38.423938 (+   174us) write_op.cc:270] Start()
0709 12:11:38.424069 (+   131us) write_op.cc:276] Timestamp: P: 1783599098423885 usec, L: 0
0709 12:11:38.424096 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:11:38.424853 (+   757us) log.cc:844] Serialized 602 byte log entry
0709 12:11:38.426890 (+  2037us) op_driver.cc:464] REPLICATION: finished
0709 12:11:38.435413 (+  8523us) write_op.cc:301] APPLY: starting
0709 12:11:38.435513 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:38.436412 (+   899us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:38.436516 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:38.437266 (+   750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:38.437435 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:38.437476 (+    41us) write_op.cc:312] APPLY: finished
0709 12:11:38.437697 (+   221us) log.cc:844] Serialized 24 byte log entry
0709 12:11:38.443254 (+  5557us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:38.443349 (+    95us) write_op.cc:454] Released schema lock
0709 12:11:38.443397 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:38.443843 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:38.443875 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":58562,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":8234,"apply.run_cpu_time_us":3052,"apply.run_wall_time_us":8389,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":252,"prepare.run_cpu_time_us":2889,"prepare.run_wall_time_us":2895,"replication_time_us":2644}]]}
I20260709 12:11:38.501448 25618 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.511291 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:38.511916 25685 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.516883 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:38.521611 25688 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:11:38.526365 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:38.532207 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:38.533329 25612 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:38.533802 25612 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:38.534082 25611 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:11:38.544452 25768 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:38.535504 30618 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:38.537504 30619 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.577364 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:38.578025 25690 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.579030 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.581259 25515 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 12, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.588956 25515 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 15 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 17 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.585911 25685 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:38.597224 25515 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.598776 25515 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 7 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.548766 25612 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.586695 25618 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:38.599938 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:38.600414 25612 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.600836 30250 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.541318 30628 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:38.601881 25515 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.562520 30618 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:38.605852 25515 catalog_manager.cc:5697] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 13, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.608145 25515 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.611191 25515 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.612754 25515 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:38.601148 30516 consensus_queue.cc:1175] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c781e437472a42e2a6162b67b1c7bbbd" responder_term: 14 status { last_received { term: 14 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 14 index: 9 } }
I20260709 12:11:38.615100 30618 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.614480 25515 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.622536 30250 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:38.623634 25515 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.624315 30250 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.630539 25690 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:38.637435 25515 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
W20260709 12:11:38.652853 25514 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 181) took 18420 ms (client timeout 15000 ms). Trace:
I20260709 12:11:38.654608 30668 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:38.655283 30668 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.644134 25515 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.658209 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.679152 25515 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 6 to 11, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.681169 25515 catalog_manager.cc:5697] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.683703 30668 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:38.690145 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:38.689575 25515 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.693298 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:38.698469 25515 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 6 to 10, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.700829 25515 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.703751 25612 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:38.690969 30619 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
W20260709 12:11:38.653359 25514 rpcz_store.cc:269] 0709 12:11:20.225254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.225391 (+   137us) service_pool.cc:224] Handling call
0709 12:11:20.259821 (+ 34430us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:11:38.645320 (+18385499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:37.966949 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:38.045525 (+ 78576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:38.048395 (+  2870us) write_op.cc:435] Acquired schema lock
0709 12:11:38.051622 (+  3227us) tablet.cc:662] Decoding operations
0709 12:11:38.094305 (+ 42683us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:38.094390 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:38.094419 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:38.094767 (+   348us) tablet.cc:701] Row locks acquired
0709 12:11:38.094785 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:38.108987 (+ 14202us) write_op.cc:270] Start()
0709 12:11:38.113704 (+  4717us) write_op.cc:276] Timestamp: P: 1783599098108887 usec, L: 0
0709 12:11:38.118339 (+  4635us) op_driver.cc:348] REPLICATION: starting
0709 12:11:38.121079 (+  2740us) log.cc:844] Serialized 934 byte log entry
0709 12:11:38.238076 (+116997us) op_driver.cc:464] REPLICATION: finished
0709 12:11:38.333692 (+ 95616us) write_op.cc:301] APPLY: starting
0709 12:11:38.333785 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:38.335311 (+  1526us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:38.335419 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:38.336582 (+  1163us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:38.336759 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:11:38.336803 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:38.337031 (+   228us) log.cc:844] Serialized 32 byte log entry
0709 12:11:38.337215 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:38.337303 (+    88us) write_op.cc:454] Released schema lock
0709 12:11:38.337343 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:38.375234 (+ 37891us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:38.375264 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":120657,"reported_tablets":53,"spinlock_wait_cycles":23900544,"child_traces":[["op",{"apply.queue_time_us":95315,"apply.run_cpu_time_us":4270,"apply.run_wall_time_us":41511,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":421672,"prepare.run_cpu_time_us":4527,"prepare.run_wall_time_us":181594,"replication_time_us":119535,"thread_start_us":350248,"threads_started":2}]]}
I20260709 12:11:38.710000 25515 catalog_manager.cc:5697] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.711236 30619 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.714563 30668 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:38.715227 30668 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.717556 30668 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:38.712404 25515 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.719039 25515 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.720782 25515 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.700589 30656 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:38.722148 25515 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.727468 25515 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 8 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 11 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:38.728781 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:38.755337 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:38.755748 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:38.756434 25691 raft_consensus.cc:2393] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 14: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:38.743257 30656 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:38.760453 25732 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.763206 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:38.765662 30668 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.768072 30618 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.786289 30656 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:38.850766 30618 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.866948 26334 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:38.869071 30628 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:38.928179 25763 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:38.932319 30628 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:38.971462 25694 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.996593 25694 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:39.001633 30661 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.043092 30495 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:39.043776 30495 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:39.046486 30495 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:39.057588 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:39.058634 25611 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 19: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:39.065171 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:39.065975 25764 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 19.
I20260709 12:11:39.068104 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:39.068478 25685 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:39.069449 30495 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:39.069871 30495 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:39.070233 30495 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:39.076259 30506 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.090138 30495 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:39.104749 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:39.105023 30495 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:39.105786 25611 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 19: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:39.108073 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:39.102329 25517 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:39.109707 25517 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 9 to 12, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 12 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.111523 25517 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 13, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.114224 25517 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 16, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.117372 25517 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 16, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 16 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:39.119045 25763 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 19.
I20260709 12:11:39.119133 25517 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.120249 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 179) took 6378 ms. Trace:
I20260709 12:11:39.121543 25657 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:39.120985 25517 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.122812 25517 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.127113 25517 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.129092 25517 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:39.131037 25517 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.121595 25515 rpcz_store.cc:276] 0709 12:11:32.742083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.742451 (+   368us) service_pool.cc:224] Handling call
0709 12:11:39.120182 (+6377731us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:38.738366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:38.738967 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:38.739013 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:11:38.739028 (+    15us) tablet.cc:662] Decoding operations
0709 12:11:38.740728 (+  1700us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:38.740780 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:38.740825 (+    45us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:11:38.811417 (+ 70592us) tablet.cc:701] Row locks acquired
0709 12:11:38.811444 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:11:38.811625 (+   181us) write_op.cc:270] Start()
0709 12:11:38.811754 (+   129us) write_op.cc:276] Timestamp: P: 1783599098811572 usec, L: 0
0709 12:11:38.811771 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:11:38.812587 (+   816us) log.cc:844] Serialized 10319 byte log entry
0709 12:11:38.818712 (+  6125us) op_driver.cc:464] REPLICATION: finished
0709 12:11:38.819240 (+   528us) write_op.cc:301] APPLY: starting
0709 12:11:38.819341 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:38.846332 (+ 26991us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:38.846505 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:38.868975 (+ 22470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:38.869346 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=0,mrs_lookups=0
0709 12:11:38.869390 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:38.870010 (+   620us) log.cc:844] Serialized 227 byte log entry
0709 12:11:38.870863 (+   853us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:38.871117 (+   254us) write_op.cc:454] Released schema lock
0709 12:11:38.871194 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:38.875139 (+  3945us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:38.875230 (+    91us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7533,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":31080,"apply.run_wall_time_us":52320,"cfile_cache_hit":104,"cfile_cache_hit_bytes":108836,"num_ops":26,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":7441,"prepare.run_wall_time_us":80284,"replication_time_us":6785}]]}
I20260709 12:11:39.132591 25517 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:39.136736 25517 catalog_manager.cc:5697] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.128708 30589 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:39.141737 25517 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:39.162997 25614 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:39.154029 30589 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:39.168879 30589 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:39.172128 30506 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.173965 25688 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:11:39.192744 30506 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:39.216092 25611 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:11:39.234308 30506 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:11:39.245548 25611 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:39.249504 30356 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.259910 25763 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.268601 25688 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:39.270205 30628 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:39.279949 30619 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:39.306037 25692 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:39.311870 30506 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.442679 25514 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 10 to 11, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:39.475631 30606 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.496667 30606 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:39.510537 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:39.514076 25516 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.545228 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:39.549216 30606 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:39.552098 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:39.553215 25763 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
I20260709 12:11:39.554582 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:39.556560 30628 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:39.556983 30628 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.557345 30628 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:39.595103 25516 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 19, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 19 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.598562 25516 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 9 to 10, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 10 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.601827 25516 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 18, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 18 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.607939 25516 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.617359 25768 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:11:39.622931 25516 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.625373 30622 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:39.625294 25516 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.638645 30628 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:39.649199 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:39.621927 25517 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 182) took 1838 ms. Trace:
I20260709 12:11:39.652968 25517 rpcz_store.cc:276] 0709 12:11:37.784009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.784797 (+   788us) service_pool.cc:224] Handling call
0709 12:11:39.621847 (+1837050us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:39.206034 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:39.206747 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:39.206788 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:11:39.206808 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:39.208179 (+  1371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:39.208244 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:39.208280 (+    36us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:11:39.258083 (+ 49803us) tablet.cc:701] Row locks acquired
0709 12:11:39.258116 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:11:39.258412 (+   296us) write_op.cc:270] Start()
0709 12:11:39.258597 (+   185us) write_op.cc:276] Timestamp: P: 1783599099258311 usec, L: 0
0709 12:11:39.258630 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:11:39.259613 (+   983us) log.cc:844] Serialized 5627 byte log entry
0709 12:11:39.261982 (+  2369us) op_driver.cc:464] REPLICATION: finished
0709 12:11:39.262395 (+   413us) write_op.cc:301] APPLY: starting
0709 12:11:39.262473 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:39.296893 (+ 34420us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:39.297054 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:39.392615 (+ 95561us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:39.392929 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:11:39.392983 (+    54us) write_op.cc:312] APPLY: finished
0709 12:11:39.399714 (+  6731us) log.cc:844] Serialized 128 byte log entry
0709 12:11:39.399958 (+   244us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.400375 (+   417us) write_op.cc:454] Released schema lock
0709 12:11:39.400465 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:39.401357 (+   892us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.401403 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64430,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":171,"apply.run_cpu_time_us":20237,"apply.run_wall_time_us":138896,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58604,"num_ops":14,"prepare.queue_time_us":1632,"prepare.run_cpu_time_us":6454,"prepare.run_wall_time_us":53979,"replication_time_us":3223}]]}
I20260709 12:11:39.659749 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:39.664608 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:39.670817 30619 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:11:39.688728 25611 raft_consensus.cc:1240] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 19. Current term is 20. Ops: []
I20260709 12:11:39.691116 30589 consensus_queue.cc:1059] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:39.692915 30622 raft_consensus.cc:3055] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:11:39.693312 30622 raft_consensus.cc:740] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:39.694334 30622 consensus_queue.cc:260] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:39.703296 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:39.704042 25694 raft_consensus.cc:606] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:39.667790 30628 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 20 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:39.715040 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:39.715715 25612 raft_consensus.cc:606] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:39.716037 25612 raft_consensus.cc:614] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:39.722510 30622 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:39.725715 25612 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:39.796303 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:39.797022 25685 raft_consensus.cc:606] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:39.849263 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52951.9us
I20260709 12:11:39.866308 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 184) took 2126 ms. Trace:
I20260709 12:11:39.874758 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:39.875435 25694 raft_consensus.cc:606] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:39.857365 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:39.888384 25515 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.866827 25516 rpcz_store.cc:276] 0709 12:11:37.740198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.752564 (+ 12366us) service_pool.cc:224] Handling call
0709 12:11:39.866187 (+2113623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:39.639609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:39.640278 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:39.640314 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:39.640328 (+    14us) tablet.cc:662] Decoding operations
0709 12:11:39.641159 (+   831us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:39.641216 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:39.641243 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:39.641834 (+   591us) tablet.cc:701] Row locks acquired
0709 12:11:39.641848 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:11:39.641987 (+   139us) write_op.cc:270] Start()
0709 12:11:39.642142 (+   155us) write_op.cc:276] Timestamp: P: 1783599099641936 usec, L: 0
0709 12:11:39.642179 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:11:39.643359 (+  1180us) log.cc:844] Serialized 2891 byte log entry
0709 12:11:39.646162 (+  2803us) op_driver.cc:464] REPLICATION: finished
0709 12:11:39.646718 (+   556us) write_op.cc:301] APPLY: starting
0709 12:11:39.646812 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:39.652655 (+  5843us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:39.652778 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:39.700868 (+ 48090us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:39.701195 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:11:39.701266 (+    71us) write_op.cc:312] APPLY: finished
0709 12:11:39.701673 (+   407us) log.cc:844] Serialized 73 byte log entry
0709 12:11:39.713227 (+ 11554us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.720206 (+  6979us) write_op.cc:454] Released schema lock
0709 12:11:39.726491 (+  6285us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:39.726928 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.726960 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87411,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":315,"apply.run_cpu_time_us":11676,"apply.run_wall_time_us":80156,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29302,"num_ops":7,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":4004,"prepare.run_wall_time_us":6151,"replication_time_us":3853}]]}
I20260709 12:11:39.916002 25515 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:39.920759 25582 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8ccce4d8eb845e4b0f90ae503e00da5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:39.923575 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7414eafc9044de28063237176e3435f"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:39.924319 25692 raft_consensus.cc:606] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:39.926873 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:39.928831 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:39.929667 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:39.935263 25694 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:39.941574 30606 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.953008 25768 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:39.967578 30606 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:39.986452 25517 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:39.993239 30704 raft_consensus.cc:993] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:39.993840 30704 raft_consensus.cc:1081] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:39.989144 25517 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 18 to 19, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 19 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.001658 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7414eafc9044de28063237176e3435f"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:40.002485 25764 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.002871 25764 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.008062 25517 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 17 to 18, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 18 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:40.026093 25764 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.028808 25764 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:40.033306 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:40.033968 25611 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.055191 25611 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:40.056633 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:40.057763 25685 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.058089 25685 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:40.058985 25685 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.060135 25685 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.092716 30702 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.097116 25764 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.117825 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:40.119026 30356 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.119607 30356 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:40.120502 30356 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.129042 30495 raft_consensus.cc:993] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:40.131508 30495 raft_consensus.cc:1081] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:11:40.137496 25565 auto_rebalancer.cc:629] Failed to schedule move for tablet a1f7a89fe9fd4bf0b5efc34622f42d69: Illegal state: Replica c781e437472a42e2a6162b67b1c7bbbd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:11:40.145519 25685 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
W20260709 12:11:40.146561 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89201.5us
I20260709 12:11:40.163895 25516 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:40.152467 25694 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:40.179383 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:40.180004 25768 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.180387 25768 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.203666 30622 raft_consensus.cc:993] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:40.204331 30622 raft_consensus.cc:1081] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:40.219607 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:40.220425 25767 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.220906 25767 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.222536 25515 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 11 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.229158 25768 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.232508 25768 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:40.241015 30704 raft_consensus.cc:993] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:40.240862 25767 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.241577 30704 raft_consensus.cc:1081] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:40.243108 25767 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:40.249759 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 52763.3us
I20260709 12:11:40.251663 25685 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.253587 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:40.254406 25768 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.254969 25768 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.256512 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:40.257093 25688 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.257300 25688 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:40.255692 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:40.260567 25692 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:40.260893 25692 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:40.261632 25692 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.262931 25692 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.257947 25688 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.266309 25688 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.274844 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:40.275457 25614 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:40.277822 25768 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.282148 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:40.282968 25611 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.283198 25768 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:40.282105 25688 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:40.287941 25732 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:40.288872 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:40.289346 25690 raft_consensus.cc:3055] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.289521 25690 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:40.290128 25690 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.291970 25690 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.292058 25611 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:40.297585 25611 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:40.299408 30495 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:40.307619 25690 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:40.307914 25614 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:40.301671 30356 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.315346 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:40.316072 25612 raft_consensus.cc:3060] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.316143 25767 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:40.310812 30356 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:40.317979 25732 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:40.321776 25657 consensus_peers.cc:597] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: badc1c7146be42a1bb728a36f96a38ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:40.321029 30488 raft_consensus.cc:2804] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.325645 25612 raft_consensus.cc:2468] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:11:40.328791 30714 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:40.332177 25611 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:40.332044 30488 raft_consensus.cc:697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:40.344261 30488 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.347389 30356 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.363770 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:40.369491 30535 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:40.370102 30535 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:40.371054 30535 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:40.383435 25692 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:11:40.410597 30544 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.432278 25612 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.437433 26334 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:40.448372 25690 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:40.459014 30702 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:40.515257 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 80824.3us
I20260709 12:11:40.476850 30628 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:40.547015 25517 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.601315 25764 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:40.534565 25690 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:40.656092 30606 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:40.685312 25515 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 12 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.694732 26338 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:40.723476 25694 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:40.727077 30708 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:40.728070 25517 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:40.738312 25692 raft_consensus.cc:2955] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:40.745607 25614 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:40.755146 30726 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:40.759634 25685 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:40.763789 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet 460a9cbf9985461f9237f09b4f5ca854 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54016
I20260709 12:11:40.787757 30708 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:40.813395 30734 tablet_replica.cc:333] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:11:40.829571 30733 ts_tablet_manager.cc:933] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:11:40.833499 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 460a9cbf9985461f9237f09b4f5ca854 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:40.833762 30731 ts_tablet_manager.cc:933] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:40.835392 25657 consensus_peers.cc:597] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60795798854e400987349043af926b8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:40.842325 25611 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:40.880803 25690 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:40.897511 25517 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 12 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.899864 25517 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 16 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:40.905534 25768 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:40.866288 30589 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:11:40.940156 30734 raft_consensus.cc:2243] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:40.911387 30356 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:11:40.978562 30734 raft_consensus.cc:2272] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:41.002291 30734 ts_tablet_manager.cc:1916] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:11:40.996107 30732 log.cc:927] Time spent T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:11:41.022564 30744 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 12:11:41.041992 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 247991us
I20260709 12:11:41.043846 30734 ts_tablet_manager.cc:1929] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:11:41.044422 30734 log.cc:1199] T 460a9cbf9985461f9237f09b4f5ca854 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/460a9cbf9985461f9237f09b4f5ca854
I20260709 12:11:41.057516 25613 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:41.054663 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet 460a9cbf9985461f9237f09b4f5ca854 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:41.081071 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:41.081429 25692 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:41.104548 25618 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:41.108865 25618 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:41.119313 30738 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:41.158311 30731 tablet_copy_client.cc:323] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:11:41.159148 30749 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:41.159796 30749 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:41.162082 30749 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:41.180787 30733 tablet_copy_client.cc:323] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:11:41.183676 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet e8ccce4d8eb845e4b0f90ae503e00da5 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:11:41.184389 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet e8ccce4d8eb845e4b0f90ae503e00da5 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-e8ccce4d8eb845e4b0f90ae503e00da5
I20260709 12:11:41.151916 30738 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:41.173918 30706 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:41.205888 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet badc1c7146be42a1bb728a36f96a38ab from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:11:41.206737 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet badc1c7146be42a1bb728a36f96a38ab from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-badc1c7146be42a1bb728a36f96a38ab
I20260709 12:11:41.186826 30737 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:41.225942 25767 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:41.248782 25614 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:11:41.261529 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 84231.2us
I20260709 12:11:41.244927 30704 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:41.274977 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:41.279249 25614 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 20: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:41.279436 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:41.275552 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:41.280043 25692 raft_consensus.cc:606] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:41.280561 25685 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 20.
I20260709 12:11:41.273775 30759 ts_tablet_manager.cc:933] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:41.297513 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:11:41.306797 30755 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.101s	user 0.000s	sys 0.004s
I20260709 12:11:41.349911 25515 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 17 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:41.344301 30758 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:41.380259 25704 tablet_copy_source_session.cc:215] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:41.391844 30758 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:41.445338 25629 tablet_copy_source_session.cc:215] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:41.411571 30758 raft_consensus.cc:3060] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:11:41.457782 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 76026.2us
I20260709 12:11:41.462244 30759 tablet_copy_client.cc:323] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:11:41.539634 30733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ccce4d8eb845e4b0f90ae503e00da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:41.569665 30758 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:41.598546 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 213983us
I20260709 12:11:41.648257 30731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badc1c7146be42a1bb728a36f96a38ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:41.660842 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet 60795798854e400987349043af926b8a from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:11:41.679553 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet 60795798854e400987349043af926b8a from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-60795798854e400987349043af926b8a
W20260709 12:11:41.691785 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 151314us
I20260709 12:11:41.715773 30758 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:41.725776 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:41.735422 25618 raft_consensus.cc:2393] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 04e6206f9e924fb3931891bf3a64b392 in current term 20: Already voted for candidate 56b5d00aa592407c9d5e67a03a961508 in this term.
I20260709 12:11:41.809494 25704 tablet_copy_source_session.cc:215] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:41.820374 30748 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.820993 30748 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:41.823320 30748 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:41.837895 30731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60620 (request call id 107) took 1081 ms. Trace:
I20260709 12:11:41.877115 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:41.878407 25767 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 12:11:41.927731 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2842bb8137e14414992e2306de44989b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:41.928496 25764 raft_consensus.cc:606] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:41.943084 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:41.961615 25688 raft_consensus.cc:2468] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 20.
W20260709 12:11:41.973567 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 141296us
I20260709 12:11:41.987124 25688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:41.873363 30731 rpcz_store.cc:276] 0709 12:11:40.756363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.756711 (+   348us) service_pool.cc:224] Handling call
0709 12:11:40.834218 (+ 77507us) ts_tablet_manager.cc:934] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
0709 12:11:41.083434 (+249216us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7fbdafd37768. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc91d91 00007fbdafc6cc44 00007fbdafc6abb4 00007fbdb7ccf131 00007fbdb7cd5ac8 00007fbdb7d6e1df 00007fbdb7d9ff4e 00007fbdb7d84fdd 00007fbdb7d84f89 00007fbdb7d84f19
0709 12:11:41.538714 (+455280us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:41.714668 (+175954us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:41.714824 (+   156us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:41.836670 (+121846us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:41.837117 (+   447us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:41.837564 (+   447us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:41.837757 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29175,"spinlock_wait_cycles":16450304,"tablet-copy.queue_time_us":66510,"thread_start_us":81155,"threads_started":2}
I20260709 12:11:41.994532 25688 raft_consensus.cc:606] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:42.005316 30731 tablet_copy_client.cc:806] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:42.006325 30731 tablet_copy_client.cc:670] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:42.012496 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:42.013320 25692 raft_consensus.cc:606] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:42.019375 25692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:42.020056 25692 raft_consensus.cc:606] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:42.020416 25692 raft_consensus.cc:614] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:42.048745 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:42.051013 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:42.051875 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:42.072674 30777 raft_consensus.cc:993] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:42.073470 30777 raft_consensus.cc:1081] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:42.078778 25732 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:42.079746 30708 raft_consensus.cc:2804] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:42.080437 30708 raft_consensus.cc:697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:42.081307 30708 consensus_queue.cc:237] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.091801 30738 raft_consensus.cc:993] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:42.092545 30738 raft_consensus.cc:1081] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:42.092654 25611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:42.093343 25611 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.093711 25611 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.101854 25612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2842bb8137e14414992e2306de44989b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:11:42.102672 25612 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.103466 25612 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:42.141709 25611 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.145358 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:42.145692 25612 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.146680 25690 raft_consensus.cc:2410] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 21 because replica has last-logged OpId of term: 19 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 12:11:42.156206 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:42.157181 25686 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:42.161438 25612 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:42.173242 25611 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:42.172340 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:42.174340 25762 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:42.174675 25762 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:42.174561 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:42.176506 25764 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.175524 25762 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.180932 25762 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:42.197865 30759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60795798854e400987349043af926b8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:42.242612 25764 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:42.253957 25686 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
I20260709 12:11:42.261941 25762 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
W20260709 12:11:42.264389 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 103006us
I20260709 12:11:42.279471 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60616 (request call id 196) took 1643 ms. Trace:
I20260709 12:11:42.284162 30731 tablet_copy_client.cc:538] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:42.280212 30733 rpcz_store.cc:276] 0709 12:11:40.646914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.647698 (+   784us) service_pool.cc:224] Handling call
0709 12:11:40.830056 (+182358us) ts_tablet_manager.cc:934] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
0709 12:11:41.125114 (+295058us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7fbdafd37768. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc91d91 00007fbdafc6cc44 00007fbdafc6abb4 00007fbdb7ccf131 00007fbdb7cd5ac8 00007fbdb7d6e1df 00007fbdb7d9ff4e 00007fbdb7d84fdd 00007fbdb7d84f89 00007fbdb7d84f19
0709 12:11:41.538059 (+412945us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:42.058061 (+520002us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:42.058196 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:42.267865 (+209669us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:42.278697 (+ 10832us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:42.279149 (+   452us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:42.279367 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":353,"spinlock_wait_cycles":44033792,"tablet-copy.queue_time_us":170476,"thread_start_us":212113,"threads_started":2}
I20260709 12:11:42.301214 30733 tablet_copy_client.cc:806] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:42.303009 30589 raft_consensus.cc:993] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:42.303580 30743 raft_consensus.cc:1081] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:42.303823 30733 tablet_copy_client.cc:670] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:42.315121 30731 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:42.357164 25582 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:42.365942 30748 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:42.367223 30748 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:42.369798 25582 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:42.394778 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 191444us
W20260709 12:11:42.398491 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 175352us
I20260709 12:11:42.421545 30748 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.383447 30780 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:42.431344 30780 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:42.464056 25516 catalog_manager.cc:5697] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 19 to 20, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 20 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.470676 30780 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.548053 30745 raft_consensus.cc:993] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:42.549278 30790 raft_consensus.cc:1081] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:42.561733 25583 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:42.564433 30715 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:11:42.586674 30733 tablet_copy_client.cc:538] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:42.639648 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:11:42.640806 25764 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.641374 25764 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.642860 25616 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:42.661856 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:42.663014 25693 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:42.663404 25693 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:42.664485 25693 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.666277 25693 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.661759 25517 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 16 to 17, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 17 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:42.701274 25764 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.731197 30723 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:42.732151 30723 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:42.746469 25612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:42.747301 25612 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.747781 25612 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.770421 25693 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:11:42.805109 30733 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:42.812230 25764 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:42.799091 30723 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:42.865983 25612 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.870885 25616 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:11:42.887547 25612 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:42.903400 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:42.917768 30759 consensus_meta.cc:287] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.011s
I20260709 12:11:42.924331 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:42.925110 25764 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:42.934731 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52862.9us
I20260709 12:11:42.941871 25764 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:42.946975 25582 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:42.955547 30723 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:42.960659 30780 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.961596 25693 raft_consensus.cc:1275] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:11:42.970623 30780 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:42.972038 30780 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:42.974761 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:42.975332 25611 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.978305 30759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60620 (request call id 109) took 1720 ms. Trace:
I20260709 12:11:42.978909 30759 rpcz_store.cc:276] 0709 12:11:41.257575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.257737 (+   162us) service_pool.cc:224] Handling call
0709 12:11:41.290107 (+ 32370us) ts_tablet_manager.cc:934] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
0709 12:11:42.133693 (+843586us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:42.317132 (+183439us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:42.317266 (+   134us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:42.918818 (+601552us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:42.977611 (+ 58793us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:42.978028 (+   417us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:42.978149 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":328,"tablet-copy.queue_time_us":15488,"thread_start_us":180115,"threads_started":2}
I20260709 12:11:42.980777 30759 tablet_copy_client.cc:806] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:42.984272 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:42.986624 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:42.999101 25686 raft_consensus.cc:3055] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:42.999574 25686 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:43.000519 25686 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:43.001883 25686 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.010563 25611 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:43.038107 25768 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:43.039812 25732 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:43.041250 30798 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:43.041777 30798 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:43.045039 30781 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:11:43.049567 25764 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:11:43.066651 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.075673 30739 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:11:43.089270 25686 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:43.095363 25611 raft_consensus.cc:1240] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.064718 30759 tablet_copy_client.cc:670] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
W20260709 12:11:43.113742 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 68790.7us
I20260709 12:11:43.119314 30789 consensus_queue.cc:1059] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:43.094249 30798 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:43.143273 30789 consensus_queue.cc:1243] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer 56b5d00aa592407c9d5e67a03a961508 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:43.144212 30789 raft_consensus.cc:3055] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.144683 30789 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:11:43.163240 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50517.6us
I20260709 12:11:43.148790 30723 consensus_queue.cc:1048] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:43.145881 30789 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:43.200539 30759 tablet_copy_client.cc:538] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:11:43.241581 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58870.1us
I20260709 12:11:43.308660 30789 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.365257 25517 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 18 to 19, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 19 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:43.367726 25517 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:43.369024 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 79590.4us
W20260709 12:11:43.385346 30733 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.050s	user 0.002s	sys 0.001s
I20260709 12:11:43.420766 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.456579 30733 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:43.457742 30733 tablet_bootstrap.cc:492] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:43.477324 30731 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:43.480087 30731 tablet_bootstrap.cc:492] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:43.481035 30731 ts_tablet_manager.cc:1403] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.166s	user 0.053s	sys 0.018s
I20260709 12:11:43.503010 30759 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:43.497752 25516 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 9, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 9 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:43.510164 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 255501us
I20260709 12:11:43.509538 30733 ts_tablet_manager.cc:1403] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.705s	user 0.054s	sys 0.037s
I20260709 12:11:43.519353 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:43.521064 25690 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:43.527456 25688 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:11:43.531560 25732 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:43.532799 30723 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:43.549363 25693 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:43.495666 30731 raft_consensus.cc:359] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:43.566707 30780 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:43.566903 30731 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:43.569356 30731 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:43.572366 30731 ts_tablet_manager.cc:1434] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:11:43.583323 26334 raft_consensus.cc:1217] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:11:43.609261 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-badc1c7146be42a1bb728a36f96a38ab received from {username='slave'} at 127.0.0.1:51490
I20260709 12:11:43.609858 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-badc1c7146be42a1bb728a36f96a38ab on tablet badc1c7146be42a1bb728a36f96a38ab with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:43.610085 30748 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:43.646564 25768 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:43.652165 25690 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:43.662705 25691 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:43.664330 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:43.665203 25764 raft_consensus.cc:606] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:43.664371 30796 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:43.654927 30733 raft_consensus.cc:359] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:43.668167 30733 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:43.668077 30606 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.668983 30733 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:43.673453 30733 ts_tablet_manager.cc:1434] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.001s
I20260709 12:11:43.694438 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:43.695111 25616 raft_consensus.cc:606] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:43.702879 30606 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:43.709692 25611 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:43.710587 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-e8ccce4d8eb845e4b0f90ae503e00da5 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:11:43.711203 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-e8ccce4d8eb845e4b0f90ae503e00da5 on tablet e8ccce4d8eb845e4b0f90ae503e00da5 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:43.725183 30488 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:11:43.748274 30715 raft_consensus.cc:993] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:43.760038 30780 raft_consensus.cc:1081] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:43.778753 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:43.779444 25768 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:43.779923 25768 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:43.870877 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44793.8us
W20260709 12:11:43.926975 30817 log.cc:927] Time spent T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.089s	user 0.000s	sys 0.004s
W20260709 12:11:44.019541 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59794.7us
I20260709 12:11:44.031678 25767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:44.032456 25767 raft_consensus.cc:606] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:44.044847 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:44.053936 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:44.089870 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60712.9us
W20260709 12:11:44.103595 30828 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:11:44.107069 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:44.092450 25768 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:44.127270 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48460.8us
I20260709 12:11:44.131023 26338 raft_consensus.cc:1217] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:11:44.157640 25768 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:44.160818 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:44.162811 25686 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:44.176698 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 107172us
W20260709 12:11:44.181064 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 117182us
I20260709 12:11:44.201798 25686 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:11:44.208511 30805 raft_consensus.cc:1064] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:44.210407 25688 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:44.215018 30805 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:44.251596 30822 consensus_queue.cc:1059] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:44.252351 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:44.252682 30822 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:44.253118 30822 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:44.261722 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:44.263466 30758 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:44.263995 30758 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:44.264897 30758 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.271255 30803 raft_consensus.cc:993] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:44.271895 30803 raft_consensus.cc:1081] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:44.278005 25688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:44.278728 25688 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:44.279130 25688 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:44.253950 30822 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.297349 30822 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:44.312496 25764 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:44.326978 25688 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.376122 25688 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:44.381711 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:44.382428 25764 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:44.382718 25764 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:44.393184 30758 raft_consensus.cc:993] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:44.393877 30758 raft_consensus.cc:1081] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:44.394896 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:44.395579 25614 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:44.399274 25764 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.400749 25764 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:44.403687 25685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:44.404342 25685 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:44.404707 25685 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.421947 25614 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:11:44.423830 25685 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.432683 25685 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:44.436383 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:44.437049 25768 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.437367 25768 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:44.438159 25768 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.439392 25768 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.454732 26338 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.459484 25767 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.462963 25614 raft_consensus.cc:1240] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:44.469010 30745 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:44.470198 30805 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:44.472445 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 82651.6us
I20260709 12:11:44.501062 25768 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:44.530936 30780 raft_consensus.cc:1064] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:44.531350 25614 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.533092 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:44.533947 25612 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.532624 25657 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:44.546651 25764 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:11:44.552423 30805 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.563027 25658 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:44.565790 30805 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:44.566638 30843 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:44.567344 30843 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:44.566903 30805 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.573289 30850 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:44.575742 30759 log.cc:927] Time spent T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:44.568336 30843 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:44.577699 25515 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 17 to 18, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 18 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:44.592432 25618 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:11:44.606598 30850 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:44.613301 25616 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:44.621553 25612 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:44.643478 30780 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:44.657963 25764 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:44.741503 26338 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:44.808014 25513 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:44.813658 25688 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:44.817266 25764 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:44.820282 26338 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:44.837674 30759 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:44.838892 30759 tablet_bootstrap.cc:492] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:44.847007 25688 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:11:44.834478 30606 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:44.860159 30780 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:44.863322 30780 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:44.859650 30488 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:11:44.873077 25616 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:11:44.846721 30759 ts_tablet_manager.cc:1403] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.348s	user 0.074s	sys 0.011s
I20260709 12:11:44.894734 30740 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:11:44.958755 30822 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:44.960985 25764 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.007402 30759 raft_consensus.cc:359] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:45.010001 30759 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:45.010972 30759 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:45.026842 25686 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.050051 30759 ts_tablet_manager.cc:1434] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.156s	user 0.008s	sys 0.000s
I20260709 12:11:45.081414 25616 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:45.090241 30745 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:45.104395 25768 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:45.119732 26334 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.130036 30745 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:45.137071 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-60795798854e400987349043af926b8a received from {username='slave'} at 127.0.0.1:51490
I20260709 12:11:45.095340 25516 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:45.140697 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-60795798854e400987349043af926b8a on tablet 60795798854e400987349043af926b8a with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:45.179416 25616 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:45.198434 25761 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:11:45.189850 30843 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:11:45.208454 30745 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:45.219389 25513 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 14 to 15, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:45.229713 25513 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 17 to 18, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:45.331489 25688 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:45.360946 26334 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:45.361299 25618 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:45.376036 30495 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:45.380182 26334 raft_consensus.cc:1217] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 12:11:45.374603 25761 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:45.397610 26334 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:45.405668 25768 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:45.408114 30606 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:45.409080 30495 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:45.413290 30606 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:45.425285 30845 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.427968 26338 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.425652 25761 raft_consensus.cc:2955] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.475739 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8ccce4d8eb845e4b0f90ae503e00da5 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:45.486322 30495 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.488082 25513 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.507900 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:45.510470 26334 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.542882 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet e8ccce4d8eb845e4b0f90ae503e00da5 with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:39676
I20260709 12:11:45.564554 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet badc1c7146be42a1bb728a36f96a38ab with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:45.582758 25517 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 12 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.600196 25768 raft_consensus.cc:2955] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:45.602320 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet badc1c7146be42a1bb728a36f96a38ab with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:41122
I20260709 12:11:45.616220 30874 tablet_replica.cc:333] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:11:45.619724 30874 raft_consensus.cc:2243] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.624455 30874 raft_consensus.cc:2272] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.652104 30873 tablet_replica.cc:333] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:11:45.653523 30873 raft_consensus.cc:2243] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.659540 30873 raft_consensus.cc:2272] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.731832 30874 ts_tablet_manager.cc:1916] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:45.766631 30873 ts_tablet_manager.cc:1916] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:45.824988 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:45.825731 25616 raft_consensus.cc:606] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:45.870417 25688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:45.871125 25688 raft_consensus.cc:606] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:45.877017 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:45.877700 25764 raft_consensus.cc:606] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:45.879699 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:45.881791 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:45.882959 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:45.932220 30874 ts_tablet_manager.cc:1929] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:11:45.932928 30874 log.cc:1199] T badc1c7146be42a1bb728a36f96a38ab P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/badc1c7146be42a1bb728a36f96a38ab
I20260709 12:11:45.940150 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet badc1c7146be42a1bb728a36f96a38ab (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:45.953671 30495 raft_consensus.cc:1064] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:45.957990 30495 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:45.970942 30873 ts_tablet_manager.cc:1929] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:11:45.971534 30873 log.cc:1199] T e8ccce4d8eb845e4b0f90ae503e00da5 P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/e8ccce4d8eb845e4b0f90ae503e00da5
I20260709 12:11:45.973806 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet e8ccce4d8eb845e4b0f90ae503e00da5 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
W20260709 12:11:45.988874 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 62738.6us
I20260709 12:11:46.010131 30488 raft_consensus.cc:993] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:46.010738 30488 raft_consensus.cc:1081] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:46.016826 25614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:11:46.017477 25614 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:46.017874 25614 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.028913 26338 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:46.030730 30745 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:46.040061 25764 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:46.042891 30745 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:46.029264 25614 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.043206 25618 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:46.052374 25614 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:46.053714 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:46.054410 25688 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.057261 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:46.057914 25768 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.058187 25768 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:46.059103 25768 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.060284 25768 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.066468 30745 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:46.138578 25688 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
W20260709 12:11:46.155997 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 93747us
I20260709 12:11:46.168802 25583 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:46.181789 30606 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.182575 30606 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:46.204645 30606 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.218665 30843 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:46.224910 25762 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:46.227505 30850 raft_consensus.cc:993] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:46.228065 30850 raft_consensus.cc:1081] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:46.232436 25614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:46.233304 25614 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:46.233783 25614 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.261986 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71748us
I20260709 12:11:46.271503 25768 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:46.282269 25614 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.306305 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:46.307075 25693 raft_consensus.cc:3055] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.307458 25693 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:46.308545 25693 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.309904 25614 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:46.322569 25693 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.344679 25517 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.351889 30781 raft_consensus.cc:993] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:46.352907 30822 raft_consensus.cc:1081] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:46.338331 25612 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:46.393803 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:46.403959 25767 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.316782 25516 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:46.422909 26338 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:46.425868 25693 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:46.429340 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:46.429991 25768 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:46.430475 25768 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:46.428135 25767 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:46.455770 25583 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:46.459723 25768 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.460228 30606 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.460976 30606 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:46.463943 25768 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:46.466140 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:46.466938 25693 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:46.461762 30606 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:46.483245 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 317342us
I20260709 12:11:46.485497 25693 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:46.488628 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:46.500028 25618 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:46.500483 25618 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:46.501369 25618 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.502964 25618 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:46.516566 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:46.528545 30830 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:46.533813 30830 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:46.535141 30830 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:46.549824 25618 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:46.743777 25768 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:46.755712 30780 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:46.749830 25685 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:46.759806 25689 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:46.770298 25513 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.808975 25515 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.822834 25767 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:46.822834 26338 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:46.842244 30780 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:46.900991 25685 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:46.948562 30745 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:46.975060 30606 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.022590 30745 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:47.038012 25767 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:47.040058 30845 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:47.040673 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:47.053856 25612 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:47.056212 30875 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.100173 25694 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:47.265297 30901 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:47.339355 30876 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:47.387820 25764 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:47.440912 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60795798854e400987349043af926b8a with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:47.487962 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2842bb8137e14414992e2306de44989b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:47.490329 25612 raft_consensus.cc:606] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:47.505337 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:47.506102 25686 raft_consensus.cc:606] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:47.516547 25767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:47.517230 25767 raft_consensus.cc:606] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:47.520850 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:47.525797 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:47.532209 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:47.542465 30781 raft_consensus.cc:993] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:47.543193 30781 raft_consensus.cc:1081] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:47.550827 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2842bb8137e14414992e2306de44989b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:47.551517 25762 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.551905 25762 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:47.484098 25513 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 13 to 14, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 17 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.566212 25762 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:47.599946 26334 raft_consensus.cc:2955] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:47.613269 25762 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:47.692744 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 57511.1us
I20260709 12:11:47.694876 30901 raft_consensus.cc:993] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:47.695487 30901 raft_consensus.cc:1081] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
W20260709 12:11:47.710748 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 82805us
I20260709 12:11:47.720221 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:47.720975 25612 raft_consensus.cc:3055] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:11:47.721379 25612 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:47.722548 25612 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:47.725782 25612 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:47.781831 25612 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 20.
I20260709 12:11:47.808871 25732 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:47.811702 30914 raft_consensus.cc:2804] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:47.812485 30914 raft_consensus.cc:697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:47.834718 25691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:47.834218 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:47.838600 25689 raft_consensus.cc:3060] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:47.845850 30906 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:47.838011 25691 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.846611 30906 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:47.850867 30906 leader_election.cc:290] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:47.852600 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:47.813661 30914 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:47.856192 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet 60795798854e400987349043af926b8a with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:41122
I20260709 12:11:47.859043 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:47.875379 25582 leader_election.cc:304] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:47.876471 30606 raft_consensus.cc:2749] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:47.881728 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:47.871369 25691 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:47.892302 25689 raft_consensus.cc:2468] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 20.
I20260709 12:11:47.910856 30917 tablet_replica.cc:333] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:11:47.916194 30850 raft_consensus.cc:993] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:47.916801 30850 raft_consensus.cc:1081] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:47.918721 25612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:47.919307 25612 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.919642 25612 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.920379 25515 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 19 to 20, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 20 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.910172 25691 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:47.925762 25691 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:47.926599 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:47.927325 25614 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:47.936981 25612 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:47.939330 25612 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:47.942019 25614 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 19.
I20260709 12:11:47.943011 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:47.943691 25767 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.955451 25658 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:47.955806 25767 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:47.956642 30912 raft_consensus.cc:2804] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:47.956519 30917 raft_consensus.cc:2243] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:47.957221 30912 raft_consensus.cc:697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:47.957749 30917 raft_consensus.cc:2272] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:47.958240 30912 consensus_queue.cc:237] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:47.973575 30917 ts_tablet_manager.cc:1916] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:47.987071 25612 raft_consensus.cc:1240] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:47.984160 25515 catalog_manager.cc:5697] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 18 to 19, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 19 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.002436 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:48.005086 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:48.008375 25767 raft_consensus.cc:3055] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:48.008740 25767 raft_consensus.cc:740] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:48.009654 25767 consensus_queue.cc:260] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:48.010910 25767 raft_consensus.cc:3060] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:48.024252 30906 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:48.025728 30906 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:48.026777 30906 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:48.040880 30917 ts_tablet_manager.cc:1929] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:11:48.055477 30917 log.cc:1199] T 60795798854e400987349043af926b8a P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/60795798854e400987349043af926b8a
I20260709 12:11:48.058045 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:48.061265 25687 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:48.061625 25687 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:48.062636 25687 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:48.064471 25687 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.065503 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet 60795798854e400987349043af926b8a (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:48.040781 25767 raft_consensus.cc:2468] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 19.
I20260709 12:11:48.076367 25764 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:48.100739 25515 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.128192 25687 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:48.277087 25689 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:11:48.281883 30901 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:48.343171 25614 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:11:48.349998 30740 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:48.373112 25767 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:11:48.375070 30911 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:48.398502 25612 raft_consensus.cc:1275] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:11:48.402864 30912 consensus_queue.cc:1048] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:48.422533 25689 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:48.426638 30606 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:48.545840 25768 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:48.547765 30899 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:48.652038 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:48.799292 25767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "481bb8b350a240b0a487c38c13791369"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:48.800069 25767 raft_consensus.cc:606] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:48.811450 25691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6225db99ff6d444e990645903f433cf3"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:48.812235 25691 raft_consensus.cc:606] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:48.819525 25614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:48.820436 25614 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:48.822467 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:48.824579 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:48.825490 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:49.039390 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 64210.6us
I20260709 12:11:49.115566 30875 raft_consensus.cc:993] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:49.116313 30740 raft_consensus.cc:1081] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:49.118803 25689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "481bb8b350a240b0a487c38c13791369"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:49.120565 25689 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:49.123481 25689 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.131011 25768 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:49.136974 25689 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:49.141252 25731 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20c583a2390b4b6d955b01e778798db7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:49.142122 25687 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:49.148114 30875 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:49.144268 25612 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:49.150590 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:49.154626 25768 raft_consensus.cc:3055] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:49.154986 25768 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:49.155679 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:49.156330 25612 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.156647 25689 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:49.160554 30875 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.155927 25768 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.174238 25768 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.175151 30933 raft_consensus.cc:993] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:49.175801 30933 raft_consensus.cc:1081] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:49.181412 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:49.182030 25764 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:49.182423 25764 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.196908 25768 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:49.200079 25657 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:49.207245 30902 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.207901 30902 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:49.209008 30902 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.232333 25612 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:49.233379 25764 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.243599 25764 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:49.244804 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:49.249735 25687 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.259819 25687 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:49.245076 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:49.270015 25612 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.270311 25612 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:49.269229 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:49.274820 25612 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.278805 30875 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:49.281533 30875 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:49.282527 30875 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.293403 25612 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.295230 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:49.299553 25612 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:49.315475 25513 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.340087 30740 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:49.366003 25612 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:49.378079 25689 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:49.409888 30850 raft_consensus.cc:993] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:49.410524 30850 raft_consensus.cc:1081] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:49.412230 25614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6225db99ff6d444e990645903f433cf3"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:49.412899 25614 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:49.413335 25614 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.432929 25614 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.432643 25768 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:49.437551 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:49.438401 25689 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:49.438753 25689 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:49.452767 25614 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:49.517359 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76665.8us
I20260709 12:11:49.503445 25689 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.519199 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:49.519836 25762 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.537935 25762 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:49.547333 25582 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:49.548487 25689 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.576414 25689 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:11:49.585193 30906 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.607060 25618 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:49.597172 30906 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:49.602496 25513 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 9 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:49.617216 30934 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:49.632086 25731 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a1b2a1b70ef4f4f93481fcf3c72c5e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:49.631824 30906 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:49.657941 25764 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:49.727375 30934 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 12:11:49.749320 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 139412us
I20260709 12:11:49.752635 25614 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:49.754513 25687 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:49.755298 25614 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:49.760839 25689 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:49.765904 30875 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:49.768883 30875 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:49.795876 30951 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:49.797683 25516 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:49.807719 30943 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:49.901351 30953 ts_tablet_manager.cc:933] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:49.932072 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 127748us
I20260709 12:11:49.976593 30953 tablet_copy_client.cc:323] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:11:49.988794 30949 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.013885 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:50.041616 25612 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.059865 25689 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:50.062923 30899 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:50.074659 25689 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:50.087334 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 20c583a2390b4b6d955b01e778798db7 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:11:50.088357 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 20c583a2390b4b6d955b01e778798db7 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-20c583a2390b4b6d955b01e778798db7
I20260709 12:11:50.109812 25515 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.140690 25768 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:50.160192 30906 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:50.191041 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:50.191960 25618 raft_consensus.cc:606] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:50.203393 25612 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:50.205325 30911 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:50.177307 25777 tablet_copy_source_session.cc:215] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:50.224751 30912 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.237534 25764 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:50.236380 25688 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.243188 30934 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:50.247541 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:50.248369 25764 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:11:50.256594 25657 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bed4e4bd0407478d9750209db4d90dca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:50.281358 30966 ts_tablet_manager.cc:933] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:50.315812 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 49468.2us
I20260709 12:11:50.314416 25764 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.333788 30953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c583a2390b4b6d955b01e778798db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:50.343241 30740 raft_consensus.cc:993] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:50.343887 30740 raft_consensus.cc:1081] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:50.351614 25689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:50.352480 25689 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:50.352934 25689 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.362841 25689 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:50.340807 25614 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:50.324479 30966 tablet_copy_client.cc:323] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:11:50.374661 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:11:50.375641 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-5a1b2a1b70ef4f4f93481fcf3c72c5e4
I20260709 12:11:50.382148 25516 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.409198 25689 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:50.413369 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:50.417734 25768 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.418278 25768 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:50.419587 25768 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:50.422145 25768 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.428584 25689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:50.430167 25689 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:50.433193 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:50.434142 25619 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.435835 25768 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:50.438586 25618 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.440002 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:50.442556 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:50.440786 25657 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:50.443569 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:50.443986 30973 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.444564 30973 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:11:50.451016 25582 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c287ffad962949a7a7a740c373130b71. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:50.445555 30973 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:50.461813 25619 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:11:50.469463 25777 tablet_copy_source_session.cc:215] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:50.474987 30966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:50.480500 25764 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:50.502874 30899 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:50.518651 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48623.1us
I20260709 12:11:50.520542 25691 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:50.532891 30975 raft_consensus.cc:993] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:50.533463 30975 raft_consensus.cc:1081] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:50.534444 30899 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:50.539934 25614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:50.563959 25614 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:50.564424 25614 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.569841 25516 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 14, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:50.602885 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 66655us
I20260709 12:11:50.610780 25614 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:50.620622 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:50.621367 25687 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:50.621727 25687 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:50.622659 25687 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:50.626960 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.620121 25614 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:50.644097 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:50.644251 25687 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.660772 30606 raft_consensus.cc:993] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:50.661681 30606 raft_consensus.cc:1081] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:50.644950 25764 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:50.683238 30906 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.692622 25687 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:50.715276 25764 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 11.
I20260709 12:11:50.714900 25686 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.716223 30953 tablet_copy_client.cc:806] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:50.717072 30953 tablet_copy_client.cc:670] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:50.708813 25583 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:50.719506 30899 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:50.720564 30899 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:50.721488 30899 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:50.749526 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 90309us
I20260709 12:11:50.752305 25761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:50.753018 25761 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:50.753535 25761 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.760881 25516 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.764394 30979 ts_tablet_manager.cc:933] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:50.773203 25515 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 10 to 11, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 11 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:50.781092 25761 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:50.789624 30953 tablet_copy_client.cc:538] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:50.805286 25761 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:50.805285 25764 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:50.808094 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:50.808924 25618 raft_consensus.cc:3055] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:50.809324 25618 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:50.814508 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:50.816183 25691 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.816345 25618 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:50.822926 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39676
I20260709 12:11:50.823642 25686 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Received request to transfer leadership
I20260709 12:11:50.826599 25618 raft_consensus.cc:3060] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.838538 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39676
I20260709 12:11:50.840112 25686 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Received request to transfer leadership
I20260709 12:11:50.843910 25618 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:50.845925 25732 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:11:50.847500 25502 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 5a1b2a1b70ef4f4f93481fcf3c72c5e4 already in progress
I20260709 12:11:50.854199 30740 raft_consensus.cc:2804] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:50.855060 30740 raft_consensus.cc:697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:50.856032 30740 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:50.862490 30979 tablet_copy_client.cc:323] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:11:50.864704 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet bed4e4bd0407478d9750209db4d90dca from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:11:50.865482 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet bed4e4bd0407478d9750209db4d90dca from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-bed4e4bd0407478d9750209db4d90dca
I20260709 12:11:50.889282 30966 tablet_copy_client.cc:806] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:50.892128 25704 tablet_copy_source_session.cc:215] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:50.893714 30953 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:50.901633 25691 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:11:50.890234 30966 tablet_copy_client.cc:670] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
W20260709 12:11:50.943162 25502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 95704.9us
I20260709 12:11:50.943615 30979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed4e4bd0407478d9750209db4d90dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:50.963457 30966 tablet_copy_client.cc:538] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:50.970456 25691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39676
I20260709 12:11:50.971285 25691 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Received request to transfer leadership
I20260709 12:11:51.003768 30966 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
W20260709 12:11:51.004966 25657 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:51.007620 25565 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:11:51.008142 25565 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5a1b2a1b70ef4f4f93481fcf3c72c5e4 already in progress
W20260709 12:11:51.008431 25565 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5a1b2a1b70ef4f4f93481fcf3c72c5e4 already in progress
I20260709 12:11:51.013022 25513 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:51.071966 25764 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:51.093051 30972 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:51.106354 25614 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:51.110797 30975 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:51.139793 25764 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:51.170904 30985 ts_tablet_manager.cc:933] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:11:51.172000 30978 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:51.171998 30911 raft_consensus.cc:993] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:51.175760 30911 raft_consensus.cc:1081] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:51.193176 25618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:51.205866 30979 tablet_copy_client.cc:806] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
W20260709 12:11:51.218236 30987 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:51.242560 30979 tablet_copy_client.cc:670] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:51.250403 30979 tablet_copy_client.cc:538] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:51.287175 30985 tablet_copy_client.cc:323] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:11:51.293697 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet c287ffad962949a7a7a740c373130b71 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:11:51.294606 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet c287ffad962949a7a7a740c373130b71 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-c287ffad962949a7a7a740c373130b71
I20260709 12:11:51.302565 25618 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.303164 25618 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.309418 25629 tablet_copy_source_session.cc:215] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:51.312906 25688 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:51.313443 25687 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:51.318243 25618 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:51.345574 30966 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:51.369213 30966 tablet_bootstrap.cc:492] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:51.373875 30966 ts_tablet_manager.cc:1403] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.371s	user 0.049s	sys 0.000s
I20260709 12:11:51.376924 30932 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:51.378995 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 56175.8us
I20260709 12:11:51.388541 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:51.389642 25691 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.390093 25691 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:51.391489 25691 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:51.403084 25691 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.393071 30966 raft_consensus.cc:359] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:51.405085 30966 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:51.405840 30966 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:51.416812 30966 ts_tablet_manager.cc:1434] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:11:51.392297 30959 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:51.463878 25691 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:51.481913 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:51.482700 25761 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:51.547063 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 77284.6us
I20260709 12:11:51.552819 25761 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:11:51.469965 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-5a1b2a1b70ef4f4f93481fcf3c72c5e4 received from {username='slave'} at 127.0.0.1:41126
W20260709 12:11:51.568742 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71556us
I20260709 12:11:51.577872 25618 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:51.530771 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:51.594403 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 127050us
I20260709 12:11:51.601392 25583 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:11:51.632036 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 139343us
I20260709 12:11:51.600651 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-5a1b2a1b70ef4f4f93481fcf3c72c5e4 on tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 with peer 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:11:51.644476 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 171845us
I20260709 12:11:51.655354 30953 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:51.655784 30985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c287ffad962949a7a7a740c373130b71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:51.677621 25658 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.640460 30906 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:51.709195 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 131827us
W20260709 12:11:51.713812 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 107782us
W20260709 12:11:51.720770 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 203806us
I20260709 12:11:51.734884 30979 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:51.717564 30906 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:51.749014 30953 tablet_bootstrap.cc:492] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:51.775131 25618 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:51.797243 25761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:51.798202 25761 raft_consensus.cc:606] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:51.821185 31002 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:51.847483 25689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debca0eda6c649e38d13858860f6a245"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:51.818569 30953 ts_tablet_manager.cc:1403] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.974s	user 0.052s	sys 0.069s
I20260709 12:11:51.848253 25689 raft_consensus.cc:606] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:51.861426 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:51.862187 25619 raft_consensus.cc:606] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:51.881448 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:11:51.884507 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 73820.3us
W20260709 12:11:51.910658 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 117214us
I20260709 12:11:51.854703 30906 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:51.934767 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:51.935772 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.024134 30953 raft_consensus.cc:359] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:52.025153 30953 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:52.027400 30953 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:52.049177 30953 ts_tablet_manager.cc:1434] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.196s	user 0.002s	sys 0.005s
I20260709 12:11:52.058333 31001 raft_consensus.cc:993] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:52.058921 31001 raft_consensus.cc:1081] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
W20260709 12:11:52.063082 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 57705us
I20260709 12:11:52.084173 31018 raft_consensus.cc:993] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:52.084864 30934 raft_consensus.cc:1081] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:52.093708 25618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debca0eda6c649e38d13858860f6a245"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:52.094384 25618 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.094758 25618 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.098968 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-20c583a2390b4b6d955b01e778798db7 received from {username='slave'} at 127.0.0.1:41126
I20260709 12:11:52.099453 26338 raft_consensus.cc:1217] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:11:52.099479 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-20c583a2390b4b6d955b01e778798db7 on tablet 20c583a2390b4b6d955b01e778798db7 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:52.049204 25515 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 15, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.119082 25618 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:52.141728 25618 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:52.142635 25687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:52.143313 25687 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.143934 25687 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.151962 25687 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:52.159740 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:52.176492 30985 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60616 (request call id 241) took 1113 ms. Trace:
W20260709 12:11:52.141942 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 259867us
I20260709 12:11:52.184900 25691 raft_consensus.cc:3055] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.185473 25691 raft_consensus.cc:740] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:52.193265 25686 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.201119 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:52.201821 25768 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.204586 25691 consensus_queue.cc:260] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:52.207159 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:52.208128 25616 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.209726 25691 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.185781 30985 rpcz_store.cc:276] 0709 12:11:51.063226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.063477 (+   251us) service_pool.cc:224] Handling call
0709 12:11:51.171366 (+107889us) ts_tablet_manager.cc:934] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
0709 12:11:51.475738 (+304372us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:52.042841 (+567103us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:52.042986 (+   145us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:52.175615 (+132629us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:52.175947 (+   332us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:52.176347 (+   400us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:52.176414 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":307,"tablet-copy.queue_time_us":106814,"thread_start_us":193825,"threads_started":2}
I20260709 12:11:52.211971 30985 tablet_copy_client.cc:806] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:52.212581 30985 tablet_copy_client.cc:670] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:52.235968 25691 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:52.237361 25687 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:52.245165 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:52.245885 25766 raft_consensus.cc:3055] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.246178 25766 raft_consensus.cc:740] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:52.244091 25583 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:52.246781 31001 consensus_queue.cc:1059] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:52.248270 30899 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.248842 30899 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:52.249751 30899 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:52.257758 25766 consensus_queue.cc:260] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:52.264021 25768 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:52.264958 25766 raft_consensus.cc:3060] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.264602 25616 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:11:52.266794 25619 raft_consensus.cc:1240] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.270341 25658 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:52.280761 30973 raft_consensus.cc:2804] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.281379 30973 raft_consensus.cc:697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:52.282325 30973 consensus_queue.cc:237] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:52.328234 25766 raft_consensus.cc:2468] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
W20260709 12:11:52.340955 31001 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:11:52.364202 25685 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.406746 30933 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 12:11:52.462402 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51619.4us
I20260709 12:11:52.466009 31008 raft_consensus.cc:993] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:52.493389 31008 raft_consensus.cc:1081] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:52.496088 30985 tablet_copy_client.cc:538] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:52.530201 30985 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:11:52.539091 26338 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Advancing to term 15
I20260709 12:11:52.530874 30949 raft_consensus.cc:1064] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:52.555491 25766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:52.559242 25766 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:52.559710 25766 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.561209 25763 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.566895 30979 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:52.567996 30979 tablet_bootstrap.cc:492] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:52.578382 30949 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:52.581990 25766 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:52.584906 25766 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:52.585357 30979 ts_tablet_manager.cc:1403] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.851s	user 0.053s	sys 0.005s
I20260709 12:11:52.585495 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:52.586182 26334 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.587698 26338 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.594926 30979 raft_consensus.cc:359] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:52.596001 30979 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:52.597014 30979 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:52.600806 26334 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:52.604135 30979 ts_tablet_manager.cc:1434] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:11:52.606521 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-bed4e4bd0407478d9750209db4d90dca received from {username='slave'} at 127.0.0.1:51490
I20260709 12:11:52.608260 25731 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:11:52.607671 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-bed4e4bd0407478d9750209db4d90dca on tablet bed4e4bd0407478d9750209db4d90dca with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:52.613250 31007 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.614130 31007 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:52.615419 31007 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:52.699786 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:52.701787 25619 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.702626 25619 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:52.704589 25619 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:52.708261 25619 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.717706 25513 catalog_manager.cc:5697] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 14 to 15, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.732986 25691 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:52.743520 26334 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:52.772171 30932 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:52.806743 31001 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:52.810127 25619 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:11:52.831624 30910 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:52.901700 31037 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 12:11:52.925208 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 47959.7us
I20260709 12:11:52.934092 25614 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.944269 25513 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.954691 25768 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:52.971102 25763 raft_consensus.cc:1275] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.972774 26334 raft_consensus.cc:1217] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 12:11:52.980464 25618 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:53.002888 25517 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:53.010321 30997 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:53.056118 30949 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:53.077880 31044 consensus_queue.cc:1048] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:53.088593 25685 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:53.157449 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:53.158650 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 75162.7us
I20260709 12:11:53.161857 31037 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:53.178505 30933 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:53.279291 25611 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:53.330873 31015 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:53.364871 26340 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:53.368235 30943 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:53.439738 30985 log.cc:927] Time spent T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:11:53.441128 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 149118us
I20260709 12:11:53.441787 30985 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:53.446565 31007 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:53.452400 26340 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:53.464381 30985 tablet_bootstrap.cc:492] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:11:53.465615 30985 ts_tablet_manager.cc:1403] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.936s	user 0.038s	sys 0.028s
I20260709 12:11:53.543431 25691 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:53.555680 30985 raft_consensus.cc:359] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:53.557591 30985 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:11:53.565564 31038 raft_consensus.cc:1064] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:53.590965 30985 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:53.595085 31038 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:53.603533 30985 ts_tablet_manager.cc:1434] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.138s	user 0.005s	sys 0.007s
I20260709 12:11:53.666127 25614 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:53.710656 30973 raft_consensus.cc:1064] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:11:53.717502 30973 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:53.731549 25688 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.742316 26338 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.743870 25763 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.754123 25517 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:53.761831 30932 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:11:53.794116 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-c287ffad962949a7a7a740c373130b71 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:11:53.794953 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-c287ffad962949a7a7a740c373130b71 on tablet c287ffad962949a7a7a740c373130b71 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:53.840674 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:53.841593 25616 raft_consensus.cc:606] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:11:53.844708 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60535.1us
I20260709 12:11:53.846788 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:53.847460 25616 raft_consensus.cc:606] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:53.868050 31037 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:53.871445 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 77973.7us
I20260709 12:11:53.875758 25766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:53.876653 25766 raft_consensus.cc:606] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:53.880656 25766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:53.881363 25766 raft_consensus.cc:606] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:53.883834 30933 raft_consensus.cc:993] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:53.884384 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:11:53.885449 30933 raft_consensus.cc:1081] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:53.886695 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:53.891470 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:53.895020 30943 raft_consensus.cc:993] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:53.897661 30932 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:53.917743 31054 raft_consensus.cc:1081] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:53.898063 25616 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.898063 26338 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.900830 25766 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.924075 25689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:53.924830 25689 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.925182 25689 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.925796 31018 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:11:53.927946 30996 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:53.951135 26338 raft_consensus.cc:1217] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:11:53.952821 25761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:53.953490 25761 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.953894 25761 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.954053 30973 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:53.963515 25689 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:53.966511 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:53.972381 25619 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.975975 25689 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:54.005720 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:54.006505 25763 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:54.006817 25763 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:54.007623 25763 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:54.009096 25763 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.013339 30606 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:54.020108 25619 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:54.027324 25658 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:54.028910 30999 raft_consensus.cc:993] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:54.029644 30999 raft_consensus.cc:1081] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:54.031224 31018 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:54.031908 31018 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:54.033169 31018 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:54.045763 25766 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:54.071175 25763 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:11:54.074273 30973 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:54.075721 25616 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:54.065985 25761 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:54.124780 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:54.125730 25768 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:54.126211 25768 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.151234 31054 raft_consensus.cc:993] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:54.276201 25761 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:54.270681 25763 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:54.173709 26340 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:54.271080 25685 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 9 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:54.291822 25760 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:54.296087 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 119402us
I20260709 12:11:54.197382 25768 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:54.301941 31029 raft_consensus.cc:1081] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:54.275682 25515 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:54.346515 25768 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:54.355300 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:54.356241 25612 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:54.356611 25612 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:54.368953 25517 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 9 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:54.384368 30978 consensus_queue.cc:1059] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:54.394587 25612 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:54.500463 25612 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:54.506438 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 52638.2us
I20260709 12:11:54.507794 26338 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:54.508822 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 105304us
W20260709 12:11:54.557437 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 173723us
W20260709 12:11:54.572614 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 62890us
I20260709 12:11:54.578784 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:54.579867 25616 raft_consensus.cc:3055] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:54.580294 25616 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:54.531766 31029 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:54.596817 25611 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:54.584728 30973 consensus_meta.cc:287] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Time spent flushing consensus metadata: real 0.503s	user 0.021s	sys 0.000s
W20260709 12:11:54.605765 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 174569us
I20260709 12:11:54.605999 25616 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:54.611646 25616 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.663422 25761 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:54.706885 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44345.6us
I20260709 12:11:54.712301 25616 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
W20260709 12:11:54.736501 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 121692us
W20260709 12:11:54.737129 31060 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:54.782521 25612 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
W20260709 12:11:54.829150 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 80152.1us
W20260709 12:11:54.823042 31037 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 12:11:54.835608 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 272920us
W20260709 12:11:54.849825 25584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.858064 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 149487us
I20260709 12:11:54.956983 25612 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:54.959271 31089 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:54.998085 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 157534us
I20260709 12:11:55.003140 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:55.003914 25685 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.004494 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:55.004900 25689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:55.005446 25693 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:55.005537 25689 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:55.005996 25689 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.011824 31015 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:55.024657 25689 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:55.026288 25691 raft_consensus.cc:1240] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:55.031787 25693 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 9.
I20260709 12:11:55.033738 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:55.045212 25611 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.045045 25685 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
W20260709 12:11:55.052717 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.071170 26340 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.033123 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:55.041978 25689 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:11:55.091187 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 67812.3us
I20260709 12:11:55.093307 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:55.110764 25759 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:55.123346 31086 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:55.123802 31088 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:55.148918 25764 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.153602 31072 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:55.134931 31086 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:55.143898 31088 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:55.162192 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:55.178777 25759 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:55.179176 25759 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:55.156262 25513 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.205276 31086 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:55.217497 25759 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:55.229243 25759 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.252617 31088 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:11:55.260767 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 53393.2us
I20260709 12:11:55.263597 30606 raft_consensus.cc:1064] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
W20260709 12:11:55.266628 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86357.1us
I20260709 12:11:55.266985 30606 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:11:55.270393 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73001.7us
I20260709 12:11:55.272118 25611 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:55.276175 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:55.279553 25759 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:11:55.303582 30973 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:55.304471 30973 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:55.305563 30973 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:55.328305 31007 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.333002 26340 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.425144 31079 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:55.426232 31079 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:55.436266 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:55.493794 25515 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 8 to 9, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 9 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.501184 31079 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:11:55.512266 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 56489.9us
I20260709 12:11:55.521936 25612 raft_consensus.cc:2955] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.552469 26340 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:55.564385 25764 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:55.606361 31085 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:55.616906 31085 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:55.618775 25612 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:55.629640 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:55.655275 26335 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.657559 31085 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:55.679157 25515 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 8 to 9, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 9 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:11:55.722433 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58137.8us
I20260709 12:11:55.724732 25764 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.722461 25689 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:55.737857 25694 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:55.753180 25657 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:55.748148 25517 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.764343 31073 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:55.768424 31085 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:55.774945 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.788475 25694 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:55.796450 31015 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:55.799050 31079 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:55.801231 31079 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:55.799330 31118 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:11:55.809777 25612 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:55.828343 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:55.831913 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c583a2390b4b6d955b01e778798db7 with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39676
I20260709 12:11:55.835327 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:55.838505 31123 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:11:55.849442 31085 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:55.850239 31085 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:55.856812 25612 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.858817 30973 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:55.879647 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:11:55.884663 31016 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:55.886672 31071 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:55.895085 31089 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:11:55.895872 31089 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:11:55.897758 31124 log.cc:927] Time spent T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:11:55.910125 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:55.916523 26337 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:55.847823 31007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54016 (request call id 69) took 1745 ms. Trace:
I20260709 12:11:55.938429 31089 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:55.956933 31085 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:55.968166 25613 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:55.986318 31119 log.cc:927] Time spent T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 12:11:56.006047 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:56.031154 31079 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:56.061528 25760 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.102839 31127 tablet_replica.cc:333] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:11:56.101191 25515 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 11, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:56.127372 30606 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.169965 30943 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:56.187820 26337 raft_consensus.cc:2955] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:11:56.210616 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 232485us
I20260709 12:11:56.228413 31127 raft_consensus.cc:2243] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.229616 31127 raft_consensus.cc:2272] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.233314 31127 ts_tablet_manager.cc:1916] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:55.935695 31007 rpcz_store.cc:276] 0709 12:11:54.089158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.089314 (+   156us) service_pool.cc:224] Handling call
0709 12:11:54.281300 (+191986us) log.cc:844] Serialized 508 byte log entry
0709 12:11:54.505272 (+223972us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54001ec6a0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cdbb26 00007fbdb2cd549a 00007fbdb2cd4714 00007fbdb2cb4eaa 00007fbdb2cbbd53 00007fbdb2cbbcd9 00007fbdb2cbbc69 00007fbdb2cbbc31 00007fbdb2cbadfd 0000000000388634
0709 12:11:55.816194 (+1310922us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31069,"raft.queue_time_us":20474,"raft.run_cpu_time_us":11293,"raft.run_wall_time_us":174501,"spinlock_wait_cycles":25851648}
I20260709 12:11:56.246506 25767 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.266669 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:56.265041 31079 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:11:56.279588 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44534.1us
I20260709 12:11:56.281551 25614 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.295588 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:56.299727 31127 ts_tablet_manager.cc:1929] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:11:56.300360 31127 log.cc:1199] T 20c583a2390b4b6d955b01e778798db7 P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/20c583a2390b4b6d955b01e778798db7
I20260709 12:11:56.300598 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20c583a2390b4b6d955b01e778798db7 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:56.312898 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 20c583a2390b4b6d955b01e778798db7 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:56.323016 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bed4e4bd0407478d9750209db4d90dca with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:56.340862 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:56.350445 25517 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.368798 25583 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:56.370970 31071 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.386407 26337 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.388015 25657 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:11:56.395524 25513 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:56.449103 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:39676
W20260709 12:11:56.539340 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 120789us
I20260709 12:11:56.541337 25692 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:56.546620 31090 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:11:56.573480 31090 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:56.577522 31090 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:56.415795 31133 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:56.549324 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 128566us
W20260709 12:11:56.578660 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 170404us
I20260709 12:11:56.591566 25516 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.594419 31127 tablet_replica.cc:333] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:11:56.448436 31135 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:56.607872 25688 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.618662 25657 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:56.635624 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:11:56.637567 25611 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:56.644415 25619 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:56.659369 31135 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.675736 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet bed4e4bd0407478d9750209db4d90dca with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:54016
I20260709 12:11:56.679054 25760 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:56.678953 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:11:56.689658 31145 tablet_replica.cc:333] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:11:56.690366 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:56.700736 25619 raft_consensus.cc:606] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:56.704595 25767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7414eafc9044de28063237176e3435f"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:56.705374 25767 raft_consensus.cc:606] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:56.712587 31127 raft_consensus.cc:2243] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.712949 31085 raft_consensus.cc:993] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:56.713929 31071 raft_consensus.cc:1081] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:56.718711 31073 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:56.719813 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:56.720369 31127 raft_consensus.cc:2272] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.722049 31073 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:56.723242 31116 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.724026 31127 ts_tablet_manager.cc:1916] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:56.726881 26338 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:56.739297 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51090.8us
I20260709 12:11:56.741695 25766 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:56.744403 25766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:56.745002 25766 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.745405 25766 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.749080 31086 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:56.752784 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:56.753727 25694 raft_consensus.cc:606] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:56.756345 25766 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:56.760164 26337 raft_consensus.cc:2955] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.793896 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:56.797319 25766 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:56.806016 31085 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:56.806686 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.813853 31127 ts_tablet_manager.cc:1929] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 12:11:56.814440 31127 log.cc:1199] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/5a1b2a1b70ef4f4f93481fcf3c72c5e4
I20260709 12:11:56.816121 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 5a1b2a1b70ef4f4f93481fcf3c72c5e4 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:56.818043 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.830673 30933 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:56.834661 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:56.848062 25692 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.850865 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:56.851555 25614 raft_consensus.cc:3055] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:56.851852 25614 raft_consensus.cc:740] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:56.861593 25614 consensus_queue.cc:260] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:56.870957 25614 raft_consensus.cc:3060] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.914733 31145 raft_consensus.cc:2243] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:56.918694 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 47476.8us
I20260709 12:11:56.924345 25614 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:11:56.933125 31145 raft_consensus.cc:2272] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.935066 25692 raft_consensus.cc:2468] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
W20260709 12:11:56.936091 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 84074.5us
I20260709 12:11:56.939611 31133 raft_consensus.cc:993] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:56.940474 31089 raft_consensus.cc:1081] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:56.958062 31145 ts_tablet_manager.cc:1916] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:56.976630 30999 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:56.999987 31145 ts_tablet_manager.cc:1929] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 12:11:57.000703 31145 log.cc:1199] T bed4e4bd0407478d9750209db4d90dca P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/bed4e4bd0407478d9750209db4d90dca
I20260709 12:11:57.115836 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c287ffad962949a7a7a740c373130b71 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:11:57.220685 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 288338us
I20260709 12:11:57.222152 25732 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:11:57.225874 31054 raft_consensus.cc:2804] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:57.226459 31054 raft_consensus.cc:697] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:57.227499 31007 raft_consensus.cc:993] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:57.227375 31054 consensus_queue.cc:237] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.228147 31007 raft_consensus.cc:1081] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:57.305519 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet bed4e4bd0407478d9750209db4d90dca (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:57.322400 25619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7414eafc9044de28063237176e3435f"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:11:57.323227 25619 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:57.323747 25619 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:57.325704 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 388874us
I20260709 12:11:57.333818 25611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:57.334625 25611 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:57.335062 25611 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.369568 30943 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:11:57.370390 30943 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.373015 30943 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:11:57.379725 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 130979us
I20260709 12:11:57.402000 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:11:57.408629 25611 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.414079 25619 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.428544 25612 raft_consensus.cc:1240] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:57.430812 25611 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:57.441161 25619 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:57.457651 25517 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 11 to 12, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.462016 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:57.462741 25685 raft_consensus.cc:3055] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:57.463030 25685 raft_consensus.cc:740] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:57.463864 25685 consensus_queue.cc:260] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.465837 25685 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.472672 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:57.473557 25692 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.485447 25685 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:57.444890 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
W20260709 12:11:57.542569 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 99284.4us
W20260709 12:11:57.557540 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 63044.6us
I20260709 12:11:57.559784 25583 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:57.560916 31151 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:57.561491 31151 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:57.571244 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:57.571969 25760 raft_consensus.cc:3055] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:57.572086 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:57.572337 25760 raft_consensus.cc:740] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:57.572743 25768 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.573998 25692 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:57.573165 25760 consensus_queue.cc:260] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.583385 25760 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.597311 31151 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:57.620110 25760 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 12.
I20260709 12:11:57.641968 25768 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:11:57.644696 25759 raft_consensus.cc:1240] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:57.657397 25583 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:57.669816 26338 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:57.684881 30933 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:57.686903 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 84082.3us
I20260709 12:11:57.687606 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:57.741285 25515 catalog_manager.cc:5697] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 11 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.729293 31099 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:11:57.826339 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 138072us
I20260709 12:11:57.856056 25759 raft_consensus.cc:2955] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:11:57.857792 25694 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:57.863346 25614 raft_consensus.cc:1275] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:57.843292 30933 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:57.876628 30943 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:57.909171 31001 consensus_queue.cc:1048] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:57.924880 30933 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:58.029662 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet c287ffad962949a7a7a740c373130b71 with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:39676
I20260709 12:11:58.099921 25515 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.102351 31174 tablet_replica.cc:333] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:11:58.101982 25515 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 11 to 12, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 12 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.103720 31174 raft_consensus.cc:2243] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:58.105270 31174 raft_consensus.cc:2272] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:58.108949 31174 ts_tablet_manager.cc:1916] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:58.152900 31174 ts_tablet_manager.cc:1929] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:11:58.153364 31174 log.cc:1199] T c287ffad962949a7a7a740c373130b71 P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/c287ffad962949a7a7a740c373130b71
I20260709 12:11:58.155215 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet c287ffad962949a7a7a740c373130b71 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:11:58.187512 25760 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:58.190464 31151 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:58.254460 25693 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:58.256282 30933 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:58.328318 26361 debug-util.cc:398] Leaking SignalData structure 0x7b080024f960 after lost signal to thread 24445
W20260709 12:11:58.329851 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2d60 after lost signal to thread 25551
W20260709 12:11:58.331501 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002e29c0 after lost signal to thread 25643
W20260709 12:11:58.332907 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd180 after lost signal to thread 25718
W20260709 12:11:58.334362 26361 debug-util.cc:398] Leaking SignalData structure 0x7b0800299760 after lost signal to thread 25792
W20260709 12:11:58.335911 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6a00 after lost signal to thread 26364
I20260709 12:11:58.487571 25694 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:58.490598 31168 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:58.529919 25760 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:58.531693 31151 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:58.858529 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.053088 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:11:59.053786 25760 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:11:59.071408 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6225db99ff6d444e990645903f433cf3"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:11:59.072126 25617 raft_consensus.cc:606] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:11:59.075728 25687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:11:59.076423 25687 raft_consensus.cc:606] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:11:59.077989 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:59.080153 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:59.081049 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.143550 31161 raft_consensus.cc:993] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:59.144232 30933 raft_consensus.cc:1081] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:11:59.146358 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6225db99ff6d444e990645903f433cf3"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:11:59.147018 25760 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:59.147406 25760 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.154317 31099 raft_consensus.cc:993] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:59.155771 31099 raft_consensus.cc:1081] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:11:59.167918 25693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:11:59.168838 25693 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:59.169278 25693 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:59.188897 25693 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:59.197075 25760 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:59.203655 25693 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:11:59.204056 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:59.200757 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:11:59.204804 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:11:59.205192 25617 raft_consensus.cc:3055] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:59.205328 25760 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:11:59.205528 25759 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:11:59.204813 25614 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:59.206040 25759 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:59.205605 25617 raft_consensus.cc:740] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:59.212646 25759 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:59.213917 25617 consensus_queue.cc:260] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:59.215394 25617 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.215308 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:59.216077 25693 raft_consensus.cc:3060] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.214129 25759 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:59.249300 25759 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 20.
I20260709 12:11:59.254770 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:59.255999 31093 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:59.256999 31093 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:59.257175 25617 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:59.258102 31093 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:59.265373 25693 raft_consensus.cc:2468] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:11:59.275015 25732 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:59.279984 25614 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 20.
I20260709 12:11:59.279273 31152 raft_consensus.cc:2804] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.281579 31152 raft_consensus.cc:697] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:11:59.282600 31152 consensus_queue.cc:237] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:11:59.329856 25513 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 19 to 20, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 20 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.367129 25515 catalog_manager.cc:5697] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:59.372305 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 68539.5us
W20260709 12:11:59.384727 31186 log.cc:927] Time spent T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.076s	user 0.003s	sys 0.000s
W20260709 12:11:59.412253 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 86999.9us
I20260709 12:11:59.444046 25694 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:11:59.506912 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48137us
W20260709 12:11:59.512934 25657 consensus_peers.cc:597] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c38995c6d4645379acd1dcc03a8a65f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:59.516880 25759 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:59.519378 31090 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.519985 25614 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:59.522775 31196 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:59.575802 31198 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.058s	user 0.001s	sys 0.002s
I20260709 12:11:59.578498 31090 raft_consensus.cc:993] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:59.581981 31090 raft_consensus.cc:1081] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:11:59.590169 25617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:11:59.590921 25617 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:59.591368 25617 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.602645 31090 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:59.617097 25617 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:59.619851 25617 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:11:59.624441 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:11:59.625176 26338 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.626068 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:11:59.626765 25687 raft_consensus.cc:3055] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:59.627063 25687 raft_consensus.cc:740] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:11:59.627930 25687 consensus_queue.cc:260] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:59.629505 25687 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.636526 25614 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:59.645021 25687 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:59.644055 25760 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:11:59.666556 25759 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:11:59.662091 25513 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 10, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.694743 25583 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:11:59.696058 31151 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.696655 31151 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:11:59.697634 31151 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:11:59.720557 26338 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:11:59.769614 25515 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 15 to 16, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:59.780364 25760 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:11:59.795203 25731 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6640372ef1e64554b6b1025b28173499. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:59.798897 31203 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:11:59.804514 25694 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:59.804898 25687 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:59.837816 31152 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:59.841104 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 52909.2us
I20260709 12:11:59.855408 25617 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:11:59.858606 31203 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:59.863191 31188 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:59.890514 25612 raft_consensus.cc:1275] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:59.908063 25612 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:59.984565 31188 consensus_queue.cc:1048] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:00.013571 31152 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:00.107574 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 82565.4us
W20260709 12:12:00.171722 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57731us
W20260709 12:12:00.173444 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 117037us
I20260709 12:12:00.235121 31188 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:12:00.255928 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 75088.1us
W20260709 12:12:00.265482 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 89825.7us
W20260709 12:12:00.271659 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 87792.9us
I20260709 12:12:00.292825 25694 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:00.269155 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:00.313513 31229 ts_tablet_manager.cc:933] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:00.357932 26338 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:12:00.398769 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 90376.7us
I20260709 12:12:00.403578 25766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:00.404436 25766 raft_consensus.cc:606] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:00.382576 31192 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
W20260709 12:12:00.413151 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 235808us
W20260709 12:12:00.463910 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44809.8us
W20260709 12:12:00.463966 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 86997.3us
I20260709 12:12:00.474156 25611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:00.474995 25611 raft_consensus.cc:606] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:00.468716 25694 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:00.444362 31194 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:12:00.472297 31229 tablet_copy_client.cc:323] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
W20260709 12:12:00.569392 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 86882.6us
W20260709 12:12:00.572155 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 106647us
I20260709 12:12:00.575084 25691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
W20260709 12:12:00.576493 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 95805.1us
I20260709 12:12:00.592402 25691 raft_consensus.cc:606] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:12:00.647902 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 170066us
W20260709 12:12:00.681079 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 65306.8us
I20260709 12:12:00.691409 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:00.693596 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.714186 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:00.747607 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 72182us
I20260709 12:12:00.761439 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet 6c38995c6d4645379acd1dcc03a8a65f from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:12:00.783051 25612 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:00.787388 31218 raft_consensus.cc:993] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:00.788004 31218 raft_consensus.cc:1081] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:00.806020 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:00.806803 25767 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.807171 25767 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.828152 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet 6c38995c6d4645379acd1dcc03a8a65f from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-6c38995c6d4645379acd1dcc03a8a65f
I20260709 12:12:00.840523 25515 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:00.858144 25685 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:00.865027 25767 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:00.872022 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 46443.4us
I20260709 12:12:00.881769 25767 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:00.845773 31188 raft_consensus.cc:993] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:00.891134 31188 raft_consensus.cc:1081] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:00.891523 31228 raft_consensus.cc:993] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:00.892155 31228 raft_consensus.cc:1081] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
W20260709 12:12:00.885583 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 54858.7us
I20260709 12:12:00.921139 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:12:00.921837 25767 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:00.922189 25767 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.933383 25767 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:00.936054 31255 ts_tablet_manager.cc:933] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:00.954452 25762 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:00.942004 31223 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:00.961210 25704 tablet_copy_source_session.cc:215] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:12:00.962477 25582 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1deffe0cca244839dc0d8c35e1c9292. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:00.965653 31255 tablet_copy_client.cc:323] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
W20260709 12:12:00.967667 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 140592us
I20260709 12:12:00.982321 25767 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:00.984315 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:00.985093 26337 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.990742 25762 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.001268 30933 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:01.008965 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 6640372ef1e64554b6b1025b28173499 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:12:01.009686 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 6640372ef1e64554b6b1025b28173499 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-6640372ef1e64554b6b1025b28173499
I20260709 12:12:01.021196 26337 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:12:01.023028 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:01.025439 25731 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:01.023681 31192 consensus_queue.cc:1059] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.035444 31214 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:01.036244 31214 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:01.037205 31214 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:01.076880 25777 tablet_copy_source_session.cc:215] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:01.077607 25613 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.078001 25613 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:01.092938 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:01.094554 25685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:01.095257 25685 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.095768 25685 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.097576 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:01.098546 25694 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:01.098940 25694 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:01.099645 25693 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.095614 25612 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:01.099768 25694 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:01.109066 25694 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.128732 25691 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:01.140337 25685 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:01.141639 25687 raft_consensus.cc:1240] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.142272 25694 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:12:01.145860 25613 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:01.162856 25613 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.195812 25693 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:01.199792 25617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:01.200659 25617 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.204159 25685 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:01.235687 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:01.236721 25767 raft_consensus.cc:3055] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:01.237149 25767 raft_consensus.cc:740] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:01.238358 31229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c38995c6d4645379acd1dcc03a8a65f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:01.252071 25767 consensus_queue.cc:260] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:01.254427 25767 raft_consensus.cc:3060] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:01.255198 31265 log.cc:927] Time spent T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:12:01.114303 31235 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:01.306236 31255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6640372ef1e64554b6b1025b28173499. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:01.315408 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 174570us
W20260709 12:12:01.333700 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 161515us
I20260709 12:12:01.367653 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:01.375269 31273 ts_tablet_manager.cc:933] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:12:01.376283 31267 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:01.377393 31267 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:01.376426 25760 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:01.409125 25617 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:01.412649 25767 raft_consensus.cc:2468] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:01.378782 31267 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:01.416802 25613 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
W20260709 12:12:01.419523 31223 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:12:01.418578 25658 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:01.423206 31232 raft_consensus.cc:2804] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:01.423822 31232 raft_consensus.cc:697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:01.424841 31232 consensus_queue.cc:237] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:01.536056 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 73479.4us
I20260709 12:12:01.497772 31273 tablet_copy_client.cc:323] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:12:01.583633 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet b1deffe0cca244839dc0d8c35e1c9292 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:12:01.584285 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet b1deffe0cca244839dc0d8c35e1c9292 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-b1deffe0cca244839dc0d8c35e1c9292
I20260709 12:12:01.639976 25629 tablet_copy_source_session.cc:215] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:01.650882 31273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1deffe0cca244839dc0d8c35e1c9292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:01.757803 25690 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:01.765748 31229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60620 (request call id 199) took 1584 ms. Trace:
I20260709 12:12:01.766327 31229 rpcz_store.cc:276] 0709 12:12:00.183888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.184064 (+   176us) service_pool.cc:224] Handling call
0709 12:12:00.314008 (+129944us) ts_tablet_manager.cc:934] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
0709 12:12:01.099317 (+785309us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:01.592184 (+492867us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:01.592343 (+   159us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:01.764941 (+172598us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:01.765261 (+   320us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:01.765586 (+   325us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:01.765669 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":80523,"tablet-copy.queue_time_us":126669,"thread_start_us":166059,"threads_started":2}
I20260709 12:12:01.767395 25517 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 12, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.783975 26338 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:01.785786 31279 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:01.789654 31229 tablet_copy_client.cc:806] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:01.790490 31229 tablet_copy_client.cc:670] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:01.801370 25513 catalog_manager.cc:5697] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 17 to 18, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.819527 31255 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45784 (request call id 178) took 1108 ms. Trace:
I20260709 12:12:01.820195 31255 rpcz_store.cc:276] 0709 12:12:00.711207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.711431 (+   224us) service_pool.cc:224] Handling call
0709 12:12:00.936624 (+225193us) ts_tablet_manager.cc:934] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
0709 12:12:01.094490 (+157866us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:01.473842 (+379352us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:01.473988 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:01.764410 (+290422us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:01.818978 (+ 54568us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:01.819379 (+   401us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:01.819444 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":288,"tablet-copy.queue_time_us":224021,"thread_start_us":117569,"threads_started":2}
I20260709 12:12:01.822422 31255 tablet_copy_client.cc:806] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:01.823112 31255 tablet_copy_client.cc:670] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:01.852967 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 12 to 13, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.856554 25515 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:01.888435 25693 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:01.891659 31229 tablet_copy_client.cc:538] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:01.896579 25759 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:01.901335 25613 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:01.904564 31220 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:01.908582 25657 consensus_peers.cc:597] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05b25fb15a3f49599d4e372d287c828a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:01.908658 31246 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:01.910522 31229 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:01.919935 31255 tablet_copy_client.cc:538] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:01.940683 25760 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:01.952772 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:01.947795 31246 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:12:01.964673 25612 raft_consensus.cc:1275] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:01.967564 31246 consensus_queue.cc:1048] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:01.979259 31279 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:02.055256 31196 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:02.066859 25759 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:02.069602 25768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:02.076408 25768 raft_consensus.cc:606] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:02.071509 25613 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:02.119786 25768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:02.120689 25768 raft_consensus.cc:606] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:02.132231 25616 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:12:02.138765 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 101452us
I20260709 12:12:02.163347 25616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:02.175985 31255 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
W20260709 12:12:02.191256 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 90328us
I20260709 12:12:02.191571 25616 raft_consensus.cc:606] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:02.216311 31222 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:12:02.243072 25694 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:02.273085 31267 raft_consensus.cc:993] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:02.273736 31267 raft_consensus.cc:1081] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:02.274180 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:02.274901 25686 raft_consensus.cc:606] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:02.275164 31222 raft_consensus.cc:993] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:02.275672 31222 raft_consensus.cc:1081] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:02.276791 31273 tablet_copy_client.cc:806] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:02.277443 31273 tablet_copy_client.cc:670] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:02.279958 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:02.280646 25759 raft_consensus.cc:606] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:02.282301 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:02.284389 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:02.285439 25515 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:02.300176 25613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:02.301002 25613 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.301429 25613 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:02.320056 25619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:02.320781 25619 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.321187 25619 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.317792 31214 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 12:12:02.312127 31229 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:12:02.340530 25613 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:02.347584 25619 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:02.356568 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:02.359460 31273 tablet_copy_client.cc:538] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:02.359658 25613 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:02.382437 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:02.382977 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:02.492445 26338 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:02.481509 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 162428us
I20260709 12:12:02.383381 25768 raft_consensus.cc:3055] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:02.498816 25768 raft_consensus.cc:740] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:02.499776 25768 consensus_queue.cc:260] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:02.501371 25768 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:02.423769 25619 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:02.502878 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 97894us
W20260709 12:12:02.505072 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 95020us
W20260709 12:12:02.462723 31229 log.cc:927] Time spent T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:02.527341 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:02.528010 25767 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:02.528316 25767 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:02.529045 25767 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:02.534073 31228 raft_consensus.cc:993] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:02.534682 31228 raft_consensus.cc:1081] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:02.542959 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:02.543830 25691 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.547278 31273 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:02.551515 25767 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:02.579254 25691 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:12:02.589923 25767 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:12:02.596987 26338 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:12:02.605644 25768 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
W20260709 12:12:02.610639 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44419.9us
I20260709 12:12:02.616847 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:12:02.617555 25768 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:02.617908 25768 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.632648 25768 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:02.634644 25768 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:02.665851 25612 raft_consensus.cc:1240] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:02.673317 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 85307.3us
I20260709 12:12:02.680969 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:02.681988 25612 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.712674 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:02.713446 25685 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:02.713753 25685 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:02.714808 25685 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:02.716485 25685 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:02.720427 25612 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:02.722141 25583 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:02.721052 31308 ts_tablet_manager.cc:933] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:02.743829 25685 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:02.755107 31311 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:02.796317 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54364us
W20260709 12:12:02.799309 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 67061.8us
I20260709 12:12:02.800191 25582 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:12:02.803467 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46456.5us
I20260709 12:12:02.791596 31279 raft_consensus.cc:993] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:02.813889 31311 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:02.846143 31311 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:02.840329 31231 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:02.860065 31279 raft_consensus.cc:1081] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:02.892899 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:02.894140 31318 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:02.885767 31231 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:02.928828 31231 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:02.906796 31318 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:02.931859 31318 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:02.956805 31308 tablet_copy_client.cc:323] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
W20260709 12:12:02.995437 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 161368us
W20260709 12:12:03.022200 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 163263us
W20260709 12:12:03.033608 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 170615us
W20260709 12:12:03.142505 31336 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:12:03.222318 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet 05b25fb15a3f49599d4e372d287c828a from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:12:03.223816 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet 05b25fb15a3f49599d4e372d287c828a from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-05b25fb15a3f49599d4e372d287c828a
W20260709 12:12:03.230576 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 172177us
I20260709 12:12:03.249266 31325 raft_consensus.cc:993] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:03.250770 31269 raft_consensus.cc:1081] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:03.295521 31229 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:03.297297 31229 tablet_bootstrap.cc:492] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:03.321674 25704 tablet_copy_source_session.cc:215] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:03.408442 31229 ts_tablet_manager.cc:1403] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.498s	user 0.071s	sys 0.043s
I20260709 12:12:03.411041 26335 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:03.417109 25685 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:03.416239 31235 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:03.456409 31308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b25fb15a3f49599d4e372d287c828a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:03.457069 25763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:03.457860 25763 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:03.458420 25763 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.489925 25764 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:03.497591 25767 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:03.512709 31235 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:03.512750 31311 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:03.515144 31194 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:03.526289 31340 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:03.527215 31340 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:03.529588 31340 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:03.532793 25763 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:03.533659 31220 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:03.547197 25763 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:03.548396 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:03.539593 31220 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:03.556684 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:03.585548 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:03.594976 31220 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:03.596354 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:03.598984 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:03.602929 31247 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:03.567070 25515 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.606813 25582 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:03.608585 31235 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:03.540719 31229 raft_consensus.cc:359] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:03.628907 31220 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.603708 31247 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:03.635169 31229 raft_consensus.cc:740] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:03.645740 31229 consensus_queue.cc:260] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:03.657080 31229 ts_tablet_manager.cc:1434] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.248s	user 0.007s	sys 0.003s
I20260709 12:12:03.663614 25693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:03.666987 25693 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:03.667462 25693 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.693158 31269 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:03.693912 31269 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:03.641533 25515 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 9 to 10, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.706573 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:03.708384 31269 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:03.715592 31247 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:03.725162 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:03.732702 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:03.741693 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:03.751531 25582 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:03.761332 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:03.762348 25691 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.767510 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:03.769522 25687 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:03.779316 25693 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:03.788345 25693 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:03.791181 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-6c38995c6d4645379acd1dcc03a8a65f received from {username='slave'} at 127.0.0.1:51490
I20260709 12:12:03.791996 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-6c38995c6d4645379acd1dcc03a8a65f on tablet 6c38995c6d4645379acd1dcc03a8a65f with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:03.795921 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:03.796527 31255 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:03.796723 26335 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.797219 31306 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:03.797622 31255 tablet_bootstrap.cc:492] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:03.806546 25759 raft_consensus.cc:1240] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:03.807781 26335 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:12:03.819545 31312 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.813503 25657 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:03.823019 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:03.827744 25610 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:03.828534 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:03.829303 25615 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:03.829725 25615 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:03.836057 25768 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.823084 25691 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:12:03.836781 25768 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:03.818879 31325 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:03.855839 31255 ts_tablet_manager.cc:1403] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.680s	user 0.050s	sys 0.059s
I20260709 12:12:03.894692 25768 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:03.896140 25768 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.869953 31325 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:03.857491 25615 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:03.923154 25615 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.902936 31331 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:03.974327 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 49124.9us
I20260709 12:12:03.981968 25615 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
W20260709 12:12:03.985229 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 53759.6us
I20260709 12:12:03.958025 31331 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:04.010774 31331 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:04.024215 25768 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:12:04.027443 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.028393 31255 raft_consensus.cc:359] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:04.029438 31255 raft_consensus.cc:740] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
W20260709 12:12:04.037647 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 93911.1us
W20260709 12:12:04.038568 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 43554.4us
W20260709 12:12:04.051491 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 74312us
I20260709 12:12:04.067060 31308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60620 (request call id 209) took 1522 ms. Trace:
I20260709 12:12:04.067616 31308 rpcz_store.cc:276] 0709 12:12:02.544796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.544980 (+   184us) service_pool.cc:224] Handling call
0709 12:12:02.756629 (+211649us) ts_tablet_manager.cc:934] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
0709 12:12:03.454461 (+697832us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:03.709419 (+254958us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:03.709593 (+   174us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:04.064160 (+354567us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:04.064700 (+   540us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:04.066797 (+  2097us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:04.066908 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":292,"tablet-copy.queue_time_us":133823,"thread_start_us":130724,"threads_started":2}
I20260709 12:12:04.077656 31325 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:04.077467 31188 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:04.080005 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:04.081946 31188 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.082530 31188 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:04.083454 31188 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:04.098536 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:04.030198 31255 consensus_queue.cc:260] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:04.086040 31308 tablet_copy_client.cc:806] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:04.105422 31308 tablet_copy_client.cc:670] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:04.107100 31255 ts_tablet_manager.cc:1434] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.214s	user 0.008s	sys 0.002s
I20260709 12:12:04.126406 31232 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:04.127213 31232 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:04.127781 31214 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:04.139624 26340 raft_consensus.cc:1217] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 12:12:04.147046 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:12:04.151579 31308 tablet_copy_client.cc:538] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:04.130079 31232 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:04.186604 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:04.193629 26335 raft_consensus.cc:1217] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:12:04.197918 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:04.205948 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:04.219430 31309 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.228587 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:04.239648 25693 raft_consensus.cc:1240] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.239677 31359 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:12:04.244182 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-6640372ef1e64554b6b1025b28173499 received from {username='slave'} at 127.0.0.1:41126
I20260709 12:12:04.244953 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-6640372ef1e64554b6b1025b28173499 on tablet 6640372ef1e64554b6b1025b28173499 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:04.309296 31308 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:04.369453 31273 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:04.378013 31273 tablet_bootstrap.cc:492] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:04.379498 31273 ts_tablet_manager.cc:1403] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.832s	user 0.081s	sys 0.028s
I20260709 12:12:04.390578 31273 raft_consensus.cc:359] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:04.391638 31273 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:04.392388 31273 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:04.395468 31273 ts_tablet_manager.cc:1434] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:12:04.396477 26335 raft_consensus.cc:1217] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 12:12:04.422948 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b1deffe0cca244839dc0d8c35e1c9292 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:12:04.423620 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b1deffe0cca244839dc0d8c35e1c9292 on tablet b1deffe0cca244839dc0d8c35e1c9292 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:04.483103 25516 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 12, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.559835 25513 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 264) took 1295 ms. Trace:
I20260709 12:12:04.560289 25513 rpcz_store.cc:276] 0709 12:12:03.264459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.267697 (+  3238us) service_pool.cc:224] Handling call
0709 12:12:03.575758 (+308061us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:12:04.559607 (+983849us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":26654592}
I20260709 12:12:04.632709 31321 raft_consensus.cc:1064] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:04.636790 25618 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:04.648488 31370 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:12:04.665004 25515 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 14, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.716243 25693 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:04.648021 31321 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:04.721514 31317 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:04.730463 26335 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.731539 31253 raft_consensus.cc:1064] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:04.735750 25767 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.748510 31246 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:04.750404 31359 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:04.771088 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 58215us
I20260709 12:12:04.745486 31253 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:04.801604 25517 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:12:04.855314 26340 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.860702 25690 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:12:04.867792 31382 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:12:04.875167 31251 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:04.891167 31251 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:04.896800 31308 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:04.897982 31308 tablet_bootstrap.cc:492] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:04.917300 25615 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.977079 31309 raft_consensus.cc:1064] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:04.979031 31370 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:04.975716 31308 ts_tablet_manager.cc:1403] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.667s	user 0.054s	sys 0.012s
I20260709 12:12:04.976344 25618 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:05.049037 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 45640.1us
I20260709 12:12:05.061288 25759 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:05.064209 26335 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:05.118974 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 69132.2us
I20260709 12:12:05.130599 31393 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:12:05.177393 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 71591.7us
I20260709 12:12:05.198571 31309 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:05.224262 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 80216.5us
I20260709 12:12:05.182715 31253 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:12:05.231195 31308 raft_consensus.cc:359] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:05.241425 31308 raft_consensus.cc:740] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:05.244050 31308 consensus_queue.cc:260] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:12:05.307664 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 79516.2us
I20260709 12:12:05.310824 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:05.311887 25615 raft_consensus.cc:606] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:05.312219 25615 raft_consensus.cc:614] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.315912 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:05.316530 25759 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:05.337478 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:05.338398 25759 raft_consensus.cc:606] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:05.382963 31308 ts_tablet_manager.cc:1434] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.379s	user 0.008s	sys 0.002s
I20260709 12:12:05.387363 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-05b25fb15a3f49599d4e372d287c828a received from {username='slave'} at 127.0.0.1:51490
I20260709 12:12:05.387876 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-05b25fb15a3f49599d4e372d287c828a on tablet 05b25fb15a3f49599d4e372d287c828a with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:05.388829 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:05.389777 25759 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:05.391548 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:05.393754 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.406102 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:05.406934 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 276659us
I20260709 12:12:05.409893 31232 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:05.413379 26338 raft_consensus.cc:1217] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:12:05.417068 31321 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:05.541975 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 182074us
I20260709 12:12:05.574651 26335 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:05.612428 25690 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:05.677098 31395 raft_consensus.cc:993] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:05.678946 31395 raft_consensus.cc:1081] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
W20260709 12:12:05.695326 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 103112us
W20260709 12:12:05.713606 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 87015.5us
I20260709 12:12:05.731874 25768 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:05.733389 26335 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:05.717075 25517 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.756547 25687 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:05.783850 31400 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:05.796025 25766 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:05.798628 31194 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:05.813810 26338 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:05.814329 31194 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
W20260709 12:12:05.801813 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 165637us
I20260709 12:12:05.841872 31414 raft_consensus.cc:993] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:05.842535 31414 raft_consensus.cc:1081] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:05.843477 31410 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:05.865602 25686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:05.866312 25686 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.866685 25686 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.873168 25690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:05.874082 25690 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:05.874634 25690 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.897774 25690 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:05.914780 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:05.914780 25690 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:05.915629 25615 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.926400 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:05.927485 25766 raft_consensus.cc:3055] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.927898 25766 raft_consensus.cc:740] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:05.930728 25686 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:05.946897 31404 raft_consensus.cc:1064] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:05.917557 25618 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:05.943466 25766 consensus_queue.cc:260] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:05.991022 25686 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:05.992594 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:05.993291 25612 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.999060 25615 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:12:06.000648 25658 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:06.002512 25612 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:12:05.957190 31404 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:06.013860 25766 raft_consensus.cc:3060] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.015290 31401 raft_consensus.cc:993] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:06.016747 31401 raft_consensus.cc:1081] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:06.018183 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:06.018903 25762 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:06.019053 25658 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:06.019240 25762 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:06.019922 31398 raft_consensus.cc:2804] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:06.020449 31398 raft_consensus.cc:697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:06.020350 25762 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:06.021616 25762 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.021384 31398 consensus_queue.cc:237] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:06.022570 31093 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:06.023140 31093 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:06.024087 31093 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:06.038571 25615 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.051071 25613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:06.051815 25613 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:06.052173 25613 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.054041 25766 raft_consensus.cc:2468] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:12:06.052798 31194 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.061839 25762 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:12:06.090734 25613 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:06.097795 25690 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:06.105790 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:06.106518 25686 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.106695 25613 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:06.111635 25687 raft_consensus.cc:1240] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.116950 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:06.117542 25762 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:06.117802 25762 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:06.134563 25686 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:12:06.144852 25619 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:06.153478 31393 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:06.153957 25764 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.161206 25762 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:06.162789 25762 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.112301 26335 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.164474 25686 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.215764 25762 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:12:06.217563 25582 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:06.252561 31410 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:06.257779 25759 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:06.267849 26338 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:06.254693 31410 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:06.271668 31410 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:06.272526 31415 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:06.276386 31246 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:06.401785 31246 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.392894 25513 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 10 to 11, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.411578 25759 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.409080 25513 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 12 to 13, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:06.424173 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 65992.7us
I20260709 12:12:06.471349 25517 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 15 to 16, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.473522 25762 consensus_queue.cc:237] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:06.483570 26335 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.504230 25619 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:06.517179 26338 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:06.525333 25613 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:06.525664 25612 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:12:06.528875 31232 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:06.530619 25766 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:12:06.532254 31402 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:06.533468 25690 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:06.536005 31400 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:06.537995 31402 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:06.542972 26338 raft_consensus.cc:1275] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:06.542953 31401 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:06.543308 25618 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.555684 31417 consensus_queue.cc:1048] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:12:06.568341 31395 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Committing config change with OpId 14.14: config changed from index 13 to 14, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.598407 31396 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.606091 26340 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 13 to 14, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.606104 25762 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:06.618686 31393 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:06.615662 25687 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.613577 25517 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.629626 25612 raft_consensus.cc:1275] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:06.651089 31400 consensus_queue.cc:1048] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:06.655992 25513 catalog_manager.cc:5697] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 15 to 16, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 16 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.660023 25513 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 14, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.713572 25517 catalog_manager.cc:5697] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 13 to 14, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.717391 25612 raft_consensus.cc:2955] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 13 to 14, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.685014 26335 raft_consensus.cc:2955] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.748309 25687 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:06.781708 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6640372ef1e64554b6b1025b28173499 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:06.787065 25764 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:06.788779 26338 raft_consensus.cc:1275] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:06.791148 31246 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:06.792336 31404 consensus_queue.cc:1048] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:06.794070 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1deffe0cca244839dc0d8c35e1c9292 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:06.818558 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:06.831875 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.841008 25517 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 13 to 14, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 16 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.872339 31404 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.882411 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 6640372ef1e64554b6b1025b28173499 with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:39676
I20260709 12:12:06.876927 25759 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.886742 26338 raft_consensus.cc:2955] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:06.921873 25762 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:06.899734 31441 tablet_replica.cc:333] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:06.967569 25690 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:06.981436 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet b1deffe0cca244839dc0d8c35e1c9292 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:54016
I20260709 12:12:07.038029 25688 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:07.060070 25517 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 12 to 13, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:07.045768 31390 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:12:07.111370 31441 raft_consensus.cc:2243] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.112110 31309 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:07.113132 31441 raft_consensus.cc:2272] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.126230 31442 tablet_replica.cc:333] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:07.128502 31442 raft_consensus.cc:2243] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.131143 31442 raft_consensus.cc:2272] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.151382 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05b25fb15a3f49599d4e372d287c828a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:07.145267 31441 ts_tablet_manager.cc:1916] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:12:07.209081 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 117578us
I20260709 12:12:07.234669 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet 05b25fb15a3f49599d4e372d287c828a with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:41122
I20260709 12:12:07.252041 25762 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.255400 26338 raft_consensus.cc:1275] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.267590 25690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:07.268296 25690 raft_consensus.cc:606] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:07.276343 31393 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:07.277962 31404 consensus_queue.cc:1048] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:07.278980 25690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60795798854e400987349043af926b8a"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:07.279592 25690 raft_consensus.cc:606] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:07.294327 31442 ts_tablet_manager.cc:1916] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:07.335623 31441 ts_tablet_manager.cc:1929] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.13
I20260709 12:12:07.341387 31441 log.cc:1199] T 6640372ef1e64554b6b1025b28173499 P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/6640372ef1e64554b6b1025b28173499
I20260709 12:12:07.343727 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 6640372ef1e64554b6b1025b28173499 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:07.356909 31331 raft_consensus.cc:993] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:07.358047 31093 raft_consensus.cc:1081] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:07.363444 25619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:07.364271 25619 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:07.370857 25619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:12:07.384274 31448 tablet_replica.cc:333] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:07.388310 25619 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:07.415839 25619 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.391183 31448 raft_consensus.cc:2243] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.419569 31448 raft_consensus.cc:2272] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.427619 31354 raft_consensus.cc:993] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:07.425002 31232 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:07.428830 31353 raft_consensus.cc:1081] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:07.430187 25766 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:07.443511 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:07.444497 25768 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:07.444975 25768 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:07.452539 26338 raft_consensus.cc:2955] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:07.425010 31448 ts_tablet_manager.cc:1916] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:07.464239 31331 raft_consensus.cc:993] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:07.464864 31331 raft_consensus.cc:1081] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:07.476279 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60795798854e400987349043af926b8a"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:12:07.476958 25767 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:07.477316 25767 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.492838 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c38995c6d4645379acd1dcc03a8a65f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:07.515642 25767 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:07.532183 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:07.532929 26335 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.539332 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:07.540035 25610 raft_consensus.cc:606] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:07.546849 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:07.549027 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:07.526556 25517 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 11 to 12, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:07.549964 25767 leader_election.cc:290] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:07.549970 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.559453 25768 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.577785 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60795798854e400987349043af926b8a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:07.602730 25687 raft_consensus.cc:3055] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:07.558656 26335 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:12:07.604786 25731 leader_election.cc:304] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:07.603183 25687 raft_consensus.cc:740] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:07.605746 31401 raft_consensus.cc:2804] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:07.606364 31401 raft_consensus.cc:697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:07.606726 25687 consensus_queue.cc:260] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:07.607836 31401 consensus_queue.cc:237] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:07.608340 25687 raft_consensus.cc:3060] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.617799 25768 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:07.628026 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c38995c6d4645379acd1dcc03a8a65f with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:41122
I20260709 12:12:07.645500 25619 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.651705 25619 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:07.652951 31448 ts_tablet_manager.cc:1929] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 12:12:07.653527 31448 log.cc:1199] T 05b25fb15a3f49599d4e372d287c828a P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/05b25fb15a3f49599d4e372d287c828a
I20260709 12:12:07.666309 31442 ts_tablet_manager.cc:1929] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 12:12:07.671036 31448 tablet_replica.cc:333] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:07.675438 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet 05b25fb15a3f49599d4e372d287c828a (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:07.675426 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:07.681188 25693 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:07.683075 31442 log.cc:1199] T b1deffe0cca244839dc0d8c35e1c9292 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/b1deffe0cca244839dc0d8c35e1c9292
I20260709 12:12:07.688906 25687 raft_consensus.cc:2468] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:12:07.692770 25693 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:07.695073 31448 raft_consensus.cc:2243] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:07.696208 31448 raft_consensus.cc:2272] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:07.701310 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:07.702028 25618 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:07.702366 25618 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:07.703552 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:07.703150 25618 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.706851 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:07.707471 25767 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.708104 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:07.708678 25693 raft_consensus.cc:3055] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:07.708953 25693 raft_consensus.cc:740] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:07.712823 31444 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:07.713425 31444 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:07.714319 31444 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.718650 25618 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:07.712845 25517 catalog_manager.cc:5697] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 17 to 18, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 18 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:07.729367 31448 ts_tablet_manager.cc:1916] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:07.732080 25618 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:07.737327 31309 raft_consensus.cc:993] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:07.737913 31309 raft_consensus.cc:1081] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:07.740252 25766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:07.740810 25766 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:07.741154 25766 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.754827 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet b1deffe0cca244839dc0d8c35e1c9292 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:07.755108 31448 ts_tablet_manager.cc:1929] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:12:07.755553 31448 log.cc:1199] T 6c38995c6d4645379acd1dcc03a8a65f P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/6c38995c6d4645379acd1dcc03a8a65f
I20260709 12:12:07.752033 25766 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.758800 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet 6c38995c6d4645379acd1dcc03a8a65f (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:07.762473 25766 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:07.762369 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:07.764451 25616 raft_consensus.cc:3055] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:07.764786 25616 raft_consensus.cc:740] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:07.765568 25616 consensus_queue.cc:260] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.768836 25616 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.775856 25767 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 21.
I20260709 12:12:07.780540 25582 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:07.783629 31408 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:07.784298 31408 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 21 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:07.785269 31408 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:07.811172 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 99911us
I20260709 12:12:07.725755 25693 consensus_queue.cc:260] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.811033 25616 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:12:07.824618 25732 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:07.825654 31251 raft_consensus.cc:2804] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:07.826673 31251 raft_consensus.cc:697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:07.823101 25693 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.836475 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:07.837251 25686 raft_consensus.cc:3060] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.846782 31251 consensus_queue.cc:237] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:07.860411 25686 raft_consensus.cc:2468] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:12:07.870378 25693 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 21.
I20260709 12:12:07.908730 25515 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 20 to 21, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 21 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:07.917769 25517 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 11 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:07.947902 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 50884.7us
I20260709 12:12:07.988871 25517 catalog_manager.cc:5697] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 17 to 18, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 18 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.212307 25694 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:08.230137 26335 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:08.232350 31251 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:08.269855 25618 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:12:08.301946 25694 raft_consensus.cc:1275] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:08.304014 25693 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:08.323483 31444 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:08.329457 31444 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:08.334074 25690 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:08.335932 31403 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:08.339354 31444 consensus_queue.cc:1048] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:08.357381 31321 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:08.364728 25766 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:08.370101 31403 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:08.427323 25610 raft_consensus.cc:1275] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:08.454842 31414 consensus_queue.cc:1048] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:08.633077 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 76854us
W20260709 12:12:08.640116 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 71471.9us
W20260709 12:12:08.650170 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 102818us
W20260709 12:12:08.691251 31469 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:12:08.780562 31467 log.cc:927] Time spent T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:12:08.796540 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 91314.3us
W20260709 12:12:08.795898 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 78831.1us
W20260709 12:12:08.808234 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 49527us
W20260709 12:12:08.817283 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 230620us
I20260709 12:12:08.844025 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:08.978408 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 161817us
I20260709 12:12:09.053809 25615 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:09.109283 25694 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:09.116532 25759 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:09.122869 25582 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5de0ecbf35224b6aa22571e4a88d71c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.133973 25687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:09.148114 25687 raft_consensus.cc:606] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:09.148501 31502 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.150089 31473 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.153249 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:09.154031 25759 raft_consensus.cc:606] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:09.163736 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:09.164621 25615 raft_consensus.cc:606] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:09.174417 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:09.175463 25615 raft_consensus.cc:606] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:09.178880 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:09.181738 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:09.189996 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.185003 31473 raft_consensus.cc:993] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:09.191131 31473 raft_consensus.cc:1081] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:09.194723 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:09.195452 25759 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.195842 25759 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.196810 31403 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:09.199091 25687 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:09.220971 25759 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.240684 25768 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:09.246232 31487 raft_consensus.cc:993] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:09.246865 31487 raft_consensus.cc:1081] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:09.250725 25694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:09.251325 25694 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.251688 25694 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.283129 25513 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:09.272601 25694 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.290035 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:09.290896 25615 raft_consensus.cc:3055] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:09.291245 25615 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:09.292307 25759 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:09.293484 25615 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.294081 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:09.296595 25687 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.299491 25615 raft_consensus.cc:3060] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.300304 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:09.300937 25616 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.301138 25694 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:09.303843 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:09.304782 25767 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:09.305095 25767 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:09.305858 25767 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.306943 25767 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.332463 25616 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:09.343760 25658 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:09.347493 25687 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:09.348953 25732 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:09.353502 25615 raft_consensus.cc:2468] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:09.354705 25767 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:09.356034 31497 raft_consensus.cc:2804] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:09.350090 31472 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:09.360471 31472 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:09.360494 31497 raft_consensus.cc:697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:09.370034 31472 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.366016 31497 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.402572 31490 raft_consensus.cc:993] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:09.403273 31490 raft_consensus.cc:1081] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:09.405001 25616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:12:09.407562 25616 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.408052 25616 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.434043 25616 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.433569 25767 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:09.443739 25616 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:09.444700 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:09.445389 25687 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:09.445693 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:09.446714 25759 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.445750 25687 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:09.457000 25687 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.459360 25759 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
I20260709 12:12:09.459604 25687 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.468142 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:09.472796 31309 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:09.474035 31309 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:09.475129 31309 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:09.487867 25616 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:09.489336 31473 raft_consensus.cc:993] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:09.489928 31473 raft_consensus.cc:1081] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:09.489653 31487 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:09.491252 25731 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2eaf15c7f3ab41eea32890f20f50b4fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.504480 25694 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:09.506798 25694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39702
I20260709 12:12:09.507786 25694 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:09.508482 25694 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.531096 25694 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:09.529359 31497 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:12:09.556066 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:09.557013 25615 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:09.557482 25615 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:09.558950 25615 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:09.560736 25615 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.565920 25694 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:09.567039 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:09.567720 26335 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.571357 25687 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
I20260709 12:12:09.585170 26335 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:12:09.588274 25657 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:09.588994 25615 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:12:09.593617 31393 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:09.614845 31393 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:09.616056 31393 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:09.673071 25615 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:09.667430 31479 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:12:09.756773 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 92012.5us
I20260709 12:12:09.773712 31517 ts_tablet_manager.cc:933] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:12:09.855331 25619 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:09.863245 31232 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.906044 25515 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 17 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.916560 25694 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:09.927901 25517 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 18 to 19, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 19 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.929845 25517 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:09.908192 25515 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 17 to 18, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.941151 31520 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:09.945526 25619 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:12:09.951995 25694 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:09.955240 31502 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.968103 25762 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:09.971783 31331 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:09.987409 25694 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:10.015087 25615 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:10.017169 31232 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:10.051394 31517 tablet_copy_client.cc:323] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:12:10.073104 25610 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:10.075001 31472 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:10.079690 31536 ts_tablet_manager.cc:933] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:10.080685 25657 consensus_peers.cc:597] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5d5870a1cad42d2813f1ca36a619afe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.079905 25766 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:10.082942 31232 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:10.082959 31520 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:10.096001 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet 5de0ecbf35224b6aa22571e4a88d71c0 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:12:10.096720 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet 5de0ecbf35224b6aa22571e4a88d71c0 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-5de0ecbf35224b6aa22571e4a88d71c0
I20260709 12:12:10.098057 25767 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:10.114205 25629 tablet_copy_source_session.cc:215] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:10.134459 26335 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:10.152331 25515 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 11 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:12:10.155432 25690 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:10.161062 31476 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:10.173293 25610 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:10.211704 31524 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:10.228101 31331 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 12:12:10.235031 31536 tablet_copy_client.cc:323] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:12:10.274160 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.403414 25690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:10.404317 25690 raft_consensus.cc:606] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:10.411520 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:10.412220 25610 raft_consensus.cc:606] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
W20260709 12:12:10.415279 31537 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:12:10.417090 31530 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:10.418589 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5de0ecbf35224b6aa22571e4a88d71c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:10.418861 25767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:10.419646 25767 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:10.423148 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:10.425304 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.426107 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:10.439153 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 203363us
W20260709 12:12:10.443542 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 200166us
I20260709 12:12:10.506139 25759 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:10.531006 31557 ts_tablet_manager.cc:933] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:10.524892 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 2eaf15c7f3ab41eea32890f20f50b4fd from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:12:10.543848 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 2eaf15c7f3ab41eea32890f20f50b4fd from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-2eaf15c7f3ab41eea32890f20f50b4fd
W20260709 12:12:10.583072 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 59879.9us
I20260709 12:12:10.590691 31525 raft_consensus.cc:993] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:10.591310 31525 raft_consensus.cc:1081] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:10.626755 25759 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:10.636559 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:10.637286 25767 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:10.637676 25767 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.677842 25767 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:10.685258 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:10.686002 26335 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.685045 25767 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:10.689630 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:10.690340 25618 raft_consensus.cc:3055] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.690680 25618 raft_consensus.cc:740] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:10.691871 31516 raft_consensus.cc:993] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:10.691517 25618 consensus_queue.cc:260] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:10.692471 31516 raft_consensus.cc:1081] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:10.692867 25618 raft_consensus.cc:3060] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.694404 25777 tablet_copy_source_session.cc:215] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:10.696513 31517 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60616 (request call id 389) took 1070 ms. Trace:
I20260709 12:12:10.696985 31517 rpcz_store.cc:276] 0709 12:12:09.625765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.625905 (+   140us) service_pool.cc:224] Handling call
0709 12:12:09.794010 (+168105us) ts_tablet_manager.cc:934] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
0709 12:12:10.219222 (+425212us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:10.507543 (+288321us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:10.547845 (+ 40302us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:10.684120 (+136275us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:10.695992 (+ 11872us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:10.696365 (+   373us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:10.696440 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":450,"tablet-copy.queue_time_us":108241,"thread_start_us":300448,"threads_started":2}
I20260709 12:12:10.686080 31557 tablet_copy_client.cc:323] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
I20260709 12:12:10.707881 25615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:10.713315 25615 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:10.713750 25615 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.716694 25517 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 7, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.719563 26335 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:12:10.725296 25731 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:10.727954 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet b5d5870a1cad42d2813f1ca36a619afe from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:12:10.728574 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet b5d5870a1cad42d2813f1ca36a619afe from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-b5d5870a1cad42d2813f1ca36a619afe
I20260709 12:12:10.731335 31552 raft_consensus.cc:993] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:10.731866 31552 raft_consensus.cc:1081] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:10.733750 31536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaf15c7f3ab41eea32890f20f50b4fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:10.742419 25619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:12:10.743126 31517 tablet_copy_client.cc:806] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:10.743821 31517 tablet_copy_client.cc:670] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:10.743132 25619 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:10.744764 25619 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.755710 31515 raft_consensus.cc:2804] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:10.756457 31515 raft_consensus.cc:697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:10.776649 25618 raft_consensus.cc:2468] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:12:10.768234 25619 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:10.777944 25615 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:10.782876 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:10.783600 25687 raft_consensus.cc:3055] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:10.783902 25687 raft_consensus.cc:740] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:10.784727 25687 consensus_queue.cc:260] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:10.785867 25687 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.786006 31517 tablet_copy_client.cc:538] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:10.791054 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:10.791564 25619 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:10.791752 25690 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.793416 31515 consensus_queue.cc:237] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:10.802629 25687 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
I20260709 12:12:10.806504 25583 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:10.807643 25615 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:10.807904 31541 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:10.814353 31541 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:10.815315 31541 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:10.816705 31517 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:10.804625 25690 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:12:10.824195 25583 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:10.831601 31541 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:10.833968 31541 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:10.834944 31541 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:10.837040 25731 consensus_peers.cc:597] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2842bb8137e14414992e2306de44989b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.836949 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:10.839028 25767 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.840713 25690 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:10.844215 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:10.844853 25759 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:10.845176 25759 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:10.842976 31521 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:10.846328 25759 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:10.856091 25619 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:10.860833 25759 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.872598 31497 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:10.874693 25704 tablet_copy_source_session.cc:215] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:10.887806 31557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d5870a1cad42d2813f1ca36a619afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:10.889950 25767 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 19.
I20260709 12:12:10.899760 25759 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 13.
I20260709 12:12:10.967568 31521 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:10.969257 31557 tablet_copy_client.cc:806] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:10.970384 31557 tablet_copy_client.cc:670] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:10.981000 25686 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:10.992102 31536 tablet_copy_client.cc:806] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:10.992833 31536 tablet_copy_client.cc:670] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:11.001583 25619 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:11.013309 31557 tablet_copy_client.cc:538] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:11.037474 31536 tablet_copy_client.cc:538] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:11.050626 25513 catalog_manager.cc:5697] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 16 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.088034 25515 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index -1 to 14, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 20 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:11.066218 25517 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.113195 25517 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 18 to 19, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 19 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.107398 31536 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:11.123015 31557 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
W20260709 12:12:11.464398 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 195840us
I20260709 12:12:11.499691 31557 tablet_bootstrap.cc:700] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Time spent opening tablet: real 0.135s	user 0.004s	sys 0.000s
I20260709 12:12:11.530040 25687 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:11.553743 31544 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:11.569325 25687 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:11.572556 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:11.599174 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 131870us
W20260709 12:12:11.597743 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 125081us
I20260709 12:12:11.637631 31309 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:11.718386 25759 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:11.719800 25767 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:11.723927 25619 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:12:11.752202 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 144092us
I20260709 12:12:11.800675 26334 raft_consensus.cc:1275] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:11.860113 31588 ts_tablet_manager.cc:933] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:11.872663 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 132974us
W20260709 12:12:11.919209 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 129128us
W20260709 12:12:11.921991 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 48049.7us
I20260709 12:12:11.941223 31588 tablet_copy_client.cc:323] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:12:11.984620 31541 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:12:12.035027 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 111195us
I20260709 12:12:12.045825 31557 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:12.040269 31575 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:12:11.981498 31577 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:12:12.091677 31557 tablet_bootstrap.cc:492] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:12.064900 31580 consensus_queue.cc:1048] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:12:12.149923 31557 ts_tablet_manager.cc:1403] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.027s	user 0.079s	sys 0.063s
W20260709 12:12:12.152037 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 49348.2us
I20260709 12:12:12.171460 31557 raft_consensus.cc:359] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:12.172657 31557 raft_consensus.cc:740] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:12.173413 31557 consensus_queue.cc:260] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:12.174327 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 2842bb8137e14414992e2306de44989b from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:12:12.174993 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 2842bb8137e14414992e2306de44989b from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-2842bb8137e14414992e2306de44989b
I20260709 12:12:12.189339 25777 tablet_copy_source_session.cc:215] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:12.193374 31517 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:12:12.230083 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 70097.9us
I20260709 12:12:12.250943 31517 tablet_bootstrap.cc:492] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:12.251959 31517 ts_tablet_manager.cc:1403] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.436s	user 0.058s	sys 0.025s
I20260709 12:12:12.280838 31588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2842bb8137e14414992e2306de44989b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:12.292192 31536 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:12.293598 31536 tablet_bootstrap.cc:492] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:12.297806 31557 ts_tablet_manager.cc:1434] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.147s	user 0.007s	sys 0.001s
I20260709 12:12:12.293443 31517 raft_consensus.cc:359] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:12.306519 31517 raft_consensus.cc:740] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:12.307402 31517 consensus_queue.cc:260] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:12:12.318071 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 108278us
I20260709 12:12:12.310187 31517 ts_tablet_manager.cc:1434] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.002s
I20260709 12:12:12.325999 31536 ts_tablet_manager.cc:1403] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.240s	user 0.041s	sys 0.034s
I20260709 12:12:12.332772 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b5d5870a1cad42d2813f1ca36a619afe received from {username='slave'} at 127.0.0.1:51490
I20260709 12:12:12.333302 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-b5d5870a1cad42d2813f1ca36a619afe on tablet b5d5870a1cad42d2813f1ca36a619afe with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:12.347709 26335 raft_consensus.cc:1217] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:12:12.353869 26334 raft_consensus.cc:1217] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:12:12.400269 31536 raft_consensus.cc:359] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:12.401343 31536 raft_consensus.cc:740] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:12.402078 31536 consensus_queue.cc:260] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:12.418658 26334 raft_consensus.cc:1217] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:12:12.406733 31536 ts_tablet_manager.cc:1434] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.003s
I20260709 12:12:12.402186 31588 tablet_copy_client.cc:806] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:12.449100 31588 tablet_copy_client.cc:670] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:12.445425 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-5de0ecbf35224b6aa22571e4a88d71c0 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:12:12.472819 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-5de0ecbf35224b6aa22571e4a88d71c0 on tablet 5de0ecbf35224b6aa22571e4a88d71c0 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:12.486088 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:12.486821 25615 raft_consensus.cc:606] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:12.505777 31588 tablet_copy_client.cc:538] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:12.512019 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:12.512830 25764 raft_consensus.cc:606] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:12.519485 31615 log.cc:927] Time spent T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:12.527524 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-2eaf15c7f3ab41eea32890f20f50b4fd received from {username='slave'} at 127.0.0.1:41126
I20260709 12:12:12.528137 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-2eaf15c7f3ab41eea32890f20f50b4fd on tablet 2eaf15c7f3ab41eea32890f20f50b4fd with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:12.527987 25612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:12.528685 25612 raft_consensus.cc:606] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:12.531605 25688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:12.532274 25688 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:12.535434 25764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:12.536100 25764 raft_consensus.cc:606] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:12.538389 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:12.540550 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:12.550367 31605 raft_consensus.cc:993] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:12.551098 31551 raft_consensus.cc:1081] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:12.553570 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:12.554284 25767 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.554666 25767 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.558867 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:12.579861 31588 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:12.597519 31579 raft_consensus.cc:993] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:12.598284 31579 raft_consensus.cc:1081] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:12.601854 25686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:12.602494 25686 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.602847 25686 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.615733 25686 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.616890 25767 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.640028 25767 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:12.642138 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:12.652031 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:12.652804 25612 raft_consensus.cc:3055] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:12.653112 25612 raft_consensus.cc:740] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:12.645211 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:12.653914 25615 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.658787 25688 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.658998 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:12.645653 25686 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:12.659725 25762 raft_consensus.cc:3055] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:12.660593 25762 raft_consensus.cc:740] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:12.653914 25612 consensus_queue.cc:260] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.669649 25612 raft_consensus.cc:3060] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.682420 25762 consensus_queue.cc:260] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.685652 25762 raft_consensus.cc:3060] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.703626 31543 raft_consensus.cc:1064] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:12.733256 31515 raft_consensus.cc:1064] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:12.748747 31551 raft_consensus.cc:993] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:12.748171 31543 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:12.749387 31551 raft_consensus.cc:1081] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:12.754478 25767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:12.755241 25767 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.755661 25767 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.759423 31515 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:12.789381 25612 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:12.799273 31579 raft_consensus.cc:993] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:12.815196 25688 raft_consensus.cc:2468] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:12.799408 25762 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:12:12.812289 25767 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.826294 31353 raft_consensus.cc:1064] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:12.833889 25732 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:12.833217 25657 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:12.845990 25615 raft_consensus.cc:2468] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 16.
I20260709 12:12:12.851159 31232 raft_consensus.cc:2804] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.851853 25767 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:12.853021 31592 raft_consensus.cc:1081] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:12.861130 31592 raft_consensus.cc:2804] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:12.861651 31592 raft_consensus.cc:697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:12.862622 31592 consensus_queue.cc:237] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.873221 25610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:12.874647 25610 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.875063 25610 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.868928 31353 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:12.912000 25612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:12.912878 25612 raft_consensus.cc:3055] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:12.913293 25612 raft_consensus.cc:740] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:12.938010 25515 catalog_manager.cc:5697] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.940291 25612 consensus_queue.cc:260] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.942423 25612 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.947613 31232 raft_consensus.cc:697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:12.962414 25610 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:12.962867 31232 consensus_queue.cc:237] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:12.975999 25612 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:12.998977 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:12.999713 25767 raft_consensus.cc:3055] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:13.000065 25767 raft_consensus.cc:740] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:13.000919 25767 consensus_queue.cc:260] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:13.002213 25767 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.001564 25610 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:13.020340 25732 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
W20260709 12:12:13.067179 31619 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:12:13.045938 31627 raft_consensus.cc:2804] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:13.094300 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 135146us
I20260709 12:12:13.134172 25613 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:13.143237 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:13.144109 25688 raft_consensus.cc:3060] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.147660 25767 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:12:13.150270 26335 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:13.155157 26334 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:12:13.152040 31632 raft_consensus.cc:993] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:13.163547 25688 raft_consensus.cc:2468] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:13.145712 31627 raft_consensus.cc:697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:13.223134 25582 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:13.183589 31632 raft_consensus.cc:1081] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
W20260709 12:12:13.294677 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 128950us
I20260709 12:12:13.313473 31627 consensus_queue.cc:237] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:13.319504 31630 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:12:13.346911 31551 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:13.389127 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 77698.1us
I20260709 12:12:13.388134 31551 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:13.411671 31551 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:13.420825 31635 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:13.422963 25686 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:13.432928 25768 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:12:13.495965 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 272677us
W20260709 12:12:13.502830 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 325181us
I20260709 12:12:13.503247 25610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:12:13.504693 25610 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:13.505741 25610 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:13.523067 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 99186.4us
W20260709 12:12:13.538717 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 106429us
I20260709 12:12:13.551667 25762 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:13.561148 31497 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:13.567840 25613 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:12:13.570730 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 377163us
I20260709 12:12:13.580651 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:13.581930 26335 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.582156 25762 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.609035 26334 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.621634 31653 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:13.624140 31232 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:13.634689 31624 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:13.668439 31541 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:13.708051 31497 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:13.714206 25513 catalog_manager.cc:5697] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 15 to 16, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 16 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.714519 25610 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:13.721323 25515 catalog_manager.cc:5697] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.718585 25613 raft_consensus.cc:1275] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:13.718464 26335 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:12:13.727936 25517 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 15, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.740026 31624 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.744105 25688 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:13.744380 25619 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:13.754457 31541 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:13.756203 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.784070 25610 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:13.793298 31472 consensus_queue.cc:1048] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.794667 31657 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:13.876370 31631 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:12:13.877878 31631 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:13.895522 31588 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:13.897056 31588 tablet_bootstrap.cc:492] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:13.898277 31588 ts_tablet_manager.cc:1403] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.319s	user 0.050s	sys 0.022s
I20260709 12:12:13.911839 25611 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:13.899422 31631 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:13.929490 31624 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:12:13.950608 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 61894.5us
I20260709 12:12:14.010416 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:14.011307 25763 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.033084 31631 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:14.029589 31624 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:14.038697 31631 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.040004 25690 raft_consensus.cc:1275] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:14.041033 31624 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:14.046159 31665 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:12:14.048449 31629 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:14.049286 31629 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:14.051851 31629 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:14.053062 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 67376.3us
I20260709 12:12:14.065269 25763 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
I20260709 12:12:14.094811 31588 raft_consensus.cc:359] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:14.096041 31588 raft_consensus.cc:740] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:14.096916 31588 consensus_queue.cc:260] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:14.088032 25610 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:14.094849 25762 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:14.116165 31639 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:14.145092 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 111873us
W20260709 12:12:14.164356 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 61671.9us
I20260709 12:12:14.169654 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:14.171152 26334 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:14.171310 31657 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:14.172601 31677 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:14.175076 31579 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:14.179327 31625 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:14.215688 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 59706.8us
I20260709 12:12:14.217990 31657 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:14.222446 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 101064us
I20260709 12:12:14.226604 31588 ts_tablet_manager.cc:1434] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.328s	user 0.010s	sys 0.001s
W20260709 12:12:14.230476 31671 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:12:14.239409 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:12:14.262499 25763 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:14.252846 25611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:12:14.276753 31633 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:14.302502 26340 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:14.317173 31677 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:14.318540 31677 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:14.341727 25764 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:14.342089 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-2842bb8137e14414992e2306de44989b received from {username='slave'} at 127.0.0.1:41126
I20260709 12:12:14.342767 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-2842bb8137e14414992e2306de44989b on tablet 2842bb8137e14414992e2306de44989b with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:14.398007 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:14.397894 25619 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:14.402640 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:14.405659 25517 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:14.455617 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 47512.7us
I20260709 12:12:14.471812 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:14.474684 31684 consensus_queue.cc:1048] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 12:12:14.581810 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 98261.9us
W20260709 12:12:14.582862 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57289.8us
W20260709 12:12:14.577651 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 74176.9us
W20260709 12:12:14.611173 31685 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:12:14.628353 31691 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.126s	user 0.004s	sys 0.000s
I20260709 12:12:14.639120 25768 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:14.648830 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 64487us
W20260709 12:12:14.652598 31672 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:14.653446 25688 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 15.
W20260709 12:12:14.657774 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 72917.3us
I20260709 12:12:14.575562 25515 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.673157 26340 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:14.699405 25687 raft_consensus.cc:1275] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:14.699968 31636 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:14.721873 31687 log.cc:927] Time spent T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:12:14.758244 25615 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:14.775504 26338 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:14.795287 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 102158us
W20260709 12:12:14.814527 25657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.830120 25763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:14.848384 25763 raft_consensus.cc:606] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
W20260709 12:12:14.895411 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 69350.7us
I20260709 12:12:14.902079 25657 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:14.918999 26338 raft_consensus.cc:1217] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260709 12:12:14.920938 25657 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:14.934427 31659 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:14.922864 31675 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:14.948825 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 118230us
I20260709 12:12:14.966079 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:14.968034 25685 raft_consensus.cc:606] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:15.029503 25768 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:15.035184 25694 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:15.036624 25689 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:15.051684 31627 raft_consensus.cc:993] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:15.052567 31497 raft_consensus.cc:1081] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:15.094786 31678 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:15.103955 31677 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:12:15.087200 31627 consensus_queue.cc:1048] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:12:15.122454 25617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:15.123494 25617 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:15.145594 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:12:15.160621 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 91509.5us
I20260709 12:12:15.172935 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:15.201333 31472 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.227962 31472 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:15.230477 25615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:15.234277 25615 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:15.234706 25615 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:15.265527 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:12:15.364166 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 100327us
I20260709 12:12:15.366627 25689 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:15.272264 31709 log.cc:927] Time spent T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:12:15.255193 31472 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:15.418855 25615 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:15.472877 25613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:12:15.492489 25615 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:15.530229 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 163501us
W20260709 12:12:15.591869 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 143584us
W20260709 12:12:15.592023 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 60827.1us
W20260709 12:12:15.591948 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 70371.8us
I20260709 12:12:15.610518 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:15.611204 25688 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:15.612257 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 83521.9us
I20260709 12:12:15.649466 25658 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
W20260709 12:12:15.665297 31714 log.cc:927] Time spent T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.396s	user 0.000s	sys 0.002s
I20260709 12:12:15.665827 31624 raft_consensus.cc:993] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:15.674544 31632 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.688007 31713 raft_consensus.cc:1081] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:15.707482 25688 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:12:15.749265 25618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:12:15.755232 25618 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:15.755733 25618 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:15.759624 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:15.760331 25766 raft_consensus.cc:3055] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:15.760597 25766 raft_consensus.cc:740] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:15.761636 25766 consensus_queue.cc:260] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:15.767385 25766 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:15.786134 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.802033 25618 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:15.804065 31686 raft_consensus.cc:1064] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:15.807090 31701 raft_consensus.cc:993] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:15.807724 31701 raft_consensus.cc:1081] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:15.820919 25617 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.831200 25516 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 14 to 15, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 15 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.832728 31635 consensus_queue.cc:1059] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:15.834460 25766 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 10.
I20260709 12:12:15.835024 31635 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:15.835367 31635 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:15.722389 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:15.836265 31635 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:15.828600 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 113054us
W20260709 12:12:15.840090 25731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.845016 25515 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51990 (request call id 296) took 1410 ms. Trace:
I20260709 12:12:15.862432 25618 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:15.867700 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 255574us
I20260709 12:12:15.845511 25515 rpcz_store.cc:276] 0709 12:12:14.418742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.418886 (+   144us) service_pool.cc:224] Handling call
0709 12:12:15.828867 (+1409981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:14.786667 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:14.787242 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:14.787280 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:12:14.787307 (+    27us) tablet.cc:662] Decoding operations
0709 12:12:14.787645 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:14.787692 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:14.787717 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:14.787901 (+   184us) tablet.cc:701] Row locks acquired
0709 12:12:14.787923 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:14.788107 (+   184us) write_op.cc:270] Start()
0709 12:12:14.788254 (+   147us) write_op.cc:276] Timestamp: P: 1783599134788048 usec, L: 0
0709 12:12:14.788281 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:12:14.788968 (+   687us) log.cc:844] Serialized 603 byte log entry
0709 12:12:14.986137 (+197169us) op_driver.cc:464] REPLICATION: finished
0709 12:12:15.010052 (+ 23915us) write_op.cc:301] APPLY: starting
0709 12:12:15.010124 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:15.022243 (+ 12119us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:15.022400 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:15.136316 (+113916us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:15.156935 (+ 20619us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:12:15.175285 (+ 18350us) write_op.cc:312] APPLY: finished
0709 12:12:15.207711 (+ 32426us) log.cc:844] Serialized 25 byte log entry
0709 12:12:15.216731 (+  9020us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:15.231174 (+ 14443us) write_op.cc:454] Released schema lock
0709 12:12:15.242129 (+ 10955us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:15.275811 (+ 33682us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:15.275864 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":173507,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":23694,"apply.run_cpu_time_us":6103,"apply.run_wall_time_us":256664,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":87556,"prepare.run_cpu_time_us":2571,"prepare.run_wall_time_us":2570,"replication_time_us":197666,"thread_start_us":104301,"threads_started":1}]]}
I20260709 12:12:15.896595 25618 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:15.915654 25583 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:15.927595 31686 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:15.928807 31650 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:12:15.929419 31650 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:15.930406 31650 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:15.933890 25764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:15.934523 25764 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:15.934916 25764 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.953580 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:15.957139 31723 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:15.957847 31723 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:15.976951 31723 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:15.981791 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:15.983069 25767 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:15.998310 25767 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
W20260709 12:12:16.005237 31691 log.cc:927] Time spent T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.484s	user 0.007s	sys 0.003s
I20260709 12:12:16.010497 25764 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:16.011161 25513 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:16.012887 25764 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:16.024587 25688 raft_consensus.cc:1240] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:16.025794 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:12:16.028649 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 44669.8us
I20260709 12:12:16.031659 25766 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Rejecting Update request from peer c781e437472a42e2a6162b67b1c7bbbd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:16.034413 31635 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.040150 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:16.046487 25688 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.080087 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:16.083768 25688 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:12:16.105088 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:16.105810 25618 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:16.106124 25618 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:16.114369 25618 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:16.110064 25614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "56b5d00aa592407c9d5e67a03a961508" is_pre_election: true
I20260709 12:12:16.111413 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:16.102442 31657 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:16.122485 25583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.122443 26336 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:16.128772 31686 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:16.129480 31686 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:16.130440 31686 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:16.131762 25688 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:16.134043 25688 raft_consensus.cc:1240] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.136088 25618 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.140740 31720 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:16.143193 31497 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:16.149950 25618 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 17.
I20260709 12:12:16.150027 31657 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:16.174875 25614 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:16.176836 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:16.184500 31688 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:16.186846 31657 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:16.195338 31705 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:16.266244 25687 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 14.
I20260709 12:12:16.407754 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51974 (request call id 293) took 1426 ms. Trace:
I20260709 12:12:16.412801 25516 rpcz_store.cc:276] 0709 12:12:14.981604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.985789 (+  4185us) service_pool.cc:224] Handling call
0709 12:12:15.168340 (+182551us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540001c2d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:12:15.446387 (+278047us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b5400002490. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc37640 00007fbdb8b0e846 00007fbdb8c1890e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:12:16.019402 (+573015us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b540001c128. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7cab9b4 00007fbdb678f3dc 00007fbdb6750e0b 00007fbdb6750be4 00007fbdb8c50fa1 00007fbdb8c517ff 00007fbdb8b10a1b 00007fbdb8c1890e 00007fbdb70d92a4 00007fbdb70d9232
0709 12:12:16.407676 (+388274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:16.126968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:16.127602 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:16.127645 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:12:16.127664 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:16.128020 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:16.128096 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:16.128124 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:16.128511 (+   387us) tablet.cc:701] Row locks acquired
0709 12:12:16.128528 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:16.128803 (+   275us) write_op.cc:270] Start()
0709 12:12:16.128976 (+   173us) write_op.cc:276] Timestamp: P: 1783599136128642 usec, L: 0
0709 12:12:16.129002 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:12:16.129815 (+   813us) log.cc:844] Serialized 544 byte log entry
0709 12:12:16.196391 (+ 66576us) op_driver.cc:464] REPLICATION: finished
0709 12:12:16.273792 (+ 77401us) write_op.cc:301] APPLY: starting
0709 12:12:16.276917 (+  3125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:16.368154 (+ 91237us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:16.368299 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:16.369266 (+   967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:16.369678 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:12:16.369755 (+    77us) write_op.cc:312] APPLY: finished
0709 12:12:16.370033 (+   278us) log.cc:844] Serialized 25 byte log entry
0709 12:12:16.370462 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.370566 (+   104us) write_op.cc:454] Released schema lock
0709 12:12:16.370634 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:16.371256 (+   622us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.371299 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":382280,"reported_tablets":1,"spinlock_wait_cycles":353975168,"child_traces":[["op",{"apply.queue_time_us":56577,"apply.run_cpu_time_us":5231,"apply.run_wall_time_us":103559,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":106775,"prepare.run_cpu_time_us":3304,"prepare.run_wall_time_us":5335,"replication_time_us":67195,"spinlock_wait_cycles":8448,"thread_start_us":124964,"threads_started":2}]]}
I20260709 12:12:16.450551 31705 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:16.473670 31750 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:16.511381 25685 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:16.545194 26336 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:16.559288 25687 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:16.561465 31737 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:16.566432 25618 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:16.577327 25763 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:12:16.584017 31650 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:16.594205 25513 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48328 (request call id 136) took 1076 ms. Trace:
I20260709 12:12:16.594738 25513 rpcz_store.cc:276] 0709 12:12:15.518311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.529692 (+ 11381us) service_pool.cc:224] Handling call
0709 12:12:16.594130 (+1064438us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:16.137826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:16.138439 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:16.138477 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:12:16.138495 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:16.141615 (+  3120us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:16.141669 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:16.141692 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:16.141867 (+   175us) tablet.cc:701] Row locks acquired
0709 12:12:16.141883 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:12:16.142036 (+   153us) write_op.cc:270] Start()
0709 12:12:16.142140 (+   104us) write_op.cc:276] Timestamp: P: 1783599136141978 usec, L: 0
0709 12:12:16.142161 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:12:16.142798 (+   637us) log.cc:844] Serialized 603 byte log entry
0709 12:12:16.274087 (+131289us) op_driver.cc:464] REPLICATION: finished
0709 12:12:16.388076 (+113989us) write_op.cc:301] APPLY: starting
0709 12:12:16.390105 (+  2029us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:16.476803 (+ 86698us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:16.476939 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:16.507978 (+ 31039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:16.527537 (+ 19559us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:12:16.529177 (+  1640us) write_op.cc:312] APPLY: finished
0709 12:12:16.535144 (+  5967us) log.cc:844] Serialized 25 byte log entry
0709 12:12:16.537146 (+  2002us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.538521 (+  1375us) write_op.cc:454] Released schema lock
0709 12:12:16.539890 (+  1369us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:16.542953 (+  3063us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.542993 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":232998,"reported_tablets":4,"spinlock_wait_cycles":25984,"child_traces":[["op",{"apply.queue_time_us":71384,"apply.run_cpu_time_us":5437,"apply.run_wall_time_us":156968,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":72153,"prepare.run_cpu_time_us":2549,"prepare.run_wall_time_us":10351,"replication_time_us":123584,"thread_start_us":26629,"threads_started":1}]]}
I20260709 12:12:16.630420 25764 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:16.640635 31656 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:16.644186 25516 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 9 to 10, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 10 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.646978 25516 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.703492 25685 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:16.703416 25513 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 14 to 15, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:16.711074 31722 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:12:16.748948 25687 consensus_queue.cc:237] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:16.764128 25614 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:16.787528 31688 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:16.788235 25694 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:16.791067 31677 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:16.793433 25763 consensus_queue.cc:237] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:16.933125 31742 log.cc:927] Time spent T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
W20260709 12:12:16.946879 31753 log.cc:927] Time spent T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 12:12:16.966127 26336 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:12:17.007444 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 179030us
I20260709 12:12:17.001684 31497 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:17.045651 25610 raft_consensus.cc:1275] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:17.052476 25513 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } }
I20260709 12:12:17.018039 25615 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:17.105381 31627 consensus_queue.cc:1048] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:17.163038 25763 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:17.166837 25764 consensus_queue.cc:237] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:17.166311 31627 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.169461 31633 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:17.171288 25687 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:17.184902 26337 raft_consensus.cc:1275] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:17.188490 26337 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:17.191295 31497 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:17.195798 26337 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.203461 31639 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:17.224869 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 92843.6us
I20260709 12:12:17.239879 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.248411 31635 consensus_queue.cc:1048] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:12:17.260109 25693 raft_consensus.cc:1275] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:17.259821 26336 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.258001 31497 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:17.283973 31774 log.cc:927] Time spent T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:17.287492 26338 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:17.284008 25515 catalog_manager.cc:5697] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 13 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.352038 31688 consensus_queue.cc:1048] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:12:17.359269 25685 raft_consensus.cc:2955] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.369638 31650 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:17.400381 31741 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.409714 25768 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.434649 31737 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.361146 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2eaf15c7f3ab41eea32890f20f50b4fd with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:17.447595 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 2eaf15c7f3ab41eea32890f20f50b4fd with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:39676
I20260709 12:12:17.458037 25516 catalog_manager.cc:5697] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 15 to 16, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 20 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:17.446481 25501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 121692us
W20260709 12:12:17.466001 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 82434.2us
I20260709 12:12:17.468699 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2842bb8137e14414992e2306de44989b with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:17.485671 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5de0ecbf35224b6aa22571e4a88d71c0 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:17.490895 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet 2842bb8137e14414992e2306de44989b with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:41122
I20260709 12:12:17.493716 25694 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.493623 26336 raft_consensus.cc:2955] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.505978 31779 tablet_replica.cc:333] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:17.523172 25515 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 14 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.520783 31779 raft_consensus.cc:2243] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.546548 31779 raft_consensus.cc:2272] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.550246 31779 ts_tablet_manager.cc:1916] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:17.557588 25610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:17.558455 25610 raft_consensus.cc:606] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:17.516968 31780 tablet_replica.cc:333] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:17.562412 25768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:17.563287 25768 raft_consensus.cc:606] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:17.563679 25768 raft_consensus.cc:630] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Rejecting request to transfer leadership because tablet server c781e437472a42e2a6162b67b1c7bbbd is not a voter in the active config
I20260709 12:12:17.549664 25517 catalog_manager.cc:5697] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 8 to 9, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 10 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.569202 31780 raft_consensus.cc:2243] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.540081 25613 raft_consensus.cc:2955] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.577112 25618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:17.577857 25618 raft_consensus.cc:606] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:17.580459 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5d5870a1cad42d2813f1ca36a619afe with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:17.572048 26338 raft_consensus.cc:2955] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:17.598276 31780 raft_consensus.cc:2272] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.599777 25768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:17.600489 25768 raft_consensus.cc:606] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:17.602131 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:17.610213 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:17.611850 31780 ts_tablet_manager.cc:1916] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:17.601905 31779 ts_tablet_manager.cc:1929] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:12:17.620977 31779 log.cc:1199] T 2eaf15c7f3ab41eea32890f20f50b4fd P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/2eaf15c7f3ab41eea32890f20f50b4fd
I20260709 12:12:17.623206 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 2eaf15c7f3ab41eea32890f20f50b4fd (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:17.649817 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.678697 31650 raft_consensus.cc:993] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:17.679260 31650 raft_consensus.cc:1081] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:17.679859 25607 tablet_service.cc:1558] Processing DeleteTablet for tablet b5d5870a1cad42d2813f1ca36a619afe with delete_type TABLET_DATA_TOMBSTONED (TS 56b5d00aa592407c9d5e67a03a961508 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41122
I20260709 12:12:17.682296 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:17.683046 25762 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.683385 25762 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.702314 25762 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:17.704512 25762 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:17.710940 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet 5de0ecbf35224b6aa22571e4a88d71c0 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:54016
I20260709 12:12:17.724262 31780 ts_tablet_manager.cc:1929] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 12:12:17.726033 31780 log.cc:1199] T 2842bb8137e14414992e2306de44989b P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/2842bb8137e14414992e2306de44989b
I20260709 12:12:17.728832 31780 tablet_replica.cc:333] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
W20260709 12:12:17.730613 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 73624us
I20260709 12:12:17.731804 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet 2842bb8137e14414992e2306de44989b (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:17.731881 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:17.740088 25615 raft_consensus.cc:3055] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:17.740476 25615 raft_consensus.cc:740] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:17.742748 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:17.743417 25685 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.751843 25615 consensus_queue.cc:260] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:17.753321 25615 raft_consensus.cc:3060] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.758561 31650 raft_consensus.cc:993] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:17.759256 31650 raft_consensus.cc:1081] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:17.761237 25766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c287ffad962949a7a7a740c373130b71"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:17.761873 25766 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.762270 25766 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.771371 25685 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 20.
I20260709 12:12:17.778154 31780 raft_consensus.cc:2243] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.779646 31780 raft_consensus.cc:2272] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.783500 31780 ts_tablet_manager.cc:1916] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:17.771332 25766 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:17.795562 25615 raft_consensus.cc:2468] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 20.
I20260709 12:12:17.793143 25732 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:17.809196 25766 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:17.820065 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:17.821189 25615 raft_consensus.cc:3055] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:17.821466 25615 raft_consensus.cc:740] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:17.822180 25615 consensus_queue.cc:260] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:17.832155 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:17.833000 26338 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.823083 31705 raft_consensus.cc:2804] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:17.837992 31705 raft_consensus.cc:697] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:17.839054 31705 consensus_queue.cc:237] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:17.848172 31782 tablet_replica.cc:333] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:17.850029 31782 raft_consensus.cc:2243] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.850350 26338 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:17.851112 31782 raft_consensus.cc:2272] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.851811 25731 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:17.855105 31688 raft_consensus.cc:2804] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:17.855624 31688 raft_consensus.cc:697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:17.856617 31688 consensus_queue.cc:237] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:17.852349 25615 raft_consensus.cc:3060] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.900406 25615 raft_consensus.cc:2468] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:17.926404 31782 ts_tablet_manager.cc:1916] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:17.930245 25513 catalog_manager.cc:5697] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 19 to 20, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 20 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.957582 31780 ts_tablet_manager.cc:1929] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 12:12:17.958213 31780 log.cc:1199] T b5d5870a1cad42d2813f1ca36a619afe P 56b5d00aa592407c9d5e67a03a961508: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/wals/b5d5870a1cad42d2813f1ca36a619afe
I20260709 12:12:17.963442 25502 catalog_manager.cc:5028] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): tablet b5d5870a1cad42d2813f1ca36a619afe (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:17.975733 25513 catalog_manager.cc:5697] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.021507 31705 raft_consensus.cc:993] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:18.022997 31705 raft_consensus.cc:1081] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:18.025497 25685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:18.026094 25685 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:18.026463 25685 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.066350 25685 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:18.077553 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:18.078315 25615 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.086680 25685 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:18.087491 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:18.096248 25763 raft_consensus.cc:3055] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.096577 25763 raft_consensus.cc:740] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:18.097560 25763 consensus_queue.cc:260] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:18.099278 25763 raft_consensus.cc:3060] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.093693 25615 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:12:18.095569 31782 ts_tablet_manager.cc:1929] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 12:12:18.129891 31782 log.cc:1199] T 5de0ecbf35224b6aa22571e4a88d71c0 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/5de0ecbf35224b6aa22571e4a88d71c0
I20260709 12:12:18.132438 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet 5de0ecbf35224b6aa22571e4a88d71c0 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:18.133915 25763 raft_consensus.cc:2468] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:12:18.135540 25657 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:18.136581 31766 raft_consensus.cc:2804] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:18.137176 31766 raft_consensus.cc:697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:18.138281 31766 consensus_queue.cc:237] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:18.172091 25513 catalog_manager.cc:5697] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 16 to 17, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 17 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.325911 25688 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:18.335208 25615 raft_consensus.cc:1275] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:18.339452 31497 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:12:18.346633 31705 consensus_queue.cc:1048] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:18.446141 25616 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:18.448951 31688 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:18.459903 26338 raft_consensus.cc:1275] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:18.463410 31688 consensus_queue.cc:1048] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:18.594445 25615 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:18.596227 31766 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:18.673951 25766 raft_consensus.cc:1275] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:18.676606 31763 consensus_queue.cc:1048] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:18.832502 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:19.094919 25616 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:12:19.143630 25582 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66ff605dcfe14eb0bba410038f643c24. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:19.184975 25763 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:19.200882 31639 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:19.214015 25685 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:19.243820 31639 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.249564 31732 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:19.252787 25766 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.354770 25515 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 8, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.359351 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:19.360351 25615 raft_consensus.cc:606] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:19.380407 25685 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.405426 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:19.406133 25762 raft_consensus.cc:606] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
W20260709 12:12:19.413861 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63013us
W20260709 12:12:19.441906 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 134939us
I20260709 12:12:19.451382 25766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:19.452150 25766 raft_consensus.cc:606] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:19.457350 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:19.458061 25685 raft_consensus.cc:606] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Received request to transfer leadership to TS 56b5d00aa592407c9d5e67a03a961508
W20260709 12:12:19.458799 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 55187.3us
I20260709 12:12:19.462198 25766 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:19.467715 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:19.470069 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:19.494479 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 83616.2us
W20260709 12:12:19.504190 25731 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2103e4c71b8f462bbb8a59f34359b34a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:19.506323 31705 raft_consensus.cc:993] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:19.510100 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:19.512974 31705 raft_consensus.cc:1081] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:19.521617 25615 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:19.521764 25618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:12:19.522480 25618 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:19.522796 25618 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.531966 25688 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:19.550369 31799 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:19.564277 31705 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:19.576875 25618 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.589820 31639 raft_consensus.cc:993] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:19.590161 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:19.590515 31800 raft_consensus.cc:1081] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:19.590991 25693 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.591921 25618 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:19.606237 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:19.607161 25762 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:19.607529 25762 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.606575 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:19.611039 25763 raft_consensus.cc:3055] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:19.611351 25763 raft_consensus.cc:740] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:19.612141 25763 consensus_queue.cc:260] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.613468 25763 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.623009 31763 raft_consensus.cc:993] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:19.623819 31763 raft_consensus.cc:1081] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Signalling peer 56b5d00aa592407c9d5e67a03a961508 to start an election
I20260709 12:12:19.627794 25618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
 from {username='slave'} at 127.0.0.1:53302
I20260709 12:12:19.628472 25618 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:19.628856 25618 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.637377 25618 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:19.638447 25693 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 18.
I20260709 12:12:19.642750 25583 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:19.649298 31732 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.649999 31732 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 18 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:19.650478 25762 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.651028 31732 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.656888 25618 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:19.659989 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:19.660742 25694 raft_consensus.cc:3055] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:19.661090 25694 raft_consensus.cc:740] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:19.665254 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:19.668605 25693 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.661979 25694 consensus_queue.cc:260] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:19.678171 25694 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.696740 26338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:19.697628 26338 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.700907 31806 raft_consensus.cc:993] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:19.701512 31806 raft_consensus.cc:1081] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:19.703531 25685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:19.704543 25685 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:19.705559 25685 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.710371 25763 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 18.
I20260709 12:12:19.715257 25685 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.717067 25610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:19.717732 25610 raft_consensus.cc:3055] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:19.718047 25610 raft_consensus.cc:740] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:19.719878 25685 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:19.719832 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:19.720069 25610 consensus_queue.cc:260] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.721212 25618 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.721549 25610 raft_consensus.cc:3060] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.726352 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:19.727310 25768 raft_consensus.cc:3055] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:19.727860 25768 raft_consensus.cc:740] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:19.653213 25762 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:19.728678 25768 consensus_queue.cc:260] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.730026 25768 raft_consensus.cc:3060] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.742033 25618 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:12:19.742033 25610 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:19.743526 25658 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:19.745324 31799 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.751065 25688 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.751677 26338 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 18.
I20260709 12:12:19.751936 31763 raft_consensus.cc:2804] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:19.758191 31763 raft_consensus.cc:697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:19.759507 31763 consensus_queue.cc:237] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:19.741047 25694 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 18.
I20260709 12:12:19.766094 25583 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:19.767738 25768 raft_consensus.cc:2468] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:12:19.770890 25732 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508; no voters: 
I20260709 12:12:19.769192 31732 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.772118 31732 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 18 LEADER]: Becoming Leader. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:19.773612 31732 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:19.776276 31806 raft_consensus.cc:2804] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:19.777158 31806 raft_consensus.cc:697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:19.778396 31806 consensus_queue.cc:237] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:19.803867 31815 log.cc:927] Time spent T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:12:19.830716 25693 raft_consensus.cc:2468] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:19.831597 25689 raft_consensus.cc:1240] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Rejecting Update request from peer 56b5d00aa592407c9d5e67a03a961508 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:19.856882 25610 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:19.877614 25516 catalog_manager.cc:5697] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:19.882334 25768 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:19.879853 25516 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:19.893129 25515 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 17 to 18, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 18 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:19.898023 25515 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: term changed from 17 to 18, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129). New cstate: current_term: 18 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:19.899667 31817 ts_tablet_manager.cc:933] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875)
I20260709 12:12:19.923390 25513 catalog_manager.cc:5697] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 13, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:19.938217 31817 tablet_copy_client.cc:323] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.129:43875
I20260709 12:12:19.945290 25629 tablet_copy_service.cc:140] P 56b5d00aa592407c9d5e67a03a961508: Received BeginTabletCopySession request for tablet 66ff605dcfe14eb0bba410038f643c24 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:59338)
I20260709 12:12:19.945938 25629 tablet_copy_service.cc:161] P 56b5d00aa592407c9d5e67a03a961508: Beginning new tablet copy session on tablet 66ff605dcfe14eb0bba410038f643c24 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:59338: session id = 8481c5f6be5b4faa9fe7c83301759f65-66ff605dcfe14eb0bba410038f643c24
I20260709 12:12:19.963541 25629 tablet_copy_source_session.cc:215] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:12:19.975440 25731 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a8d705bac7f4cac8af41b0b3de03011. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:19.977187 25693 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:19.978714 25618 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:19.980177 31806 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:19.992388 31688 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:12:20.020128 31822 ts_tablet_manager.cc:933] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:20.025399 31817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ff605dcfe14eb0bba410038f643c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:20.098546 31806 raft_consensus.cc:2955] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:20.102931 31822 tablet_copy_client.cc:323] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
I20260709 12:12:20.110749 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 2103e4c71b8f462bbb8a59f34359b34a from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:12:20.110556 25693 raft_consensus.cc:2955] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:20.133809 25688 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:20.141634 31639 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:20.147719 25618 raft_consensus.cc:2955] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:20.152057 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 2103e4c71b8f462bbb8a59f34359b34a from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-2103e4c71b8f462bbb8a59f34359b34a
I20260709 12:12:20.174860 31817 tablet_copy_client.cc:806] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:20.193063 31817 tablet_copy_client.cc:670] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:20.194494 25515 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 11, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:20.184643 25693 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:20.207893 31817 tablet_copy_client.cc:538] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:20.223729 25694 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:20.225559 31732 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:20.232162 25657 consensus_peers.cc:597] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515): Couldn't send request to peer 8481c5f6be5b4faa9fe7c83301759f65. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 481bb8b350a240b0a487c38c13791369. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:20.233795 25610 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:20.236828 31781 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:20.226171 25777 tablet_copy_source_session.cc:215] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:20.249348 31822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2103e4c71b8f462bbb8a59f34359b34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:20.250417 26338 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:20.251955 25762 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:20.252669 31732 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:20.256201 31766 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:20.272250 25762 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:20.279798 31639 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:20.281785 31817 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:20.313908 31822 tablet_copy_client.cc:806] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:20.322904 31766 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:20.328579 25618 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:20.331171 31763 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:20.334453 25763 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:20.334669 25618 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
I20260709 12:12:20.334553 31822 tablet_copy_client.cc:670] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:20.351475 25766 raft_consensus.cc:1275] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:20.361130 31822 tablet_copy_client.cc:538] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:20.365886 31832 consensus_queue.cc:1048] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 12:12:20.446336 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 77521.3us
I20260709 12:12:20.455968 31840 ts_tablet_manager.cc:933] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:20.506073 25615 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:12:20.522168 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 157453us
I20260709 12:12:20.580904 31822 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:20.577955 25688 raft_consensus.cc:1275] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:20.607163 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index -1 to 9, NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) added. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } } }
W20260709 12:12:20.723579 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 43909.8us
I20260709 12:12:20.760665 31688 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:20.847395 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 290166us
I20260709 12:12:20.884848 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:20.848294 31860 consensus_queue.cc:1048] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:12:20.890961 31840 tablet_copy_client.cc:323] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.131:44413
W20260709 12:12:21.022535 31872 log.cc:927] Time spent T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:12:21.031862 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 423703us
I20260709 12:12:21.047084 31877 ts_tablet_manager.cc:933] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:21.066987 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 139984us
I20260709 12:12:21.100576 25777 tablet_copy_service.cc:140] P 04e6206f9e924fb3931891bf3a64b392: Received BeginTabletCopySession request for tablet 5a8d705bac7f4cac8af41b0b3de03011 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:41126)
I20260709 12:12:21.119405 25777 tablet_copy_service.cc:161] P 04e6206f9e924fb3931891bf3a64b392: Beginning new tablet copy session on tablet 5a8d705bac7f4cac8af41b0b3de03011 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:41126: session id = 8481c5f6be5b4faa9fe7c83301759f65-5a8d705bac7f4cac8af41b0b3de03011
I20260709 12:12:21.139536 31877 tablet_copy_client.cc:323] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Beginning tablet copy session from remote peer at address 127.23.222.130:39349
W20260709 12:12:21.193822 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 110853us
I20260709 12:12:21.207427 25704 tablet_copy_service.cc:140] P c781e437472a42e2a6162b67b1c7bbbd: Received BeginTabletCopySession request for tablet 481bb8b350a240b0a487c38c13791369 from peer 8481c5f6be5b4faa9fe7c83301759f65 ({username='slave'} at 127.0.0.1:51490)
I20260709 12:12:21.208339 25704 tablet_copy_service.cc:161] P c781e437472a42e2a6162b67b1c7bbbd: Beginning new tablet copy session on tablet 481bb8b350a240b0a487c38c13791369 from peer 8481c5f6be5b4faa9fe7c83301759f65 at {username='slave'} at 127.0.0.1:51490: session id = 8481c5f6be5b4faa9fe7c83301759f65-481bb8b350a240b0a487c38c13791369
W20260709 12:12:21.214327 31856 log.cc:927] Time spent T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:21.239243 25704 tablet_copy_source_session.cc:215] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:12:21.295861 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 214960us
W20260709 12:12:21.307029 31817 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:12:21.322901 31877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 481bb8b350a240b0a487c38c13791369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.338956 25777 tablet_copy_source_session.cc:215] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:21.347118 31817 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:21.365829 31840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8d705bac7f4cac8af41b0b3de03011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:21.384258 31817 tablet_bootstrap.cc:492] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:21.385356 31817 ts_tablet_manager.cc:1403] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.104s	user 0.032s	sys 0.024s
I20260709 12:12:21.408445 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
mode: GRACEFUL
new_leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:47320
I20260709 12:12:21.409210 25760 raft_consensus.cc:606] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Received request to transfer leadership to TS c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:21.428382 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:45420
I20260709 12:12:21.429132 25685 raft_consensus.cc:606] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:21.432696 31840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:45784 (request call id 339) took 1059 ms. Trace:
I20260709 12:12:21.438895 31840 rpcz_store.cc:276] 0709 12:12:20.373419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.379327 (+  5908us) service_pool.cc:224] Handling call
0709 12:12:20.484560 (+105233us) ts_tablet_manager.cc:934] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Initiating tablet copy from peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
0709 12:12:21.364454 (+879894us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:12:21.390026 (+ 25572us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:21.390157 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:12:21.431841 (+ 41684us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:12:21.432162 (+   321us) tablet_replica.cc:206] Creating consensus instance
0709 12:12:21.432516 (+   354us) ts_tablet_manager.cc:989] Replica registered.
0709 12:12:21.432594 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":33742,"tablet-copy.queue_time_us":62227,"thread_start_us":263944,"threads_started":2}
I20260709 12:12:21.444487 31840 tablet_copy_client.cc:806] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:21.444597 25615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
mode: GRACEFUL
new_leader_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:12:21.446044 25615 raft_consensus.cc:606] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Received request to transfer leadership to TS 04e6206f9e924fb3931891bf3a64b392
I20260709 12:12:21.453128 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:21.455952 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:21.457216 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:21.488135 31869 raft_consensus.cc:993] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: : Instructing follower c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:21.488811 31869 raft_consensus.cc:1081] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Signalling peer c781e437472a42e2a6162b67b1c7bbbd to start an election
I20260709 12:12:21.458174 31840 tablet_copy_client.cc:670] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:21.521200 31817 raft_consensus.cc:359] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:21.525228 31817 raft_consensus.cc:740] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:21.526095 31817 consensus_queue.cc:260] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:21.540248 25694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44"
dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
 from {username='slave'} at 127.0.0.1:39692
I20260709 12:12:21.524338 31840 tablet_copy_client.cc:538] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:21.540998 25694 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:21.541471 25694 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.562911 31817 ts_tablet_manager.cc:1434] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.177s	user 0.010s	sys 0.001s
I20260709 12:12:21.580133 31822 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:21.581429 31822 tablet_bootstrap.cc:492] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:21.581502 25694 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:21.582412 31822 ts_tablet_manager.cc:1403] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 1.002s	user 0.061s	sys 0.015s
I20260709 12:12:21.585135 25629 tablet_copy_service.cc:342] P 56b5d00aa592407c9d5e67a03a961508: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-66ff605dcfe14eb0bba410038f643c24 received from {username='slave'} at 127.0.0.1:59338
I20260709 12:12:21.609619 31840 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:21.631548 25629 tablet_copy_service.cc:434] P 56b5d00aa592407c9d5e67a03a961508: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-66ff605dcfe14eb0bba410038f643c24 on tablet 66ff605dcfe14eb0bba410038f643c24 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:21.637773 31822 raft_consensus.cc:359] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:21.639034 31822 raft_consensus.cc:740] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:21.639849 31822 consensus_queue.cc:260] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:21.652213 31822 ts_tablet_manager.cc:1434] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:21.654870 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-2103e4c71b8f462bbb8a59f34359b34a received from {username='slave'} at 127.0.0.1:41126
I20260709 12:12:21.655422 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-2103e4c71b8f462bbb8a59f34359b34a on tablet 2103e4c71b8f462bbb8a59f34359b34a with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:21.661366 25694 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:21.662838 31877 tablet_copy_client.cc:806] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:21.666446 31877 tablet_copy_client.cc:670] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:21.669644 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:21.673612 25618 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.677135 31877 tablet_copy_client.cc:538] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:21.704034 25618 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:21.705592 25658 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:21.701995 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:21.707830 25762 raft_consensus.cc:3055] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:21.708137 25762 raft_consensus.cc:740] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:21.709280 25762 consensus_queue.cc:260] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:21.738551 25762 raft_consensus.cc:3060] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.735842 31781 raft_consensus.cc:2804] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:21.771291 25762 raft_consensus.cc:2468] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:21.763374 31781 raft_consensus.cc:697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:21.811987 31781 consensus_queue.cc:237] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:21.835005 31895 raft_consensus.cc:993] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:21.835620 31895 raft_consensus.cc:1081] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:21.858958 26336 raft_consensus.cc:1217] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:12:21.874423 31877 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap starting.
I20260709 12:12:21.897292 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54032
I20260709 12:12:21.899816 25762 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:21.902521 25762 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.904973 31800 raft_consensus.cc:993] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: : Instructing follower 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:21.905568 31800 raft_consensus.cc:1081] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Signalling peer 04e6206f9e924fb3931891bf3a64b392 to start an election
I20260709 12:12:21.907814 25768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473"
dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:12:21.908425 25768 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:21.908818 25768 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.922600 25768 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:21.941924 25513 catalog_manager.cc:5697] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 17 to 18, leader changed from 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 18 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.960321 25768 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:21.968353 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "56b5d00aa592407c9d5e67a03a961508"
I20260709 12:12:21.968793 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:21.969447 25690 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.969005 25615 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:21.970685 25615 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 56b5d00aa592407c9d5e67a03a961508, State: Running, Role: LEADER
I20260709 12:12:21.971549 25615 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:21.972966 25615 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.017714 25762 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:22.035524 25690 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:12:22.038733 25615 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:12:22.039206 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:22.041507 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:22.043139 26340 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.044292 31875 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:22.046355 31875 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:22.047367 31875 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:22.050820 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badc1c7146be42a1bb728a36f96a38ab" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:22.052587 26340 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:22.055579 25731 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:22.058187 31848 raft_consensus.cc:2804] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:22.052816 25690 raft_consensus.cc:3055] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:22.058845 31848 raft_consensus.cc:697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:22.059141 25690 raft_consensus.cc:740] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:22.059929 31848 consensus_queue.cc:237] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:22.060070 25690 consensus_queue.cc:260] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:22.061566 25690 raft_consensus.cc:3060] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:22.062857 25762 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:22.065986 26336 raft_consensus.cc:1217] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:12:22.116647 31840 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:22.117815 31840 tablet_bootstrap.cc:492] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:22.120240 31840 ts_tablet_manager.cc:1403] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.511s	user 0.059s	sys 0.047s
I20260709 12:12:22.129082 25690 raft_consensus.cc:2468] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:22.151762 25515 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 16 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:22.152544 31840 raft_consensus.cc:359] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:22.153707 31840 raft_consensus.cc:740] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
I20260709 12:12:22.194830 31840 consensus_queue.cc:260] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:22.200892 31840 ts_tablet_manager.cc:1434] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.002s
I20260709 12:12:22.203591 25777 tablet_copy_service.cc:342] P 04e6206f9e924fb3931891bf3a64b392: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-5a8d705bac7f4cac8af41b0b3de03011 received from {username='slave'} at 127.0.0.1:41126
I20260709 12:12:22.204116 25777 tablet_copy_service.cc:434] P 04e6206f9e924fb3931891bf3a64b392: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-5a8d705bac7f4cac8af41b0b3de03011 on tablet 5a8d705bac7f4cac8af41b0b3de03011 with peer 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:22.222332 25513 catalog_manager.cc:5697] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:22.258765 31806 raft_consensus.cc:1064] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:22.264186 31806 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:22.319407 25690 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:22.319394 25615 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:22.334707 26340 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:22.335680 25615 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:22.337389 31766 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:22.323454 31852 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:12:22.347611 25762 raft_consensus.cc:1275] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:22.349136 31876 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:22.350373 31848 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:22.369974 31864 consensus_queue.cc:1048] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:22.428247 31855 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:22.438521 31877 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:22.459249 31877 tablet_bootstrap.cc:492] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: Bootstrap complete.
I20260709 12:12:22.460127 31877 ts_tablet_manager.cc:1403] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent bootstrapping tablet: real 0.598s	user 0.034s	sys 0.030s
I20260709 12:12:22.497099 25618 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:22.531302 31877 raft_consensus.cc:359] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:22.532681 31877 raft_consensus.cc:740] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Initialized, Role: LEARNER
W20260709 12:12:22.564286 31911 log.cc:927] Time spent T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:12:22.533664 31877 consensus_queue.cc:260] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:12:22.581552 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 63590us
I20260709 12:12:22.648300 26336 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:22.662540 31877 ts_tablet_manager.cc:1434] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: Time spent starting tablet: real 0.202s	user 0.012s	sys 0.000s
W20260709 12:12:22.666904 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 152654us
I20260709 12:12:22.673305 25689 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:22.676136 26336 raft_consensus.cc:1217] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 12:12:22.678428 25693 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:22.712822 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.769433 25516 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:22.787739 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 96004.3us
I20260709 12:12:22.768595 25704 tablet_copy_service.cc:342] P c781e437472a42e2a6162b67b1c7bbbd: Request end of tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-481bb8b350a240b0a487c38c13791369 received from {username='slave'} at 127.0.0.1:51490
I20260709 12:12:22.722971 31852 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 12:12:22.894616 26340 raft_consensus.cc:1217] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:12:22.830435 25704 tablet_copy_service.cc:434] P c781e437472a42e2a6162b67b1c7bbbd: ending tablet copy session 8481c5f6be5b4faa9fe7c83301759f65-481bb8b350a240b0a487c38c13791369 on tablet 481bb8b350a240b0a487c38c13791369 with peer 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:12:22.911022 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 122254us
W20260709 12:12:22.994765 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 225400us
W20260709 12:12:23.016723 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 322254us
I20260709 12:12:23.068640 26340 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:23.144193 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 43918.1us
W20260709 12:12:23.302883 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 119893us
W20260709 12:12:23.295066 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 126459us
W20260709 12:12:23.410660 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 96297.6us
I20260709 12:12:23.472048 25688 raft_consensus.cc:1275] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:12:23.505081 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 61876.5us
I20260709 12:12:23.513759 31938 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:23.515823 31919 raft_consensus.cc:1064] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
W20260709 12:12:23.516945 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 71522.4us
W20260709 12:12:23.554082 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 256167us
I20260709 12:12:23.557451 25610 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:23.650593 31800 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.651242 31800 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:23.653898 31800 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:23.671977 31937 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:23.682677 31926 raft_consensus.cc:1064] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:23.686928 31926 consensus_queue.cc:237] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:23.708626 25516 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51996 (request call id 333) took 1007 ms. Trace:
I20260709 12:12:23.709136 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:23.692935 31919 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:23.727275 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:23.728066 25689 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 16.
I20260709 12:12:23.709273 25516 rpcz_store.cc:276] 0709 12:12:22.700898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.701025 (+   127us) service_pool.cc:224] Handling call
0709 12:12:22.762340 (+ 61315us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b5400002490. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc37640 00007fbdb8b0e846 00007fbdb8c1890e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:12:23.708524 (+946184us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:22.967837 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:22.968495 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:22.968539 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:12:22.968560 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:22.968953 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:22.969019 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:22.969052 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:12:22.969262 (+   210us) tablet.cc:701] Row locks acquired
0709 12:12:22.969284 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:22.969449 (+   165us) write_op.cc:270] Start()
0709 12:12:22.969584 (+   135us) write_op.cc:276] Timestamp: P: 1783599142969397 usec, L: 0
0709 12:12:22.969610 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:12:22.970390 (+   780us) log.cc:844] Serialized 603 byte log entry
0709 12:12:23.210510 (+240120us) op_driver.cc:464] REPLICATION: finished
0709 12:12:23.310491 (+ 99981us) write_op.cc:301] APPLY: starting
0709 12:12:23.410804 (+100313us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:23.535418 (+124614us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:23.535549 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:23.558943 (+ 23394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:23.574614 (+ 15671us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:12:23.574686 (+    72us) write_op.cc:312] APPLY: finished
0709 12:12:23.574933 (+   247us) log.cc:844] Serialized 25 byte log entry
0709 12:12:23.575143 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:23.575245 (+   102us) write_op.cc:454] Released schema lock
0709 12:12:23.575295 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:23.615905 (+ 40610us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b1800209980. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb29034bc 00007fbdafc5148b 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb6791ef0 00007fbdb6792489 00007fbdb679471a
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":20935040,"child_traces":[["op",{"apply.queue_time_us":86543,"apply.run_cpu_time_us":7886,"apply.run_wall_time_us":271044,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":182812,"prepare.run_cpu_time_us":2930,"prepare.run_wall_time_us":4645,"replication_time_us":240674,"spinlock_wait_cycles":4105088,"thread_start_us":158526,"threads_started":2}]]}
I20260709 12:12:23.731566 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:23.732484 31800 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.732977 31800 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.733407 31800 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:23.746374 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 75215.5us
I20260709 12:12:23.752270 31800 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:23.760984 26336 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEARNER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:23.762537 31937 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:23.779369 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58876.2us
I20260709 12:12:23.799790 26336 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:23.800086 25762 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:23.804579 31800 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:23.808779 25689 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Refusing update from remote peer 56b5d00aa592407c9d5e67a03a961508: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:23.808998 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:23.811163 25693 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:23.816645 31948 raft_consensus.cc:1064] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: attempting to promote NON_VOTER 8481c5f6be5b4faa9fe7c83301759f65 to VOTER
I20260709 12:12:23.818977 31855 consensus_queue.cc:1048] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:23.822757 31948 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:23.838950 31926 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:23.894719 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 67375.9us
I20260709 12:12:23.930519 25615 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:23.932751 25762 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:23.935247 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:23.939585 25618 raft_consensus.cc:1240] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Rejecting Update request from peer 04e6206f9e924fb3931891bf3a64b392 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:23.942909 25610 raft_consensus.cc:1275] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:23.948024 31914 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:23.952942 31914 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:23.965049 26335 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 LEARNER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:23.967517 31781 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:24.004129 31800 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:24.004827 31920 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:24.020442 25768 consensus_queue.cc:237] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:23.939955 25582 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:24.028204 31934 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:12:24.084046 25732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:24.122448 31981 log.cc:927] Time spent T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:12:24.123116 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 183529us
I20260709 12:12:24.119923 31966 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 4
I20260709 12:12:24.160665 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
W20260709 12:12:24.238790 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 138350us
W20260709 12:12:24.289219 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 80403.8us
W20260709 12:12:24.295179 25658 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:24.392001 26333 raft_consensus.cc:1275] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:24.392007 31935 consensus_queue.cc:1059] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:12:24.408066 31855 raft_consensus.cc:3055] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:24.408540 31855 raft_consensus.cc:740] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:24.412510 31926 consensus_queue.cc:1048] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:24.412887 31855 consensus_queue.cc:260] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:24.416538 31855 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:24.428076 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 148823us
W20260709 12:12:24.565280 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 173057us
I20260709 12:12:24.613449 31942 consensus_queue.cc:1048] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:24.629266 31806 raft_consensus.cc:2955] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:24.655263 31962 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:24.660014 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 73107.6us
I20260709 12:12:24.691397 26332 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:24.691609 31997 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:24.762037 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 133580us
W20260709 12:12:24.766182 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.766294 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.767695 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.770350 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.777987 25658 consensus_peers.cc:597] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.787817 25692 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:24.779160 26337 raft_consensus.cc:2955] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:24.794847 25517 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:24.824138 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.824903 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 51868.7us
W20260709 12:12:24.825740 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.804612 25766 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:24.860046 25690 raft_consensus.cc:2955] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:24.895287 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 47601.1us
I20260709 12:12:24.903333 31937 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:24.900308 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.898430 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.917794 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:24.933153 26332 raft_consensus.cc:2955] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:24.917820 25762 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:24.925021 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.961421 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 115863us
W20260709 12:12:24.968096 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.969014 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.969666 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.970227 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.970937 25734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:24.970785 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.973951 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.976264 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:24.976909 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.016063 26335 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:25.051975 32005 log.cc:927] Time spent T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:12:25.057121 31947 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.058027 31947 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.057807 25515 catalog_manager.cc:5697] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 11 to 12, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.060105 31944 raft_consensus.cc:493] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.060793 31947 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.060748 31944 raft_consensus.cc:515] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.062171 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.061868 25513 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 reported cstate change: config changed from index 8 to 9, 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "56b5d00aa592407c9d5e67a03a961508" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.067715 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.063125 31944 leader_election.cc:290] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.089742 31966 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.090487 31966 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.093067 31966 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:12:25.093351 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.093639 31966 raft_consensus.cc:493] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
W20260709 12:12:25.094559 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.097417 31966 raft_consensus.cc:515] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:25.097847 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.094967 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcdef7196c6a445c945bb47541d7d3ac" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.093858 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.093974 31947 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.096530 31800 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.102738 31800 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.102291 31947 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.105203 31800 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.105513 31947 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:12:25.099102 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.108955 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:12:25.109346 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.112354 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.114174 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.114820 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.116353 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.118149 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.119079 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.119601 32007 raft_consensus.cc:493] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.120323 32007 raft_consensus.cc:515] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.121434 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1f7a89fe9fd4bf0b5efc34622f42d69" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.122480 31914 raft_consensus.cc:493] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:12:25.123390 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:12:25.125370 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.126643 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.111871 31966 leader_election.cc:290] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:25.127831 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.117992 31917 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.132270 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.133395 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.123090 31914 raft_consensus.cc:515] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:25.135064 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.119122 31997 raft_consensus.cc:493] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
W20260709 12:12:25.137524 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.157016 31997 raft_consensus.cc:515] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.137285 31800 raft_consensus.cc:493] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.136247 31969 raft_consensus.cc:493] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:12:25.138082 31947 raft_consensus.cc:493] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.131789 31917 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
W20260709 12:12:25.163353 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:25.166993 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:25.143349 31937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54016 (request call id 76) took 1128 ms. Trace:
I20260709 12:12:25.173144 25582 leader_election.cc:304] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:25.156208 32007 leader_election.cc:290] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.186682 31800 raft_consensus.cc:515] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.189322 31966 raft_consensus.cc:2749] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.190362 31800 leader_election.cc:290] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.180423 31937 rpcz_store.cc:276] 0709 12:12:24.012870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.013939 (+  1069us) service_pool.cc:224] Handling call
0709 12:12:24.116563 (+102624us) log.cc:844] Serialized 508 byte log entry
0709 12:12:24.675770 (+559207us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54001a5ca0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2cd0dbe 00007fbdb2cdb930 00007fbdb2cdb8d8 00007fbdb2cdb858 00007fbdb2cdb813 00007fbdb2cdaa9c 00007fbdb8bc62f6 00007fbdb8bc0aa8 00007fbdb2d177cb 00007fbdb2d1a2c0
0709 12:12:25.137749 (+461979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":596,"raft.queue_time_us":15960,"raft.run_cpu_time_us":1378,"raft.run_wall_time_us":1373,"spinlock_wait_cycles":65695616,"thread_start_us":130666,"threads_started":1,"wal-append.queue_time_us":289215}
I20260709 12:12:25.196163 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:25.178450 31969 raft_consensus.cc:515] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.205155 31969 leader_election.cc:290] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.202210 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:25.181494 31947 raft_consensus.cc:515] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.202332 31800 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.214969 32007 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.221573 32007 raft_consensus.cc:493] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:12:25.222453 32007 raft_consensus.cc:515] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.224198 31914 leader_election.cc:290] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.225997 31997 leader_election.cc:290] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.230031 31998 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.230820 31998 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.236583 25582 leader_election.cc:304] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:25.225302 32007 leader_election.cc:290] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.264844 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.268210 32019 raft_consensus.cc:493] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.268900 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:25.270988 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:25.292095 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.293965 25501 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2103e4c71b8f462bbb8a59f34359b34a with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:25.294494 31998 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.303510 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.286437 31800 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.413021 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.268913 32019 raft_consensus.cc:515] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.426290 31944 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:25.420423 32009 raft_consensus.cc:2749] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:25.435966 32007 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.427093 31800 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.481259 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:25.464310 31917 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.498499 31947 leader_election.cc:290] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.502074 31800 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.474963 31944 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.503234 31944 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.510353 31944 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.517026 32019 leader_election.cc:290] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.523872 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34f7287caa8a4b84a342ecc197b9fabc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.533490 25657 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:25.539076 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6225db99ff6d444e990645903f433cf3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.540673 32027 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.543711 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.547043 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.567391 25688 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.624012 32019 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.624441 32009 raft_consensus.cc:493] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:12:25.625008 32019 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.625236 32009 raft_consensus.cc:515] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.627579 32009 leader_election.cc:290] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.629062 32009 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.627604 32019 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.634443 32019 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.635119 32019 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.629678 32009 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.730084 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.727895 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.780579 32019 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.793170 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.801151 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.813889 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.830299 26335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830afb4bf9c747ab89c652d34a9aedef" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.831841 26339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b28e719d6586469e8c186ce7b5af6bc7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.832581 26334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0600a571a0457f804bf9bf88fd9fd4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.833972 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e6df07fdde400cbbefc675d486ab4a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.835091 32031 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:25.835740 32031 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.855909 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.871369 25582 leader_election.cc:304] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:25.872947 32026 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.874435 31800 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.874995 31917 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.875119 31800 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } attrs { replace: true } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: NON_VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: true } }
I20260709 12:12:25.875765 32036 raft_consensus.cc:2749] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.877632 31800 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.874150 32032 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.879381 32032 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.881656 32032 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.883602 32018 raft_consensus.cc:493] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8481c5f6be5b4faa9fe7c83301759f65)
I20260709 12:12:25.884436 32018 raft_consensus.cc:515] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.886502 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaf15c7f3ab41eea32890f20f50b4fd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.870070 32009 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.888206 32031 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.894858 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:25.875681 31917 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.873847 32026 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.899060 31917 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.900162 32026 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:25.901371 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 85068us
I20260709 12:12:25.906165 31800 raft_consensus.cc:493] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:25.907639 31800 raft_consensus.cc:515] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.908167 25583 leader_election.cc:304] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:25.914166 32009 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.927489 32018 leader_election.cc:290] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:25.928018 32009 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.911306 31800 leader_election.cc:290] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.914451 31917 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:25.932876 31917 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:25.935576 31917 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:25.920480 32032 raft_consensus.cc:2749] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:25.919683 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.944617 32009 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:25.961970 25502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 65643us
I20260709 12:12:25.971387 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:25.978188 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.972747 24442 tablet_replica.cc:333] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:25.987725 31939 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:25.989217 26340 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:25.991140 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.988024 25515 catalog_manager.cc:5697] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: config changed from index 12 to 13, VOTER c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) evicted. New cstate: current_term: 17 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:25.991204 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.002898 32022 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:26.003304 24442 raft_consensus.cc:2243] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.004117 24442 raft_consensus.cc:2272] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.003607 32022 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:25.999233 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.010480 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:25.988703 31939 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.033525 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.079630 31917 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:26.079859 25582 leader_election.cc:304] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.080674 32022 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:26.080469 31917 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.081337 32022 raft_consensus.cc:2749] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:26.081586 32009 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:26.082206 32009 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:26.083096 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.083746 31917 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:26.079653 25659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.084542 32009 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:26.081233 25582 leader_election.cc:304] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.086681 25582 leader_election.cc:304] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.087846 25582 leader_election.cc:304] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.088757 31917 raft_consensus.cc:2749] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:12:26.089102 31800 raft_consensus.cc:2749] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:12:26.089402 32022 raft_consensus.cc:2749] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.090838 25582 leader_election.cc:304] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.031401 32019 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:12:26.093257 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): ChangeConfig:REMOVE_PEER RPC failed for tablet 66ff605dcfe14eb0bba410038f643c24: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.103741 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.111380 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.079777 32028 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:26.115558 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.113070 32019 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.118911 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.120393 32019 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:26.120393 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.120934 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6640372ef1e64554b6b1025b28173499" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:26.121223 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:26.125362 31939 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:26.126801 26333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:26.137369 32026 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.132089 32028 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:26.138018 32026 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.142568 32026 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:26.107692 31917 raft_consensus.cc:2749] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.158872 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.160359 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.161530 25582 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.166103 25767 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:26.166659 25582 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.169215 32009 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.174618 32018 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:26.176620 32028 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:26.186542 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8d705bac7f4cac8af41b0b3de03011" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.190615 24442 tablet_replica.cc:333] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
W20260709 12:12:26.194090 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 198034us
W20260709 12:12:26.196821 25658 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.202662 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f692b35e5aaf426dbfdc5ec7efe47cc3" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:12:26.204710 26304 leader_election.cc:336] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.205312 26304 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:26.208511 32031 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:26.210500 32028 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:26.211083 32028 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.213640 32028 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:26.251430 24442 raft_consensus.cc:2243] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.252343 24442 raft_consensus.cc:2272] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.261059 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a019a0a19861420b8da3d57b0d23ebbd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.261366 25690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75613106563e4abcbdf42d2200d80af5" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.287118 31926 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.292053 31926 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.296205 31926 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:26.301451 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8225ffb62d4087a3a45c98cc24c581" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.301985 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3637b70d215243c283e2280b99045ced" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.304055 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57ef007401b4e88884bfaefab8e512b" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.311154 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0100a4dff40541e38cf6a72d218d3a44" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.315730 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95d45dfde7e4e1ea3a9df8d3a6c8ede" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.302894 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb8bd60a08b47bdb117f89304e5dda7" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.317212 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3e9aede281f4f4d8ad175c6b2357ddc" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.303706 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.332743 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec1ea6ba3c44e1fb40c2cf3a43f0da6" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.337307 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b02303361d43d1903c3e943b866b64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:12:26.337436 25658 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:26.340291 25658 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.343027 31998 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:26.343652 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcae3b0851948f58bc6dc5970b11943" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.344054 31998 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.348582 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d559aa8dd6d44d11ab56eb9a423319bd" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.352481 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2103e4c71b8f462bbb8a59f34359b34a" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.353307 25692 raft_consensus.cc:2468] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56b5d00aa592407c9d5e67a03a961508 in term 17.
I20260709 12:12:26.364570 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff1240c7107404994c96234274c5e64" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.363159 24442 tablet_replica.cc:333] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.371963 31998 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:26.373181 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ec4f9939ba74a4a8a5bcc35720a5e31" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.373201 24442 raft_consensus.cc:2243] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.382829 25767 raft_consensus.cc:1275] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:26.385324 24442 raft_consensus.cc:2272] T 594f26e3426243d5b79945733b1f2dd5 P 56b5d00aa592407c9d5e67a03a961508 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.386099 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.387045 25692 raft_consensus.cc:2410] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56b5d00aa592407c9d5e67a03a961508 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:26.397274 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.404227 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
W20260709 12:12:26.404438 25658 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.406351 25583 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.410600 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.414729 31800 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:26.417593 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2842bb8137e14414992e2306de44989b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.413049 25583 leader_election.cc:304] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.421940 31996 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:26.423025 25583 raft_consensus.cc:2686] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 56b5d00aa592407c9d5e67a03a961508: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:26.430159 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:26.430938 25694 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:12:26.441129 31996 consensus_queue.cc:1048] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:26.448745 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:26.452209 25583 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.460060 25583 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.466418 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:26.470366 25657 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.465468 31800 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.465337 32018 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.463281 31996 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.478619 32042 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.498363 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.499424 25763 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 17.
I20260709 12:12:26.484872 31962 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:26.529448 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 48353.9us
I20260709 12:12:26.533583 25657 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:26.536098 32027 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.536525 32027 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:26.536897 32027 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.538847 31939 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:26.543841 26332 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:26.548815 32027 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:26.532474 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 60390.6us
I20260709 12:12:26.531060 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:26.555233 25583 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:26.556348 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 94529.5us
I20260709 12:12:26.561481 25583 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.572067 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:26.573936 24442 tablet_replica.cc:333] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.565687 32026 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.560534 31806 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:26.587962 24442 raft_consensus.cc:2243] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:26.579825 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.583600 25684 tablet_service.cc:1558] Processing DeleteTablet for tablet 2103e4c71b8f462bbb8a59f34359b34a with delete_type TABLET_DATA_TOMBSTONED (TS c781e437472a42e2a6162b67b1c7bbbd not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:39676
I20260709 12:12:26.585480 31806 raft_consensus.cc:493] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.606426 31806 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:26.583001 25583 raft_consensus.cc:2686] T 3637b70d215243c283e2280b99045ced P 56b5d00aa592407c9d5e67a03a961508: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:12:26.612936 25583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51510.5us
I20260709 12:12:26.613893 25583 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:26.595261 25658 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.578919 32027 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:26.628480 25583 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.629896 25583 leader_election.cc:304] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.631009 25583 leader_election.cc:304] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.631253 24442 raft_consensus.cc:2272] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.623054 32026 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.634584 25583 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:26.638589 25583 raft_consensus.cc:2686] T 481bb8b350a240b0a487c38c13791369 P 56b5d00aa592407c9d5e67a03a961508: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:26.639855 25583 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.640098 24442 tablet_replica.cc:333] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.640789 31800 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.634819 31917 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.641347 25583 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.642203 31917 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:26.642704 25583 leader_election.cc:304] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.643859 25583 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.644910 25583 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.645443 32022 raft_consensus.cc:2749] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:26.646134 32022 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.646588 25583 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.646828 32022 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.647364 32018 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.648561 25583 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.649315 32026 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.650749 25583 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:26.651229 24442 raft_consensus.cc:2243] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.651520 32026 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:26.652094 24442 raft_consensus.cc:2272] T b28e719d6586469e8c186ce7b5af6bc7 P 56b5d00aa592407c9d5e67a03a961508 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.653667 32056 raft_consensus.cc:2749] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:26.655260 24442 tablet_replica.cc:333] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.656029 24442 raft_consensus.cc:2243] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.656924 24442 raft_consensus.cc:2272] T 5de0ecbf35224b6aa22571e4a88d71c0 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.633955 32032 raft_consensus.cc:2749] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:12:26.658977 32059 tablet_replica.cc:333] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:26.660602 32059 raft_consensus.cc:2243] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.665493 24442 tablet_replica.cc:333] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.666725 24442 raft_consensus.cc:2243] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.668216 24442 raft_consensus.cc:2272] T b1deffe0cca244839dc0d8c35e1c9292 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:26.700276 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 54169.1us
W20260709 12:12:26.699760 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 63999.2us
I20260709 12:12:26.705950 32059 raft_consensus.cc:2272] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.704113 24442 tablet_replica.cc:333] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.707305 24442 raft_consensus.cc:2243] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.709709 24442 raft_consensus.cc:2272] T bed4e4bd0407478d9750209db4d90dca P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.718006 24442 tablet_replica.cc:333] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.710400 25767 raft_consensus.cc:2955] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:26.719332 24442 raft_consensus.cc:2243] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.720144 24442 raft_consensus.cc:2272] T 969280fd738b40ab84e4cf910d39f1dc P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.712445 31806 raft_consensus.cc:515] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.709735 32059 ts_tablet_manager.cc:1916] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:26.738241 24442 tablet_replica.cc:333] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.739372 24442 raft_consensus.cc:2243] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.740031 24442 raft_consensus.cc:2272] T 34f7287caa8a4b84a342ecc197b9fabc P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.751726 25763 raft_consensus.cc:2368] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 17. Current term is 18.
I20260709 12:12:26.755765 31806 leader_election.cc:290] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:26.761198 31939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39676 (request call id 79) took 1254 ms. Trace:
I20260709 12:12:26.763672 24442 tablet_replica.cc:333] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.764869 24442 raft_consensus.cc:2243] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.765326 25657 leader_election.cc:400] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 17. Current term is 18.
I20260709 12:12:26.765666 25657 leader_election.cc:403] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:26.766317 24442 raft_consensus.cc:2272] T f44656354a354842bb48b4fd32f2c39b P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.767130 31996 raft_consensus.cc:3060] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.766796 31939 rpcz_store.cc:276] 0709 12:12:25.506800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.506953 (+   153us) service_pool.cc:224] Handling call
0709 12:12:25.570172 (+ 63219us) log.cc:844] Serialized 508 byte log entry
0709 12:12:25.721713 (+151541us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400329954. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d61735 00007fbdb2d599fa 00007fbdb7d214c9 00007fbdb129dc54 00007fbdb129dbe2 00007fbdb129db11 00007fbdb129da8c 00007fbdb129cd42 00007fbdb109648c 00007fbdb10958c6
0709 12:12:26.761089 (+1039376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58690,"raft.queue_time_us":46993,"raft.run_cpu_time_us":1358,"raft.run_wall_time_us":25043,"spinlock_wait_cycles":133006592,"thread_start_us":211489,"threads_started":1}
I20260709 12:12:26.773188 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 481bb8b350a240b0a487c38c13791369 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:26.781185 25515 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: config changed from index 10 to 11, VOTER 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) evicted. New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:26.789356 24442 tablet_replica.cc:333] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.789951 31996 raft_consensus.cc:2749] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413) with higher term. Message: Invalid argument: T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd for earlier term 17. Current term is 18.
I20260709 12:12:26.790483 24442 raft_consensus.cc:2243] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.793860 32032 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:26.794555 32032 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:26.800359 32032 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:26.802048 24442 raft_consensus.cc:2272] T 7ff1240c7107404994c96234274c5e64 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.802294 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4e477d5c41447338e4490daf6af0473" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:26.810014 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:26.811228 32059 ts_tablet_manager.cc:1929] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:12:26.811779 32059 log.cc:1199] T 2103e4c71b8f462bbb8a59f34359b34a P c781e437472a42e2a6162b67b1c7bbbd: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/wals/2103e4c71b8f462bbb8a59f34359b34a
I20260709 12:12:26.813943 25502 catalog_manager.cc:5028] TS c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): tablet 2103e4c71b8f462bbb8a59f34359b34a (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
I20260709 12:12:26.813876 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c287ffad962949a7a7a740c373130b71" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:26.812991 24442 tablet_replica.cc:333] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.816061 24442 raft_consensus.cc:2243] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.838781 25689 raft_consensus.cc:2468] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 18.
I20260709 12:12:26.871896 24442 raft_consensus.cc:2272] T b57ef007401b4e88884bfaefab8e512b P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:26.872228 25582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 58490.9us
I20260709 12:12:26.875540 24442 tablet_replica.cc:333] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.878186 24442 raft_consensus.cc:2243] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.879102 24442 raft_consensus.cc:2272] T 085a5eec03e94a80b662d7995cbee18c P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.891355 24442 tablet_replica.cc:333] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.892289 24442 raft_consensus.cc:2243] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.895063 24442 raft_consensus.cc:2272] T 75613106563e4abcbdf42d2200d80af5 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.898330 24442 tablet_replica.cc:333] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.899188 24442 raft_consensus.cc:2243] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.892464 25582 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:26.899775 24442 raft_consensus.cc:2272] T 830afb4bf9c747ab89c652d34a9aedef P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.899986 31917 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.918324 25732 leader_election.cc:304] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:26.919761 31926 raft_consensus.cc:2804] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.920339 31926 raft_consensus.cc:697] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:26.921231 31926 consensus_queue.cc:237] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:26.939248 24442 tablet_replica.cc:333] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.940645 24442 raft_consensus.cc:2243] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.941394 24442 raft_consensus.cc:2272] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.945043 24442 tablet_replica.cc:333] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.955072 24442 raft_consensus.cc:2243] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.955862 24442 raft_consensus.cc:2272] T 0100a4dff40541e38cf6a72d218d3a44 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.957059 25515 catalog_manager.cc:5697] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.958984 24442 tablet_replica.cc:333] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.960076 24442 raft_consensus.cc:2243] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:26.961302 24442 raft_consensus.cc:2272] T debca0eda6c649e38d13858860f6a245 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:26.975091 25732 leader_election.cc:336] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:26.975271 24442 tablet_replica.cc:333] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.988755 24442 raft_consensus.cc:2243] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.989668 24442 raft_consensus.cc:2272] T d5b02303361d43d1903c3e943b866b64 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:26.997030 24442 tablet_replica.cc:333] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:26.997997 24442 raft_consensus.cc:2243] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:26.998673 24442 raft_consensus.cc:2272] T bbb8bd60a08b47bdb117f89304e5dda7 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.001888 24442 tablet_replica.cc:333] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.016170 24442 raft_consensus.cc:2243] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.016943 24442 raft_consensus.cc:2272] T a019a0a19861420b8da3d57b0d23ebbd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.028650 24442 tablet_replica.cc:333] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.034904 24442 raft_consensus.cc:2243] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.035784 24442 raft_consensus.cc:2272] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.038785 31917 raft_consensus.cc:493] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:27.039371 31917 raft_consensus.cc:515] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:27.042299 31917 leader_election.cc:290] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:27.043009 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:27.046852 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a4bcd027c7e4c85bf47844eba789061" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:27.051616 25582 leader_election.cc:304] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:27.055110 31917 raft_consensus.cc:2749] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:27.067265 24442 tablet_replica.cc:333] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.068552 24442 raft_consensus.cc:2243] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:27.078619 31917 raft_consensus.cc:670] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:12:27.082602 24442 raft_consensus.cc:2272] T dcdef7196c6a445c945bb47541d7d3ac P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.091884 24442 tablet_replica.cc:333] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.092850 24442 raft_consensus.cc:2243] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.093501 24442 raft_consensus.cc:2272] T 0a4bcd027c7e4c85bf47844eba789061 P 56b5d00aa592407c9d5e67a03a961508 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.096637 24442 tablet_replica.cc:333] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.097584 24442 raft_consensus.cc:2243] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.098899 24442 raft_consensus.cc:2272] T e8ccce4d8eb845e4b0f90ae503e00da5 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.114334 24442 tablet_replica.cc:333] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.115247 24442 raft_consensus.cc:2243] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.122653 24442 raft_consensus.cc:2272] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.137373 24442 tablet_replica.cc:333] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.138413 24442 raft_consensus.cc:2243] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.139073 24442 raft_consensus.cc:2272] T 4fcae3b0851948f58bc6dc5970b11943 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.149012 24442 tablet_replica.cc:333] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.149996 24442 raft_consensus.cc:2243] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.151229 24442 raft_consensus.cc:2272] T f944cbb1f9c948d88b377be34146370e P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.169231 24442 tablet_replica.cc:333] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.174300 24442 raft_consensus.cc:2243] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.175664 24442 raft_consensus.cc:2272] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.178802 24442 tablet_replica.cc:333] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.179646 24442 raft_consensus.cc:2243] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.181020 24442 raft_consensus.cc:2272] T 66ff605dcfe14eb0bba410038f643c24 P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.182621 32018 raft_consensus.cc:493] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:27.183163 32018 raft_consensus.cc:515] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:27.184341 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.185554 32018 leader_election.cc:290] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:27.187498 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:27.194135 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ba2cd1bc7a14c19bade889bb7b32145" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:27.196302 25582 leader_election.cc:304] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:27.198503 32018 raft_consensus.cc:2749] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:27.200165 24442 tablet_replica.cc:333] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.201102 24442 raft_consensus.cc:2243] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.201835 24442 raft_consensus.cc:2272] T 5a8d705bac7f4cac8af41b0b3de03011 P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:27.204627 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:12:27.213665 24442 tablet_replica.cc:333] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.214738 24442 raft_consensus.cc:2243] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.223016 24442 raft_consensus.cc:2272] T d559aa8dd6d44d11ab56eb9a423319bd P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.227455 24442 tablet_replica.cc:333] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.228369 24442 raft_consensus.cc:2243] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.228991 24442 raft_consensus.cc:2272] T e4e477d5c41447338e4490daf6af0473 P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.272778 24442 tablet_replica.cc:333] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.273690 24442 raft_consensus.cc:2243] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.280951 24442 raft_consensus.cc:2272] T c287ffad962949a7a7a740c373130b71 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.312783 24442 tablet_replica.cc:333] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.313979 24442 raft_consensus.cc:2243] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.322605 24442 raft_consensus.cc:2272] T 39e6df07fdde400cbbefc675d486ab4a P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.328840 24442 tablet_replica.cc:333] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.329739 24442 raft_consensus.cc:2243] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.331267 24442 raft_consensus.cc:2272] T 84aa327d1e74484291d8031bfc9a9463 P 56b5d00aa592407c9d5e67a03a961508 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.352674 24442 tablet_replica.cc:333] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.371899 24442 raft_consensus.cc:2243] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.372721 24442 raft_consensus.cc:2272] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 56b5d00aa592407c9d5e67a03a961508 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.385934 24442 tablet_replica.cc:333] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.387202 24442 raft_consensus.cc:2243] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.388397 24442 raft_consensus.cc:2272] T 2103e4c71b8f462bbb8a59f34359b34a P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.392021 24442 tablet_replica.cc:333] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.392930 24442 raft_consensus.cc:2243] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.399016 24442 raft_consensus.cc:2272] T e7414eafc9044de28063237176e3435f P 56b5d00aa592407c9d5e67a03a961508 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.402382 24442 tablet_replica.cc:333] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.403304 24442 raft_consensus.cc:2243] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:27.414027 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.423239 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.431236 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.432142 32018 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:27.433010 32018 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:27.404023 24442 raft_consensus.cc:2272] T 7a8225ffb62d4087a3a45c98cc24c581 P 56b5d00aa592407c9d5e67a03a961508 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.435381 32018 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:27.437489 24442 tablet_replica.cc:333] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.438516 24442 raft_consensus.cc:2243] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.438623 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:27.439514 24442 raft_consensus.cc:2272] T fa0600a571a0457f804bf9bf88fd9fd4 P 56b5d00aa592407c9d5e67a03a961508 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.439908 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1b2a1b70ef4f4f93481fcf3c72c5e4" candidate_uuid: "56b5d00aa592407c9d5e67a03a961508" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:27.442289 25582 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56b5d00aa592407c9d5e67a03a961508; no voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:27.442972 24442 tablet_replica.cc:333] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.443490 32018 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.444036 24442 raft_consensus.cc:2243] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.445578 24442 raft_consensus.cc:2272] T 20c583a2390b4b6d955b01e778798db7 P 56b5d00aa592407c9d5e67a03a961508 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.448866 24442 tablet_replica.cc:333] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.449764 24442 raft_consensus.cc:2243] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.450525 24442 raft_consensus.cc:2272] T d3e9aede281f4f4d8ad175c6b2357ddc P 56b5d00aa592407c9d5e67a03a961508 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:27.452669 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:27.453469 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.453930 24442 tablet_replica.cc:333] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.454887 24442 raft_consensus.cc:2243] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.455561 24442 raft_consensus.cc:2272] T 2ba2cd1bc7a14c19bade889bb7b32145 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.458983 24442 tablet_replica.cc:333] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.459884 24442 raft_consensus.cc:2243] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.460608 24442 raft_consensus.cc:2272] T 6225db99ff6d444e990645903f433cf3 P 56b5d00aa592407c9d5e67a03a961508 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.463948 24442 tablet_replica.cc:333] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.464923 24442 raft_consensus.cc:2243] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:27.467666 24442 raft_consensus.cc:2272] T 460a9cbf9985461f9237f09b4f5ca854 P 56b5d00aa592407c9d5e67a03a961508 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.475337 25692 raft_consensus.cc:1275] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:27.490240 31923 consensus_queue.cc:1048] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:27.491714 24442 tablet_replica.cc:333] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.492630 24442 raft_consensus.cc:2243] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.493278 24442 raft_consensus.cc:2272] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 56b5d00aa592407c9d5e67a03a961508 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.523785 24442 tablet_replica.cc:333] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.524611 24442 raft_consensus.cc:2243] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.525381 24442 raft_consensus.cc:2272] T 2eaf15c7f3ab41eea32890f20f50b4fd P 56b5d00aa592407c9d5e67a03a961508 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:27.528334 24442 tablet_replica.cc:333] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508: stopping tablet replica
I20260709 12:12:27.529167 24442 raft_consensus.cc:2243] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:27.530200 24442 raft_consensus.cc:2272] T 6640372ef1e64554b6b1025b28173499 P 56b5d00aa592407c9d5e67a03a961508 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:27.620198 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.659948 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.680686 32064 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.681388 32064 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:27.683866 32064 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:27.686826 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:27.691004 31948 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.691594 31948 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:27.692745 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:27.693288 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:27.698235 32064 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.702054 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:27.702838 25766 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 21.
W20260709 12:12:27.704682 25658 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:27.707780 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:27.709532 31996 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:27.710028 31996 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.710458 31996 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:27.694121 31948 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:27.743790 31996 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:27.761663 32068 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.762689 32068 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:27.772169 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.772694 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:27.774441 32068 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:12:27.776222 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.789280 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.795805 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:27.800952 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "594f26e3426243d5b79945733b1f2dd5" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:27.801743 25766 raft_consensus.cc:3060] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:27.802794 32068 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.803398 32068 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:27.805645 32068 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:27.819223 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:27.833132 32068 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.833952 32068 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:27.836624 32068 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:27.839238 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:27.871574 31996 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 22 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:27.887099 25766 raft_consensus.cc:2468] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 22.
W20260709 12:12:27.798689 25658 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:27.905037 25658 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:27.905215 25657 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:27.906085 31996 raft_consensus.cc:2749] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.889979 32037 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.892783 32021 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.907238 32021 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:27.909757 32021 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:27.912999 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:27.914012 25689 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 18.
I20260709 12:12:27.906186 32069 raft_consensus.cc:2804] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:27.915741 32069 raft_consensus.cc:697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 22 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:27.916728 32069 consensus_queue.cc:237] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:27.919766 32037 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:27.928546 32071 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.929294 32071 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:27.932150 32071 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:27.922351 32037 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:27.939214 26304 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:27.941644 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:27.942431 25692 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 14.
I20260709 12:12:27.944049 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:27.944860 25689 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 16.
W20260709 12:12:27.948277 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 150462us
I20260709 12:12:27.949685 32037 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.950150 32037 raft_consensus.cc:493] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.950611 32037 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:27.954892 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 60014.7us
W20260709 12:12:27.902352 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:27.959292 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 57049.2us
I20260709 12:12:27.966130 26304 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:27.969549 32071 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:27.969689 26304 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:27.970067 32071 raft_consensus.cc:493] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.970616 32071 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.981840 31996 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.990427 31996 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:27.992957 31996 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:27.993952 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:27.996601 32021 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:27.997044 32021 raft_consensus.cc:493] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:27.997394 32021 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:28.003903 24442 connection.cc:466] server connection from 127.0.0.1:53290 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 3521) could send its response
I20260709 12:12:28.007289 25515 catalog_manager.cc:5697] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 21 to 22, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 22 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:28.015852 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 46247.7us
I20260709 12:12:28.032546 32021 raft_consensus.cc:515] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.034828 32021 leader_election.cc:290] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:28.020592 25732 connection.cc:769] client connection to 127.23.222.129:43875 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260709 12:12:28.056259 25658 connection.cc:769] client connection to 127.23.222.129:43875 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:28.058532 26304 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:28.059451 26304 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:28.060120 26304 leader_election.cc:336] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:28.079738 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed4e4bd0407478d9750209db4d90dca" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:28.080618 25689 raft_consensus.cc:3060] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.099937 32071 raft_consensus.cc:515] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.109408 25689 raft_consensus.cc:2468] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 17.
I20260709 12:12:28.117666 32071 leader_election.cc:290] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.143215 32037 raft_consensus.cc:515] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.147027 32037 leader_election.cc:290] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.165596 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5de0ecbf35224b6aa22571e4a88d71c0" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:28.166373 25689 raft_consensus.cc:3060] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.174823 32073 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.175570 32073 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.178218 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1deffe0cca244839dc0d8c35e1c9292" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:28.178946 25691 raft_consensus.cc:3060] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.181068 25689 raft_consensus.cc:2468] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 15.
I20260709 12:12:28.183926 26304 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.188273 32073 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.206521 32069 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.207301 32069 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.209079 31996 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.209820 31996 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.212553 31996 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.214768 26304 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.215067 32037 raft_consensus.cc:2804] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:28.215571 32037 raft_consensus.cc:697] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:12:28.216064 32071 raft_consensus.cc:2804] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:28.216594 32071 raft_consensus.cc:697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:12:28.216542 32037 consensus_queue.cc:237] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.217669 32071 consensus_queue.cc:237] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.220961 32069 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.223467 31923 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
W20260709 12:12:28.222851 26304 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.224085 31923 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:28.225157 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:28.225875 25691 raft_consensus.cc:2468] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 19.
W20260709 12:12:28.238435 26304 leader_election.cc:336] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:28.241514 26304 leader_election.cc:336] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.246657 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:28.236891 32021 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.250284 32021 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.256315 32064 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.257237 32064 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.260545 31923 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.277626 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.277913 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:12:28.280109 25502 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 230043us
I20260709 12:12:28.286739 25767 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:12:28.288069 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:12:28.288606 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.290519 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:12:28.297191 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 54092.9us
I20260709 12:12:28.299304 26304 leader_election.cc:304] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:28.300315 32076 raft_consensus.cc:2804] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:28.300871 32076 raft_consensus.cc:697] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:12:28.301503 32021 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.301957 32076 consensus_queue.cc:237] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.306681 32069 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:28.314087 32069 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.315263 32069 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.309514 31923 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.319199 31923 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.320595 25516 catalog_manager.cc:5697] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 16 to 17, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 17 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:28.321633 31923 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.322808 25516 catalog_manager.cc:5697] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 15 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:28.330636 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.331833 26304 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.332321 26304 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:28.333493 32037 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.339541 32064 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:28.341071 26304 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.346652 25762 raft_consensus.cc:1275] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:28.349177 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:28.349826 25692 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:12:28.354058 32070 consensus_queue.cc:1048] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:28.363528 32068 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.368865 32068 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.372514 32068 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.391575 32069 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.396217 32069 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.406929 32069 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.416241 32069 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.429543 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969280fd738b40ab84e4cf910d39f1dc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:28.430318 25767 raft_consensus.cc:3060] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.430209 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.434906 25762 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 10.
I20260709 12:12:28.436200 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.439440 31996 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:28.441504 31996 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.441919 31996 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:28.449534 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.450578 25762 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:12:28.449534 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.462266 31996 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.471510 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a5eec03e94a80b662d7995cbee18c" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:28.472378 25768 raft_consensus.cc:3060] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:28.478364 32069 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.479010 31996 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.479526 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:28.480224 26332 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
I20260709 12:12:28.481472 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.482669 32037 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.483340 32037 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:28.484541 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.485100 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.485554 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:28.485615 32037 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.486223 32064 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:28.486670 32064 raft_consensus.cc:493] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.487043 32064 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.489759 25767 raft_consensus.cc:2468] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 15.
I20260709 12:12:28.497689 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.496675 25657 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.499625 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.500959 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:12:28.501313 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.501868 25732 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.502000 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
W20260709 12:12:28.502820 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:28.502686 25692 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:12:28.515522 32070 raft_consensus.cc:2804] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:28.515965 26304 leader_election.cc:336] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.516124 32070 raft_consensus.cc:697] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:28.501739 32064 raft_consensus.cc:515] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.522917 32070 consensus_queue.cc:237] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.527981 25516 catalog_manager.cc:5697] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 18 to 19, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 19 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:28.534934 31996 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:28.535691 31996 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.540824 32095 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.541440 32095 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.545250 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:28.545951 26332 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 10.
I20260709 12:12:28.546730 32095 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.547701 25731 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:28.548660 32095 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:28.549099 32095 raft_consensus.cc:493] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.549531 32095 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:28.551009 32093 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.560720 26303 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:28.551607 32093 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.562325 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.564127 32086 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:28.564640 32086 raft_consensus.cc:493] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.564819 32093 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.565141 32086 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.566403 32076 raft_consensus.cc:2749] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:28.538811 31996 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.574642 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:28.575454 26332 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:28.575624 32069 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.576233 32069 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.579355 25731 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:28.580417 32064 leader_election.cc:290] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.582023 25768 raft_consensus.cc:2468] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 11.
I20260709 12:12:28.584348 31923 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.585652 32069 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.590013 32086 raft_consensus.cc:515] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.595306 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.597980 25657 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.602957 32095 raft_consensus.cc:515] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.605540 32095 leader_election.cc:290] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.610239 26303 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:28.612164 32037 raft_consensus.cc:2749] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.613272 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c583a2390b4b6d955b01e778798db7" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:28.613970 26332 raft_consensus.cc:3060] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:28.597151 31923 raft_consensus.cc:493] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.615001 31923 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:28.621768 25732 leader_election.cc:336] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.614025 31948 raft_consensus.cc:2804] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:28.626710 32090 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.703348 32090 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.705615 32090 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.630995 32093 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.631529 32069 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.706452 32093 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.637959 26332 raft_consensus.cc:2468] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 11.
I20260709 12:12:28.708586 25731 leader_election.cc:304] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:28.708963 32093 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.709477 32090 raft_consensus.cc:2804] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:28.710048 32090 raft_consensus.cc:697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:28.711002 32090 consensus_queue.cc:237] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.705348 25516 catalog_manager.cc:5697] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 15 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:28.713788 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:28.648001 32086 leader_election.cc:290] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.664785 32068 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.673849 32070 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.677680 25687 raft_consensus.cc:1275] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:28.688529 25689 raft_consensus.cc:1275] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:28.706496 32069 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.637079 31923 raft_consensus.cc:515] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:28.724308 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 102554us
W20260709 12:12:28.735098 25732 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.735607 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:28.736794 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.737332 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.737802 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:28.743085 31948 raft_consensus.cc:697] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
W20260709 12:12:28.746297 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.750046 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.751430 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:28.752604 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:28.738616 32092 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.725927 32068 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.738631 32076 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.756032 32076 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.757632 32068 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.734377 32070 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.745421 32037 consensus_queue.cc:1048] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:12:28.767755 31923 leader_election.cc:290] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.754390 32074 consensus_queue.cc:1048] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:12:28.757681 32069 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.772013 32070 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.758126 32076 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:28.783116 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ccce4d8eb845e4b0f90ae503e00da5" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:28.783872 26332 raft_consensus.cc:3060] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.794001 25516 catalog_manager.cc:5697] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 10 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 11 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:28.795442 26304 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:28.799573 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:28.826699 25687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:28.827934 25687 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 11.
I20260709 12:12:28.842895 26304 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:28.844792 32071 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:28.851042 32071 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.781272 31996 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:28.887907 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 146116us
I20260709 12:12:28.845443 26332 raft_consensus.cc:2468] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
I20260709 12:12:28.851640 32071 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:28.840909 32101 raft_consensus.cc:493] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.897840 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.899581 25763 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 12.
I20260709 12:12:28.905660 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.906451 25767 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 18.
I20260709 12:12:28.909317 25766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:28.838450 31948 consensus_queue.cc:237] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.909978 25766 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 19.
I20260709 12:12:28.913024 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debca0eda6c649e38d13858860f6a245" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:28.913194 25693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:28.913659 25694 raft_consensus.cc:3060] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.911697 25692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44656354a354842bb48b4fd32f2c39b" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:28.914618 25692 raft_consensus.cc:3060] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.914492 25688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd" is_pre_election: true
I20260709 12:12:28.915504 25688 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 12.
I20260709 12:12:28.913832 25693 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:28.916960 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.930248 25694 raft_consensus.cc:2468] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:28.936244 25691 raft_consensus.cc:1275] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:28.932265 25731 leader_election.cc:304] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:12:28.919566 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:28.943152 32100 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:28.943641 32100 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.944016 32100 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:28.946432 31923 raft_consensus.cc:2804] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:28.947059 31923 raft_consensus.cc:697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:28.947217 32074 consensus_queue.cc:1048] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:28.951710 25692 raft_consensus.cc:2468] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:28.948050 31923 consensus_queue.cc:237] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:28.941294 25732 leader_election.cc:336] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.918500 31996 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.962960 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.964201 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:28.968528 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:28.969154 32105 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:28.964295 32099 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.969777 32105 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.969909 32099 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:28.970304 32105 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.970469 32099 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.969261 25768 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.970250 32100 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.911314 32101 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.981084 32100 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:28.982443 32101 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:28.983028 32105 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:28.983440 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ff605dcfe14eb0bba410038f643c24" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:28.984102 26332 raft_consensus.cc:3060] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.988256 32071 raft_consensus.cc:515] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:28.990649 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:28.991515 26340 raft_consensus.cc:2393] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c781e437472a42e2a6162b67b1c7bbbd in current term 12: Already voted for candidate 8481c5f6be5b4faa9fe7c83301759f65 in this term.
W20260709 12:12:28.962215 25732 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:28.981880 25768 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
I20260709 12:12:29.000089 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7414eafc9044de28063237176e3435f" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:29.000947 25764 raft_consensus.cc:3060] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:29.030833 24442 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25640)
I20260709 12:12:29.068662 32105 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:29.112092 26332 raft_consensus.cc:2468] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 14.
W20260709 12:12:29.114249 32084 log.cc:927] Time spent T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: Append to log took a long time: real 0.050s	user 0.000s	sys 0.008s
I20260709 12:12:29.101575 32071 leader_election.cc:290] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:29.126706 25516 catalog_manager.cc:5697] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 10 to 11, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 11 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.161643 25515 catalog_manager.cc:5697] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 16 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:29.181142 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 174020us
I20260709 12:12:29.209625 25657 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.241014 25764 raft_consensus.cc:2468] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 13.
W20260709 12:12:29.241081 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:29.247404 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 44450.9us
I20260709 12:12:29.249872 25691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460a9cbf9985461f9237f09b4f5ca854" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:29.250881 25691 raft_consensus.cc:3060] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:29.263062 32113 log.cc:927] Time spent T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:12:29.268185 26304 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.269590 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.270440 32092 raft_consensus.cc:2764] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:12:29.270569 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.271194 32069 raft_consensus.cc:2804] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:29.273211 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 72660us
I20260709 12:12:29.271809 25732 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.281288 25657 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.281750 25764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4081aaa0ccdd4b4bb28382a955fcd9fc" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:29.282358 25764 raft_consensus.cc:3060] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.271759 32069 raft_consensus.cc:697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:29.288712 25732 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.290669 25768 raft_consensus.cc:1275] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:29.296838 25691 raft_consensus.cc:2468] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 12.
I20260709 12:12:29.287854 32121 raft_consensus.cc:2804] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:29.301028 32093 raft_consensus.cc:2804] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:29.301656 32093 raft_consensus.cc:697] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:29.303427 32063 raft_consensus.cc:2804] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:29.304085 32063 raft_consensus.cc:697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:29.281098 32125 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:29.305797 32125 raft_consensus.cc:493] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 56b5d00aa592407c9d5e67a03a961508)
I20260709 12:12:29.306195 32125 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.304613 32093 consensus_queue.cc:237] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.310809 32069 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:29.305009 32063 consensus_queue.cc:237] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.317293 26304 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508
W20260709 12:12:29.295274 25658 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 48320.6us
W20260709 12:12:29.319473 25658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111) [suppressed 276 similar messages]
I20260709 12:12:29.317965 32121 raft_consensus.cc:697] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:29.335542 32124 raft_consensus.cc:2804] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:29.335848 26333 raft_consensus.cc:1275] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:29.336333 32124 raft_consensus.cc:697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:12:29.344913 32117 consensus_queue.cc:1048] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:29.343915 32099 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.349133 25764 raft_consensus.cc:2468] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 20.
W20260709 12:12:29.352851 25732 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.354673 25732 leader_election.cc:336] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.337386 32124 consensus_queue.cc:237] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:29.355535 25732 leader_election.cc:336] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.361339 32083 consensus_queue.cc:1048] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:29.365516 25732 leader_election.cc:336] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.366714 25732 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.367980 25732 leader_election.cc:336] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.377803 25657 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.392505 25768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aa327d1e74484291d8031bfc9a9463" candidate_uuid: "c781e437472a42e2a6162b67b1c7bbbd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:29.393316 25768 raft_consensus.cc:3060] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.379542 32099 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:29.326043 32121 consensus_queue.cc:237] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.415549 25768 raft_consensus.cc:2468] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c781e437472a42e2a6162b67b1c7bbbd in term 19.
I20260709 12:12:29.391249 32070 raft_consensus.cc:2804] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:29.426841 25657 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
I20260709 12:12:29.431368 32131 raft_consensus.cc:2804] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:29.432180 32131 raft_consensus.cc:697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:29.432521 32070 raft_consensus.cc:697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Becoming Leader. State: Replica: c781e437472a42e2a6162b67b1c7bbbd, State: Running, Role: LEADER
I20260709 12:12:29.433158 32131 consensus_queue.cc:237] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.433522 32070 consensus_queue.cc:237] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:29.441017 25658 leader_election.cc:336] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.441737 25658 leader_election.cc:304] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:29.446841 32099 raft_consensus.cc:2749] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:29.465184 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:29.468708 25658 leader_election.cc:336] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.469112 25658 leader_election.cc:304] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
I20260709 12:12:29.417966 32125 raft_consensus.cc:515] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.489354 26333 raft_consensus.cc:1275] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:29.490584 32104 raft_consensus.cc:2749] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:29.499934 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:29.523149 32135 log.cc:927] Time spent T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:29.525159 32125 leader_election.cc:290] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Requested vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:29.515026 25658 leader_election.cc:336] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.528321 25502 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 145417us
I20260709 12:12:29.528313 25658 leader_election.cc:304] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:12:29.529827 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:29.530507 25658 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.532706 25689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f944cbb1f9c948d88b377be34146370e" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c781e437472a42e2a6162b67b1c7bbbd"
I20260709 12:12:29.533372 25689 raft_consensus.cc:3060] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.531255 32070 raft_consensus.cc:2749] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:29.557804 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.513302 32090 consensus_queue.cc:1048] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:12:29.565687 25516 catalog_manager.cc:5697] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.569684 25516 catalog_manager.cc:5697] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:29.586056 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:29.586720 25658 leader_election.cc:336] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.587177 25658 leader_election.cc:304] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:29.588340 25689 raft_consensus.cc:2468] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:29.592001 25732 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd; no voters: 
W20260709 12:12:29.594609 25658 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.595700 32100 raft_consensus.cc:2749] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:29.600525 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:29.601214 25658 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.601637 32094 raft_consensus.cc:2804] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:29.601997 25658 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.602380 32094 raft_consensus.cc:697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
W20260709 12:12:29.602881 25658 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.603753 25658 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.604754 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:29.605175 25658 leader_election.cc:336] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.605551 25658 leader_election.cc:304] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:29.603425 32094 consensus_queue.cc:237] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:29.639411 32101 raft_consensus.cc:2749] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:29.640172 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:29.642877 25658 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.643752 25658 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.644454 25658 leader_election.cc:336] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.646687 25766 raft_consensus.cc:1275] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:29.648488 32105 consensus_queue.cc:1048] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:29.650943 25515 catalog_manager.cc:5697] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 11 to 12, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 12 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:29.656026 25658 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.657666 25658 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.665256 25658 leader_election.cc:336] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.666549 25658 leader_election.cc:304] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c781e437472a42e2a6162b67b1c7bbbd; no voters: 56b5d00aa592407c9d5e67a03a961508, 8481c5f6be5b4faa9fe7c83301759f65
W20260709 12:12:29.673015 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:29.673980 25517 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 13 to 14, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.684365 25517 catalog_manager.cc:5697] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 12 to 13, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 13 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:29.696507 25658 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.698025 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:29.699846 32068 raft_consensus.cc:2749] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:29.758899 25658 leader_election.cc:336] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:29.774824 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:29.820933 26334 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:29.822974 32117 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:29.869654 25763 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:12:29.878492 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:29.879913 25732 leader_election.cc:336] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:29.874096 25515 catalog_manager.cc:5697] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 14 to 15, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 15 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.888733 25691 raft_consensus.cc:1275] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:29.898799 25687 raft_consensus.cc:1275] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:29.876423 32070 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:12:29.914002 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:29.917440 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:29.917980 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:29.936870 25764 raft_consensus.cc:1275] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:29.941607 32121 consensus_queue.cc:1048] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:29.948796 25764 raft_consensus.cc:1275] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:29.952481 32070 consensus_queue.cc:1048] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:29.982780 25517 catalog_manager.cc:5697] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 18 to 19, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 19 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.987711 25517 catalog_manager.cc:5697] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: term changed from 19 to 20, leader changed from 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129) to c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130). New cstate: current_term: 20 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.989755 32063 consensus_queue.cc:1048] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:29.984265 32125 consensus_queue.cc:1048] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:12:30.009065 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:30.011598 25764 raft_consensus.cc:1275] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:30.014011 32070 consensus_queue.cc:1048] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:30.037737 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:30.047950 25692 raft_consensus.cc:1275] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Refusing update from remote peer 8481c5f6be5b4faa9fe7c83301759f65: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:12:30.050433 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:30.038453 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:30.063768 24442 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25640)
I20260709 12:12:30.055399 32129 consensus_queue.cc:1048] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:12:30.095187 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:30.157680 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:30.166762 25692 raft_consensus.cc:1275] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Refusing update from remote peer 04e6206f9e924fb3931891bf3a64b392: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:12:30.172669 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:30.180974 32083 consensus_queue.cc:1048] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 12:12:30.263273 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:30.291316 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:30.462497 25691 consensus_queue.cc:237] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:30.492250 26337 raft_consensus.cc:1275] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Refusing update from remote peer c781e437472a42e2a6162b67b1c7bbbd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:12:30.494921 32117 consensus_queue.cc:1048] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:30.553797 32099 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
W20260709 12:12:30.556456 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:30.565145 26337 raft_consensus.cc:2955] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } } }
I20260709 12:12:30.568897 25502 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66ff605dcfe14eb0bba410038f643c24 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:12:30.585755 25517 catalog_manager.cc:5697] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd reported cstate change: config changed from index 9 to 11, VOTER 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131) evicted. New cstate: current_term: 14 leader_uuid: "c781e437472a42e2a6162b67b1c7bbbd" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:30.619184 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:30.658777 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:30.728643 25756 tablet_service.cc:1558] Processing DeleteTablet for tablet 66ff605dcfe14eb0bba410038f643c24 with delete_type TABLET_DATA_TOMBSTONED (TS 04e6206f9e924fb3931891bf3a64b392 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54016
W20260709 12:12:30.743094 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:30.779966 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:30.788103 32166 tablet_replica.cc:333] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:30.789292 32166 raft_consensus.cc:2243] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:30.802446 32166 raft_consensus.cc:2272] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:30.812992 32166 ts_tablet_manager.cc:1916] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:30.942648 32166 ts_tablet_manager.cc:1929] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:12:30.943133 32166 log.cc:1199] T 66ff605dcfe14eb0bba410038f643c24 P 04e6206f9e924fb3931891bf3a64b392: Deleting WAL directory at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/wals/66ff605dcfe14eb0bba410038f643c24
I20260709 12:12:30.949343 25501 catalog_manager.cc:5028] TS 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): tablet 66ff605dcfe14eb0bba410038f643c24 (table test-workload [id=bac210690ba94fa0b2250fd51b0472a8]) successfully deleted
W20260709 12:12:31.031780 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.033196 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 73898.9us
W20260709 12:12:31.064301 24442 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:31.090343 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 51606.7us
W20260709 12:12:31.100706 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.101379 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.142078 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:31.177505 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.186504 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.209815 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.222487 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.268029 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.262794 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:31.363092 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.484644 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.488196 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:31.576790 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.689333 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.691164 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.697368 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 109742us
W20260709 12:12:31.699658 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.716601 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:31.740756 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.753775 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.785316 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.787235 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.792351 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.793001 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:31.800324 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:31.946302 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.006511 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:32.044945 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:32.064869 24442 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:32.069358 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.149117 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:32.166946 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 45363.3us
W20260709 12:12:32.216398 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.283880 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.312110 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:32.313050 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.338513 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:32.351647 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.404101 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:32.510268 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:32.520440 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.538594 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.573653 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:32.644897 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:32.880740 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:32.978237 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:32.985821 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 51234.4us
W20260709 12:12:32.991725 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:33.039705 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:33.055214 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.065572 24442 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:33.099432 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:33.259578 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.315862 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:33.429838 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.456657 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.695459 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:33.699613 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.726176 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.770853 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:33.785691 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.801465 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.837039 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.906601 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.964758 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:33.998761 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.000697 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.130107 24442 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:34.163467 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.212535 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.213541 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.258844 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:34.334816 25658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111) [suppressed 485 similar messages]
W20260709 12:12:34.339612 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.349932 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.372382 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:34.451344 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 134415us
W20260709 12:12:34.475387 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.531692 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:34.545218 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:34.615870 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.616676 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.617723 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:34.622226 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.797228 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:34.876818 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 55692.5us
W20260709 12:12:34.939564 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 57937.6us
W20260709 12:12:35.067579 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 116692us
W20260709 12:12:35.080013 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.080825 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.085084 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:35.089733 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.077368 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:35.101217 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.117209 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.120409 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:35.131420 24442 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:35.133417 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.163733 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.168279 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.202431 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.205560 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.367450 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.511080 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.557397 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.574385 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:35.608649 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.836678 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08002569c0 after lost signal to thread 24445
W20260709 12:12:35.879727 26361 debug-util.cc:398] Leaking SignalData structure 0x7b0800374200 after lost signal to thread 25551
W20260709 12:12:35.884816 26361 debug-util.cc:398] Leaking SignalData structure 0x7b0800305a40 after lost signal to thread 25718
W20260709 12:12:35.908058 26361 debug-util.cc:398] Leaking SignalData structure 0x7b08003657c0 after lost signal to thread 25792
W20260709 12:12:35.917514 26361 debug-util.cc:398] Leaking SignalData structure 0x7b0800368f60 after lost signal to thread 26364
W20260709 12:12:35.928365 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:35.936802 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:35.979730 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.037247 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:36.053738 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.062362 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.132022 24442 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:36.245627 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.345144 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.365049 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.380195 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.405491 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.493593 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.551574 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.561964 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.632619 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.653824 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.656950 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.721671 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.722436 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.739880 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.761654 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.817829 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.835922 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.880461 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.888743 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.891012 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:36.949049 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:36.965646 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.033667 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.068001 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:37.091037 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.132607 24442 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:37.266462 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.287958 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.304769 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.305281 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.456362 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.488780 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.492568 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.513496 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:37.515955 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.555787 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.632485 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:37.635911 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:37.727878 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:37.878494 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:37.908721 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.019385 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.063046 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:38.115825 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.133183 24442 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:38.172284 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 52018.6us
W20260709 12:12:38.252570 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.457298 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.551422 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:38.563050 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.771692 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:38.801550 25731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:39515, user_credentials={real_user=slave}} blocked reactor thread for 61453.5us
W20260709 12:12:38.810359 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:38.825191 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.863878 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:38.881645 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.879530 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:38.896701 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:38.955056 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.102617 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.133716 24442 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:39.141706 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.178593 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.182063 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.268464 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.294270 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.295547 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.315215 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.331606 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.334136 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.334739 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.344132 26304 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111) [suppressed 486 similar messages]
W20260709 12:12:39.380863 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.392300 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.393723 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.398149 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.479864 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.599402 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.652420 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:39.686091 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.710130 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.768606 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.790225 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:39.952054 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.972031 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:39.990159 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:40.063025 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:40.064306 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:40.134246 24442 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:40.207647 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:40.216620 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:40.276844 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:41.134903 24442 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:41.139268 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 53273.2us
W20260709 12:12:41.141916 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.140583 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:41.151250 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.162635 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:41.186848 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.228384 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.230710 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:41.234596 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.379994 25715 debug-util.cc:398] Leaking SignalData structure 0x7b080010f580 after lost signal to thread 24445
W20260709 12:12:41.381491 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800349960 after lost signal to thread 25551
W20260709 12:12:41.383391 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08001656c0 after lost signal to thread 25718
W20260709 12:12:41.384819 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb880 after lost signal to thread 25792
W20260709 12:12:41.386387 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08002cbf20 after lost signal to thread 26364
W20260709 12:12:41.426014 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:41.678013 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.708567 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.729766 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:41.885056 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:42.087162 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:42.135457 24442 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:42.201609 25657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 49650.4us
W20260709 12:12:42.239562 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.278203 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.368155 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.411649 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:42.431571 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:42.545089 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:42.553018 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.574608 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.607213 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.624936 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:42.628767 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:42.671404 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.701393 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.745441 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.791044 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:42.836045 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.866298 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:42.885267 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.886103 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.886633 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:42.953581 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.004426 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.048509 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.050577 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.062376 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.132128 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.136044 24442 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:43.151070 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.154719 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:43.308655 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:43875, user_credentials={real_user=slave}} blocked reactor thread for 172480us
W20260709 12:12:43.471756 26303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:44413, user_credentials={real_user=slave}} blocked reactor thread for 63682us
W20260709 12:12:43.474011 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.477466 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.482056 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.512449 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.513162 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:43.582901 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:43.583792 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.624366 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.626794 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.658712 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:43.854333 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:43.918969 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.017148 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.069633 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:44.136680 24442 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:44.141453 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.171146 25715 debug-util.cc:398] Leaking SignalData structure 0x7b080032ea80 after lost signal to thread 24445
W20260709 12:12:44.172585 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3680 after lost signal to thread 25551
W20260709 12:12:44.174300 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800279360 after lost signal to thread 25718
W20260709 12:12:44.179070 25715 debug-util.cc:398] Leaking SignalData structure 0x7b0800124e40 after lost signal to thread 25792
W20260709 12:12:44.180564 25715 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8dc0 after lost signal to thread 26364
W20260709 12:12:44.185988 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:44.357772 25732 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111) [suppressed 400 similar messages]
W20260709 12:12:44.407850 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.434616 26304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 53581.9us
W20260709 12:12:44.604108 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.605646 25732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:39349, user_credentials={real_user=slave}} blocked reactor thread for 117085us
W20260709 12:12:44.660576 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:44.662518 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.706808 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:44.708523 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.761729 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:44.825691 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:44.879293 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:44.890698 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.917709 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.927098 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.969033 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:44.971776 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:44.972942 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.095691 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.096343 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.105276 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.107936 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:45.137730 24442 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 25640)
W20260709 12:12:45.147557 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:12:45.200568 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.201251 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.265352 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.290690 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.350222 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:45.358449 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.493193 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.577199 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.595916 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.694968 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.715080 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.762187 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.765460 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.776446 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.799495 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:45.872475 25658 consensus_peers.cc:597] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:45.906499 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:45.941639 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:46.028203 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:46.050326 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:46.093796 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:46.162360 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:46.219269 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:46.306839 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:46.369674 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:46.410560 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:46.521394 25658 consensus_peers.cc:597] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:46.558858 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:46.573135 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:46.728447 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:46.977274 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.026688 25658 consensus_peers.cc:597] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.086971 25658 consensus_peers.cc:597] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.146039 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:47.277719 25658 consensus_peers.cc:597] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.301229 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:47.328760 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.330636 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:47.362746 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:47.443171 25658 consensus_peers.cc:597] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.459507 25658 consensus_peers.cc:597] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:47.465509 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.506635 25658 consensus_peers.cc:597] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.547569 25658 consensus_peers.cc:597] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.603262 25658 consensus_peers.cc:597] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.639092 25658 consensus_peers.cc:597] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:47.656250 25658 consensus_peers.cc:597] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.688175 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.753067 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:47.767094 25658 consensus_peers.cc:597] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:47.780014 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
W20260709 12:12:47.799109 25658 consensus_peers.cc:597] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.842615 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:12:47.845075 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:47.867750 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:48.014964 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:48.043285 25658 consensus_peers.cc:597] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:48.059719 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
W20260709 12:12:48.095304 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:48.098568 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.116817 26304 consensus_peers.cc:597] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.126999 25732 consensus_peers.cc:597] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.134932 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.135763 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.136624 25658 consensus_peers.cc:597] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:48.137419 25658 consensus_peers.cc:597] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:48.161914 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.193070 25732 consensus_peers.cc:597] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.195336 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.196414 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.196786 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:48.202605 24442 tablet_replica.cc:333] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.203838 24442 raft_consensus.cc:2243] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.205763 24442 raft_consensus.cc:2272] T 594f26e3426243d5b79945733b1f2dd5 P c781e437472a42e2a6162b67b1c7bbbd [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.206619 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:48.210016 24442 tablet_replica.cc:333] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.211426 24442 raft_consensus.cc:2243] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.212368 24442 raft_consensus.cc:2272] T f692b35e5aaf426dbfdc5ec7efe47cc3 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.216200 24442 tablet_replica.cc:333] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.217630 24442 raft_consensus.cc:2243] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.218724 24442 raft_consensus.cc:2272] T d430da6a4c644f538698b570759feb1e P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.221973 24442 tablet_replica.cc:333] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
W20260709 12:12:48.222498 25732 consensus_peers.cc:597] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.223049 24442 raft_consensus.cc:2243] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.224467 24442 raft_consensus.cc:2272] T 3637b70d215243c283e2280b99045ced P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.227236 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.229179 24442 tablet_replica.cc:333] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.230314 24442 raft_consensus.cc:2243] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.231724 24442 raft_consensus.cc:2272] T 481bb8b350a240b0a487c38c13791369 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.235191 24442 tablet_replica.cc:333] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.236212 24442 raft_consensus.cc:2243] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.237581 24442 raft_consensus.cc:2272] T 05b25fb15a3f49599d4e372d287c828a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.241058 24442 tablet_replica.cc:333] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.242095 24442 raft_consensus.cc:2243] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.242930 24442 raft_consensus.cc:2272] T bed4e4bd0407478d9750209db4d90dca P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.246086 25658 consensus_peers.cc:597] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:48.246412 24442 tablet_replica.cc:333] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.247669 24442 raft_consensus.cc:2243] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.248656 24442 raft_consensus.cc:2272] T b28e719d6586469e8c186ce7b5af6bc7 P c781e437472a42e2a6162b67b1c7bbbd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.251868 24442 tablet_replica.cc:333] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
W20260709 12:12:48.252461 25732 consensus_peers.cc:597] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.252861 24442 raft_consensus.cc:2243] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.254206 24442 raft_consensus.cc:2272] T 5de0ecbf35224b6aa22571e4a88d71c0 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.257474 24442 tablet_replica.cc:333] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.258471 24442 raft_consensus.cc:2243] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.259157 24442 raft_consensus.cc:2272] T b1deffe0cca244839dc0d8c35e1c9292 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.262379 24442 tablet_replica.cc:333] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.263302 24442 raft_consensus.cc:2243] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.263975 24442 raft_consensus.cc:2272] T badc1c7146be42a1bb728a36f96a38ab P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.267010 24442 tablet_replica.cc:333] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.267980 24442 raft_consensus.cc:2243] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.269438 24442 raft_consensus.cc:2272] T 969280fd738b40ab84e4cf910d39f1dc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.269723 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.272459 24442 tablet_replica.cc:333] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.273440 24442 raft_consensus.cc:2243] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.274062 24442 raft_consensus.cc:2272] T 34f7287caa8a4b84a342ecc197b9fabc P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.277032 24442 tablet_replica.cc:333] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.277935 24442 raft_consensus.cc:2243] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.278672 24442 raft_consensus.cc:2272] T f44656354a354842bb48b4fd32f2c39b P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.281561 24442 tablet_replica.cc:333] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.282482 24442 raft_consensus.cc:2243] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.283735 24442 raft_consensus.cc:2272] T 7ff1240c7107404994c96234274c5e64 P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.286725 24442 tablet_replica.cc:333] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.287637 24442 raft_consensus.cc:2243] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.288877 24442 raft_consensus.cc:2272] T b57ef007401b4e88884bfaefab8e512b P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.291800 24442 tablet_replica.cc:333] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.292675 24442 raft_consensus.cc:2243] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.293916 24442 raft_consensus.cc:2272] T d5b02303361d43d1903c3e943b866b64 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.296857 24442 tablet_replica.cc:333] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.297796 24442 raft_consensus.cc:2243] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.298662 24442 raft_consensus.cc:2272] T bbb8bd60a08b47bdb117f89304e5dda7 P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.304318 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.307093 24442 tablet_replica.cc:333] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.308200 24442 raft_consensus.cc:2243] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.308945 24442 raft_consensus.cc:2272] T 2842bb8137e14414992e2306de44989b P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.312167 24442 tablet_replica.cc:333] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.313050 24442 raft_consensus.cc:2243] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.314348 24442 raft_consensus.cc:2272] T 085a5eec03e94a80b662d7995cbee18c P c781e437472a42e2a6162b67b1c7bbbd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.317584 24442 tablet_replica.cc:333] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.318543 24442 raft_consensus.cc:2243] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.319854 24442 raft_consensus.cc:2272] T b7b82e0d41f14cc2baa1e889ed4c7312 P c781e437472a42e2a6162b67b1c7bbbd [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.322845 24442 tablet_replica.cc:333] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.323685 24442 raft_consensus.cc:2243] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:12:48.324221 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:48.324867 24442 raft_consensus.cc:2272] T 75613106563e4abcbdf42d2200d80af5 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.328025 24442 tablet_replica.cc:333] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.329247 24442 raft_consensus.cc:2243] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.330628 24442 raft_consensus.cc:2272] T 6c38995c6d4645379acd1dcc03a8a65f P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.334049 24442 tablet_replica.cc:333] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.335021 24442 raft_consensus.cc:2243] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.336298 24442 raft_consensus.cc:2272] T a019a0a19861420b8da3d57b0d23ebbd P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.339522 24442 tablet_replica.cc:333] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.340317 24442 raft_consensus.cc:2243] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.341161 24442 raft_consensus.cc:2272] T a1f7a89fe9fd4bf0b5efc34622f42d69 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.344035 24442 tablet_replica.cc:333] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.344805 24442 raft_consensus.cc:2243] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.345969 24442 raft_consensus.cc:2272] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P c781e437472a42e2a6162b67b1c7bbbd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.348840 24442 tablet_replica.cc:333] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.349628 24442 raft_consensus.cc:2243] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.350342 24442 raft_consensus.cc:2272] T dcdef7196c6a445c945bb47541d7d3ac P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.353565 24442 tablet_replica.cc:333] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.354444 24442 raft_consensus.cc:2243] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.355130 24442 raft_consensus.cc:2272] T 0a4bcd027c7e4c85bf47844eba789061 P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.357888 24442 tablet_replica.cc:333] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.358732 24442 raft_consensus.cc:2243] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.359315 24442 raft_consensus.cc:2272] T fa0600a571a0457f804bf9bf88fd9fd4 P c781e437472a42e2a6162b67b1c7bbbd [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.360046 25658 consensus_peers.cc:597] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:48.362401 24442 tablet_replica.cc:333] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.371392 24442 raft_consensus.cc:2243] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.372356 24442 raft_consensus.cc:2272] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P c781e437472a42e2a6162b67b1c7bbbd [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.376060 24442 tablet_replica.cc:333] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.377190 24442 raft_consensus.cc:2243] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.378610 24442 raft_consensus.cc:2272] T e7414eafc9044de28063237176e3435f P c781e437472a42e2a6162b67b1c7bbbd [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.381112 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.387598 25732 consensus_peers.cc:597] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:48.388936 25732 consensus_peers.cc:597] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.389564 25732 consensus_peers.cc:597] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.395092 24442 tablet_replica.cc:333] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.396154 24442 raft_consensus.cc:2243] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.397404 24442 raft_consensus.cc:2272] T 7a8225ffb62d4087a3a45c98cc24c581 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.400722 24442 tablet_replica.cc:333] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.401602 24442 raft_consensus.cc:2243] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.403126 24442 raft_consensus.cc:2272] T d559aa8dd6d44d11ab56eb9a423319bd P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.407616 25732 consensus_peers.cc:597] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.410483 24442 tablet_replica.cc:333] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.413277 24442 raft_consensus.cc:2243] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.414613 24442 raft_consensus.cc:2272] T 5a8d705bac7f4cac8af41b0b3de03011 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.418042 24442 tablet_replica.cc:333] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.419174 24442 raft_consensus.cc:2243] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.419911 24442 raft_consensus.cc:2272] T e4e477d5c41447338e4490daf6af0473 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.423305 24442 tablet_replica.cc:333] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.424104 24442 raft_consensus.cc:2243] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.425917 24442 raft_consensus.cc:2272] T 84aa327d1e74484291d8031bfc9a9463 P c781e437472a42e2a6162b67b1c7bbbd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.429502 24442 tablet_replica.cc:333] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.430492 24442 raft_consensus.cc:2243] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.431924 24442 raft_consensus.cc:2272] T 0100a4dff40541e38cf6a72d218d3a44 P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.435182 24442 tablet_replica.cc:333] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.436168 24442 raft_consensus.cc:2243] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.436815 24442 raft_consensus.cc:2272] T debca0eda6c649e38d13858860f6a245 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.440047 24442 tablet_replica.cc:333] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.440872 24442 raft_consensus.cc:2243] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:12:48.442085 26304 consensus_peers.cc:597] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.442179 24442 raft_consensus.cc:2272] T b5d5870a1cad42d2813f1ca36a619afe P c781e437472a42e2a6162b67b1c7bbbd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.445853 24442 tablet_replica.cc:333] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.446872 24442 raft_consensus.cc:2243] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.448210 24442 raft_consensus.cc:2272] T 4fcae3b0851948f58bc6dc5970b11943 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.451769 24442 tablet_replica.cc:333] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.452679 24442 raft_consensus.cc:2243] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.453943 24442 raft_consensus.cc:2272] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.457300 24442 tablet_replica.cc:333] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.458298 24442 raft_consensus.cc:2243] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:48.458709 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.459004 24442 raft_consensus.cc:2272] T fca1ee2242e042518b1c8986c3bd8955 P c781e437472a42e2a6162b67b1c7bbbd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.462370 24442 tablet_replica.cc:333] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.463280 24442 raft_consensus.cc:2243] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.463968 24442 raft_consensus.cc:2272] T f944cbb1f9c948d88b377be34146370e P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.466954 24442 tablet_replica.cc:333] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
W20260709 12:12:48.467231 26304 consensus_peers.cc:597] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:48.467777 24442 raft_consensus.cc:2243] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.469097 24442 raft_consensus.cc:2272] T 4081aaa0ccdd4b4bb28382a955fcd9fc P c781e437472a42e2a6162b67b1c7bbbd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.472257 24442 tablet_replica.cc:333] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.473259 24442 raft_consensus.cc:2243] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.475461 24442 raft_consensus.cc:2272] T 66ff605dcfe14eb0bba410038f643c24 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.479331 24442 tablet_replica.cc:333] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.480333 24442 raft_consensus.cc:2243] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:48.481622 24442 raft_consensus.cc:2272] T d3e9aede281f4f4d8ad175c6b2357ddc P c781e437472a42e2a6162b67b1c7bbbd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.484853 24442 tablet_replica.cc:333] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.485562 24442 raft_consensus.cc:2243] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.486791 24442 raft_consensus.cc:2272] T 460a9cbf9985461f9237f09b4f5ca854 P c781e437472a42e2a6162b67b1c7bbbd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.489850 24442 tablet_replica.cc:333] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.490607 24442 raft_consensus.cc:2243] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.491446 24442 raft_consensus.cc:2272] T 60795798854e400987349043af926b8a P c781e437472a42e2a6162b67b1c7bbbd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.494802 24442 tablet_replica.cc:333] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.495738 24442 raft_consensus.cc:2243] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.496447 24442 raft_consensus.cc:2272] T 6225db99ff6d444e990645903f433cf3 P c781e437472a42e2a6162b67b1c7bbbd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:48.499348 24442 tablet_replica.cc:333] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd: stopping tablet replica
I20260709 12:12:48.499958 24442 raft_consensus.cc:2243] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:48.500633 24442 raft_consensus.cc:2272] T 2ba2cd1bc7a14c19bade889bb7b32145 P c781e437472a42e2a6162b67b1c7bbbd [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:48.518549 25732 consensus_peers.cc:597] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.527558 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.544087 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.549779 25732 consensus_peers.cc:597] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.588689 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.595613 25732 consensus_peers.cc:597] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:48.612604 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:48.635236 25732 consensus_peers.cc:597] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:48.644802 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:48.665863 25732 consensus_peers.cc:597] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:48.667439 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:48.729573 25732 consensus_peers.cc:597] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:48.742532 26304 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:48.813972 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:48.843276 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:48.852198 25732 consensus_peers.cc:597] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:48.858875 25732 consensus_peers.cc:597] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:49.268821 25732 consensus_peers.cc:597] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:49.321805 32269 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.322597 32269 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.327301 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:49.329694 32269 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:12:49.330929 25732 leader_election.cc:336] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.331538 25732 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.332311 32269 raft_consensus.cc:2749] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.339643 32269 raft_consensus.cc:493] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.340276 32269 raft_consensus.cc:515] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.342489 32269 leader_election.cc:290] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.343299 25732 consensus_peers.cc:597] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:12:49.351692 25732 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
W20260709 12:12:49.352448 25732 leader_election.cc:336] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.352805 25732 leader_election.cc:304] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.354143 32262 raft_consensus.cc:2749] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:49.373232 26304 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111) [suppressed 528 similar messages]
I20260709 12:12:49.383258 32269 raft_consensus.cc:493] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.383836 32269 raft_consensus.cc:515] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.385809 32269 leader_election.cc:290] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.391633 25732 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.394569 25732 leader_election.cc:336] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.394979 25732 leader_election.cc:304] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.395639 32269 raft_consensus.cc:2749] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:49.415516 32270 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.416225 32270 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.420835 32270 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:49.423003 32270 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
W20260709 12:12:49.423703 26304 leader_election.cc:336] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.423619 32270 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.423961 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:49.424739 25759 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 18.
I20260709 12:12:49.426402 26303 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.426455 32270 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:49.429119 32270 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.429498 32270 raft_consensus.cc:493] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.429864 32270 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.432462 32269 raft_consensus.cc:493] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.433033 32269 raft_consensus.cc:515] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.435282 32269 leader_election.cc:290] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.437034 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
W20260709 12:12:49.441591 25732 leader_election.cc:336] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.444221 25732 leader_election.cc:336] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.444730 25732 leader_election.cc:304] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.445524 32269 raft_consensus.cc:2749] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:49.447044 26304 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.447580 26304 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.448424 32264 raft_consensus.cc:2749] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:49.449167 32270 raft_consensus.cc:515] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.452590 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b25fb15a3f49599d4e372d287c828a" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392"
I20260709 12:12:49.452893 32270 leader_election.cc:290] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:49.453198 25759 raft_consensus.cc:3060] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.457213 32269 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.458637 32262 raft_consensus.cc:493] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.459095 32262 raft_consensus.cc:515] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.460938 32262 leader_election.cc:290] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.457726 32269 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.463527 32269 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:49.466624 32264 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.467214 32264 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.469506 32269 raft_consensus.cc:493] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.470830 32269 raft_consensus.cc:515] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.472966 32269 leader_election.cc:290] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.469849 32262 raft_consensus.cc:493] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.477797 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:49.475092 32264 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:49.478349 32262 raft_consensus.cc:515] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.480988 32262 leader_election.cc:290] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.456815 26304 leader_election.cc:336] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.483412 25759 raft_consensus.cc:2468] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 19.
I20260709 12:12:49.487377 26337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:49.490609 26303 leader_election.cc:304] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.491449 32270 raft_consensus.cc:2804] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:49.492085 32270 raft_consensus.cc:697] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 LEADER]: Becoming Leader. State: Replica: 8481c5f6be5b4faa9fe7c83301759f65, State: Running, Role: LEADER
I20260709 12:12:49.493690 32270 consensus_queue.cc:237] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:49.491242 26304 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.497855 26304 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.498907 32264 raft_consensus.cc:2749] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:49.490836 25732 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.501102 25732 leader_election.cc:336] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.505633 25732 leader_election.cc:304] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:49.508908 25732 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.509459 25732 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 8481c5f6be5b4faa9fe7c83301759f65, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:49.510560 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.511718 32273 raft_consensus.cc:2749] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.512475 32273 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:49.515523 25732 leader_election.cc:336] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.515936 25732 leader_election.cc:304] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:49.516781 25732 leader_election.cc:336] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.516963 32273 raft_consensus.cc:2749] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:49.521520 25732 leader_election.cc:336] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.521972 25732 leader_election.cc:304] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.521998 25516 catalog_manager.cc:5697] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 reported cstate change: term changed from 18 to 19, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132). New cstate: current_term: 19 leader_uuid: "8481c5f6be5b4faa9fe7c83301759f65" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.527488 32271 raft_consensus.cc:2749] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:49.539175 25732 consensus_peers.cc:597] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:49.540670 32273 raft_consensus.cc:493] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.541286 32273 raft_consensus.cc:515] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.543897 32273 leader_election.cc:290] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.554294 25732 leader_election.cc:336] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.555189 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:49.557672 25732 leader_election.cc:336] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.558306 25732 leader_election.cc:304] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.559154 32273 raft_consensus.cc:2749] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:49.566860 32273 raft_consensus.cc:493] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.567520 32273 raft_consensus.cc:515] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.569396 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
I20260709 12:12:49.570020 32273 leader_election.cc:290] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.573881 25732 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.574780 25732 leader_election.cc:336] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.575265 25732 leader_election.cc:304] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.576967 32273 raft_consensus.cc:2749] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:49.605264 32273 raft_consensus.cc:493] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.605830 32273 raft_consensus.cc:515] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.608238 32273 leader_election.cc:290] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.612383 32269 raft_consensus.cc:493] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.612941 32269 raft_consensus.cc:515] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.615572 32262 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.616197 32262 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.618737 32262 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:49.621598 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:49.622473 26332 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 15.
I20260709 12:12:49.623963 25731 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:49.626468 32269 leader_election.cc:290] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.627331 32269 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:49.627768 32269 raft_consensus.cc:493] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.628232 32269 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.638401 32269 raft_consensus.cc:515] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.641417 32269 leader_election.cc:290] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:49.644513 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c38995c6d4645379acd1dcc03a8a65f" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:49.645267 26332 raft_consensus.cc:3060] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:49.645910 25732 leader_election.cc:336] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.647073 25732 leader_election.cc:336] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.647593 25732 leader_election.cc:304] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.651674 32273 raft_consensus.cc:2749] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:49.654973 32262 raft_consensus.cc:493] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.655522 32262 raft_consensus.cc:515] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:49.657378 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:49.657514 32262 leader_election.cc:290] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.665063 25732 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.669396 26332 raft_consensus.cc:2468] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 16.
W20260709 12:12:49.671051 25732 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.671015 25731 leader_election.cc:304] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
I20260709 12:12:49.673250 32269 raft_consensus.cc:2804] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:49.674110 32269 raft_consensus.cc:697] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:49.675194 32269 consensus_queue.cc:237] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:49.676059 25732 leader_election.cc:336] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.679128 25732 leader_election.cc:304] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:49.689054 25732 leader_election.cc:336] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.689318 32273 raft_consensus.cc:2749] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:49.692946 25732 leader_election.cc:336] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.701959 32264 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.702716 32264 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.705255 32264 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:49.706606 32262 raft_consensus.cc:493] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.707158 32262 raft_consensus.cc:515] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.707754 32271 raft_consensus.cc:493] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.708244 32271 raft_consensus.cc:515] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.709079 32262 leader_election.cc:290] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.711160 32273 raft_consensus.cc:493] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.711712 32273 raft_consensus.cc:515] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.710152 32271 leader_election.cc:290] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.713006 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d5870a1cad42d2813f1ca36a619afe" candidate_uuid: "8481c5f6be5b4faa9fe7c83301759f65" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "04e6206f9e924fb3931891bf3a64b392" is_pre_election: true
I20260709 12:12:49.713642 32273 leader_election.cc:290] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.713653 25759 raft_consensus.cc:2468] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8481c5f6be5b4faa9fe7c83301759f65 in term 10.
I20260709 12:12:49.723877 32273 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.724685 32273 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.725605 32270 raft_consensus.cc:493] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.726176 32270 raft_consensus.cc:515] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.727133 32273 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
I20260709 12:12:49.728506 32270 leader_election.cc:290] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.734462 26304 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.721292 25516 catalog_manager.cc:5697] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 15 to 16, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 16 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:49.735140 25732 leader_election.cc:336] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.734632 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65" is_pre_election: true
I20260709 12:12:49.737953 25732 leader_election.cc:304] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.738094 26332 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 13.
I20260709 12:12:49.740854 26303 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.742053 32270 raft_consensus.cc:2804] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:49.742447 32270 raft_consensus.cc:493] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.742811 32270 raft_consensus.cc:3060] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:49.748626 32273 raft_consensus.cc:2749] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:49.760911 25731 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: 
W20260709 12:12:49.762756 25732 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
W20260709 12:12:49.763430 25732 leader_election.cc:336] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.763798 32271 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:49.764353 32271 raft_consensus.cc:493] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.764773 32271 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:49.765002 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
I20260709 12:12:49.767372 32273 raft_consensus.cc:493] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.768033 32273 raft_consensus.cc:515] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:49.768692 25732 leader_election.cc:336] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.769240 25732 leader_election.cc:304] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.770087 32269 raft_consensus.cc:2749] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:49.770480 32273 leader_election.cc:290] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.771345 25732 leader_election.cc:336] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.771883 25732 leader_election.cc:304] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.772835 32262 raft_consensus.cc:2749] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:49.772943 25732 leader_election.cc:336] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.777100 25732 leader_election.cc:336] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.777663 25732 leader_election.cc:304] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.778605 32262 raft_consensus.cc:2749] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:49.779073 25732 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
W20260709 12:12:49.783653 25732 consensus_peers.cc:597] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:49.758781 32270 raft_consensus.cc:515] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.787147 32270 leader_election.cc:290] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:49.760998 26304 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.788470 26304 leader_election.cc:336] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.788928 26304 leader_election.cc:304] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
W20260709 12:12:49.792029 25732 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
W20260709 12:12:49.794203 25732 leader_election.cc:336] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:49.794679 25732 leader_election.cc:304] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.795868 32262 raft_consensus.cc:2749] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:49.792539 32270 raft_consensus.cc:2749] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:49.796718 26303 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Couldn't send request to peer 04e6206f9e924fb3931891bf3a64b392. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.811259 32271 raft_consensus.cc:515] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:49.816387 32271 leader_election.cc:290] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Requested vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 8481c5f6be5b4faa9fe7c83301759f65 (127.23.222.132:39515)
W20260709 12:12:49.816474 26304 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.819151 26332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "481bb8b350a240b0a487c38c13791369" candidate_uuid: "04e6206f9e924fb3931891bf3a64b392" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8481c5f6be5b4faa9fe7c83301759f65"
I20260709 12:12:49.819818 26332 raft_consensus.cc:3060] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:49.822642 26303 leader_election.cc:336] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:49.823154 26303 leader_election.cc:304] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.824244 32270 raft_consensus.cc:2749] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:49.829129 26332 raft_consensus.cc:2468] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04e6206f9e924fb3931891bf3a64b392 in term 14.
I20260709 12:12:49.831193 32262 raft_consensus.cc:493] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.832610 32262 raft_consensus.cc:515] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.834497 32262 leader_election.cc:290] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
W20260709 12:12:49.836576 25732 leader_election.cc:336] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.844296 32262 raft_consensus.cc:493] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.844918 32262 raft_consensus.cc:515] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
I20260709 12:12:49.845765 25731 leader_election.cc:304] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392, 8481c5f6be5b4faa9fe7c83301759f65; no voters: c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.847009 32271 raft_consensus.cc:2804] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:49.847138 32262 leader_election.cc:290] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.848971 32271 raft_consensus.cc:697] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Becoming Leader. State: Replica: 04e6206f9e924fb3931891bf3a64b392, State: Running, Role: LEADER
I20260709 12:12:49.851310 32273 raft_consensus.cc:493] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c781e437472a42e2a6162b67b1c7bbbd)
I20260709 12:12:49.851897 32273 raft_consensus.cc:515] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } }
W20260709 12:12:49.853154 25732 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.854809 25732 leader_election.cc:336] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.853991 32273 leader_election.cc:290] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349)
I20260709 12:12:49.855250 25732 leader_election.cc:304] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.856001 32273 raft_consensus.cc:2749] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.857565 32271 consensus_queue.cc:237] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:49.859659 25732 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.860615 25732 leader_election.cc:336] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.861033 25732 leader_election.cc:304] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.862192 32273 raft_consensus.cc:2749] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.869269 25732 leader_election.cc:336] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
W20260709 12:12:49.869951 25732 leader_election.cc:336] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:49.870406 25732 leader_election.cc:304] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04e6206f9e924fb3931891bf3a64b392; no voters: 56b5d00aa592407c9d5e67a03a961508, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:49.871317 32273 raft_consensus.cc:2749] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.871959 26303 consensus_peers.cc:597] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Couldn't send request to peer 04e6206f9e924fb3931891bf3a64b392. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.885829 25516 catalog_manager.cc:5697] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 reported cstate change: term changed from 13 to 14, leader changed from c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130) to 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131). New cstate: current_term: 14 leader_uuid: "04e6206f9e924fb3931891bf3a64b392" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:49.913064 26303 consensus_peers.cc:597] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Couldn't send request to peer 04e6206f9e924fb3931891bf3a64b392. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.927845 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:49.931660 24442 tablet_replica.cc:333] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.932711 24442 raft_consensus.cc:2243] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.933904 24442 raft_consensus.cc:2272] T f692b35e5aaf426dbfdc5ec7efe47cc3 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.936923 24442 tablet_replica.cc:333] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.937816 24442 raft_consensus.cc:2243] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.938432 24442 raft_consensus.cc:2272] T d430da6a4c644f538698b570759feb1e P 04e6206f9e924fb3931891bf3a64b392 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:49.941129 26303 consensus_peers.cc:597] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Couldn't send request to peer 04e6206f9e924fb3931891bf3a64b392. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.941542 24442 tablet_replica.cc:333] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.942502 24442 raft_consensus.cc:2243] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.944365 24442 raft_consensus.cc:2272] T 05b25fb15a3f49599d4e372d287c828a P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.947314 24442 tablet_replica.cc:333] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.948189 24442 raft_consensus.cc:2243] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.948874 24442 raft_consensus.cc:2272] T 594f26e3426243d5b79945733b1f2dd5 P 04e6206f9e924fb3931891bf3a64b392 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.951923 24442 tablet_replica.cc:333] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.952725 24442 raft_consensus.cc:2243] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.953944 24442 pending_rounds.cc:70] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Trying to abort 1 pending ops.
I20260709 12:12:49.954203 24442 pending_rounds.cc:77] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392: Aborting op as it isn't in flight: id { term: 14 index: 12 } timestamp: 7305622199747330048 op_type: NO_OP noop_request { }
I20260709 12:12:49.954759 24442 raft_consensus.cc:2889] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:49.955098 24442 raft_consensus.cc:2272] T 481bb8b350a240b0a487c38c13791369 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:49.959133 25732 consensus_peers.cc:597] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:49.961371 24442 tablet_replica.cc:333] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.962738 24442 raft_consensus.cc:2243] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.963415 24442 raft_consensus.cc:2272] T 3637b70d215243c283e2280b99045ced P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.966305 24442 tablet_replica.cc:333] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.967272 24442 raft_consensus.cc:2243] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.968005 24442 raft_consensus.cc:2272] T 969280fd738b40ab84e4cf910d39f1dc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.970881 24442 tablet_replica.cc:333] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.971747 24442 raft_consensus.cc:2243] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:12:49.972065 26303 consensus_peers.cc:597] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Couldn't send request to peer 04e6206f9e924fb3931891bf3a64b392. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.972894 24442 raft_consensus.cc:2272] T badc1c7146be42a1bb728a36f96a38ab P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.975984 24442 tablet_replica.cc:333] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.976828 24442 raft_consensus.cc:2243] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.977901 24442 raft_consensus.cc:2272] T 34f7287caa8a4b84a342ecc197b9fabc P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.980597 24442 tablet_replica.cc:333] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.981454 24442 raft_consensus.cc:2243] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.982664 24442 raft_consensus.cc:2272] T f44656354a354842bb48b4fd32f2c39b P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:49.984897 26303 consensus_peers.cc:597] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Couldn't send request to peer 04e6206f9e924fb3931891bf3a64b392. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.985524 24442 tablet_replica.cc:333] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.986456 24442 raft_consensus.cc:2243] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.987257 24442 raft_consensus.cc:2272] T 7ff1240c7107404994c96234274c5e64 P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.990113 24442 tablet_replica.cc:333] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.991003 24442 raft_consensus.cc:2243] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.991601 24442 raft_consensus.cc:2272] T b57ef007401b4e88884bfaefab8e512b P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.994438 24442 tablet_replica.cc:333] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.995272 24442 raft_consensus.cc:2243] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.995942 24442 raft_consensus.cc:2272] T 830afb4bf9c747ab89c652d34a9aedef P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.998744 24442 tablet_replica.cc:333] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:49.999506 24442 raft_consensus.cc:2243] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:49.999958 25732 consensus_peers.cc:597] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:12:50.000067 24442 raft_consensus.cc:2272] T 085a5eec03e94a80b662d7995cbee18c P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.003376 24442 tablet_replica.cc:333] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.004281 24442 raft_consensus.cc:2243] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.004953 24442 raft_consensus.cc:2272] T b7b82e0d41f14cc2baa1e889ed4c7312 P 04e6206f9e924fb3931891bf3a64b392 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.007835 24442 tablet_replica.cc:333] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.008675 24442 raft_consensus.cc:2243] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.009266 24442 raft_consensus.cc:2272] T 75613106563e4abcbdf42d2200d80af5 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.012068 24442 tablet_replica.cc:333] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.012880 24442 raft_consensus.cc:2243] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.013947 24442 raft_consensus.cc:2272] T 2842bb8137e14414992e2306de44989b P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.016611 24442 tablet_replica.cc:333] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.017390 24442 raft_consensus.cc:2243] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.018564 24442 raft_consensus.cc:2272] T bbb8bd60a08b47bdb117f89304e5dda7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.021265 24442 tablet_replica.cc:333] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.022076 24442 raft_consensus.cc:2243] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.022686 24442 raft_consensus.cc:2272] T 9ec1ea6ba3c44e1fb40c2cf3a43f0da6 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.025637 24442 tablet_replica.cc:333] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.026470 24442 raft_consensus.cc:2243] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.027081 24442 raft_consensus.cc:2272] T a019a0a19861420b8da3d57b0d23ebbd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.029804 24442 tablet_replica.cc:333] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.030634 24442 raft_consensus.cc:2243] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.031694 24442 raft_consensus.cc:2272] T a1f7a89fe9fd4bf0b5efc34622f42d69 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.034287 24442 tablet_replica.cc:333] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.035171 24442 raft_consensus.cc:2243] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.036559 24442 pending_rounds.cc:70] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Trying to abort 1 pending ops.
I20260709 12:12:50.036777 24442 pending_rounds.cc:77] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392: Aborting op as it isn't in flight: id { term: 16 index: 13 } timestamp: 7305622199012458496 op_type: NO_OP noop_request { }
I20260709 12:12:50.037117 24442 raft_consensus.cc:2889] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:50.037444 24442 raft_consensus.cc:2272] T 6c38995c6d4645379acd1dcc03a8a65f P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.041020 24442 tablet_replica.cc:333] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.041873 24442 raft_consensus.cc:2243] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.042991 24442 raft_consensus.cc:2272] T dcdef7196c6a445c945bb47541d7d3ac P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.045778 24442 tablet_replica.cc:333] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.046763 24442 raft_consensus.cc:2243] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.047891 24442 raft_consensus.cc:2272] T 0a4bcd027c7e4c85bf47844eba789061 P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.050748 24442 tablet_replica.cc:333] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.051671 24442 raft_consensus.cc:2243] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.052366 24442 raft_consensus.cc:2272] T 0100a4dff40541e38cf6a72d218d3a44 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.055145 24442 tablet_replica.cc:333] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.055871 24442 raft_consensus.cc:2243] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.057127 24442 raft_consensus.cc:2272] T debca0eda6c649e38d13858860f6a245 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.059849 24442 tablet_replica.cc:333] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.060662 24442 raft_consensus.cc:2243] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.061806 24442 raft_consensus.cc:2272] T 20c583a2390b4b6d955b01e778798db7 P 04e6206f9e924fb3931891bf3a64b392 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.064491 24442 tablet_replica.cc:333] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.065465 24442 raft_consensus.cc:2243] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.066177 24442 raft_consensus.cc:2272] T d3e9aede281f4f4d8ad175c6b2357ddc P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.068634 26304 consensus_peers.cc:597] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.069223 24442 tablet_replica.cc:333] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.070173 24442 raft_consensus.cc:2243] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.071504 24442 raft_consensus.cc:2272] T 2103e4c71b8f462bbb8a59f34359b34a P 04e6206f9e924fb3931891bf3a64b392 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.074527 24442 tablet_replica.cc:333] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.075529 24442 raft_consensus.cc:2243] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:50.075728 25732 consensus_peers.cc:597] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:12:50.076336 24442 raft_consensus.cc:2272] T e7414eafc9044de28063237176e3435f P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.079582 24442 tablet_replica.cc:333] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.080490 24442 raft_consensus.cc:2243] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.081141 24442 raft_consensus.cc:2272] T 7a8225ffb62d4087a3a45c98cc24c581 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.084272 24442 tablet_replica.cc:333] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.085137 24442 raft_consensus.cc:2243] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.086493 24442 raft_consensus.cc:2272] T e8ccce4d8eb845e4b0f90ae503e00da5 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.089340 24442 tablet_replica.cc:333] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.090492 24442 raft_consensus.cc:2243] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.091434 24442 raft_consensus.cc:2272] T b5d5870a1cad42d2813f1ca36a619afe P 04e6206f9e924fb3931891bf3a64b392 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.094287 24442 tablet_replica.cc:333] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.095057 24442 raft_consensus.cc:2243] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.096179 24442 raft_consensus.cc:2272] T 2ba2cd1bc7a14c19bade889bb7b32145 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.099015 24442 tablet_replica.cc:333] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.099776 24442 raft_consensus.cc:2243] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.100870 24442 raft_consensus.cc:2272] T 6225db99ff6d444e990645903f433cf3 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.103758 24442 tablet_replica.cc:333] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.104833 24442 raft_consensus.cc:2243] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.106027 24442 raft_consensus.cc:2272] T 60795798854e400987349043af926b8a P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.108986 24442 tablet_replica.cc:333] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.109807 24442 raft_consensus.cc:2243] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.111029 24442 raft_consensus.cc:2272] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 04e6206f9e924fb3931891bf3a64b392 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.113912 24442 tablet_replica.cc:333] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.114718 24442 raft_consensus.cc:2243] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.115896 24442 raft_consensus.cc:2272] T 2eaf15c7f3ab41eea32890f20f50b4fd P 04e6206f9e924fb3931891bf3a64b392 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.119304 24442 tablet_replica.cc:333] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.120113 24442 raft_consensus.cc:2243] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.120853 24442 raft_consensus.cc:2272] T 4fcae3b0851948f58bc6dc5970b11943 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.123610 24442 tablet_replica.cc:333] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.124353 24442 raft_consensus.cc:2243] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.124905 24442 raft_consensus.cc:2272] T 8ec4f9939ba74a4a8a5bcc35720a5e31 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.127471 24442 tablet_replica.cc:333] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.128207 24442 raft_consensus.cc:2243] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.128778 24442 raft_consensus.cc:2272] T fca1ee2242e042518b1c8986c3bd8955 P 04e6206f9e924fb3931891bf3a64b392 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.131596 24442 tablet_replica.cc:333] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.132395 24442 raft_consensus.cc:2243] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.133560 24442 raft_consensus.cc:2272] T f944cbb1f9c948d88b377be34146370e P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.136382 24442 tablet_replica.cc:333] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.137151 24442 raft_consensus.cc:2243] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.137737 24442 raft_consensus.cc:2272] T 4081aaa0ccdd4b4bb28382a955fcd9fc P 04e6206f9e924fb3931891bf3a64b392 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.140306 24442 tablet_replica.cc:333] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.141037 24442 raft_consensus.cc:2243] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.141764 24442 raft_consensus.cc:2272] T d559aa8dd6d44d11ab56eb9a423319bd P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.144512 24442 tablet_replica.cc:333] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.145226 24442 raft_consensus.cc:2243] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.146415 24442 raft_consensus.cc:2272] T e4e477d5c41447338e4490daf6af0473 P 04e6206f9e924fb3931891bf3a64b392 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.149147 24442 tablet_replica.cc:333] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.149837 24442 raft_consensus.cc:2243] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.151396 24442 raft_consensus.cc:2272] T 5a8d705bac7f4cac8af41b0b3de03011 P 04e6206f9e924fb3931891bf3a64b392 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.154201 24442 tablet_replica.cc:333] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.154965 24442 raft_consensus.cc:2243] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.156116 24442 raft_consensus.cc:2272] T 6640372ef1e64554b6b1025b28173499 P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.158754 24442 tablet_replica.cc:333] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.159441 24442 raft_consensus.cc:2243] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:50.160481 24442 raft_consensus.cc:2272] T c287ffad962949a7a7a740c373130b71 P 04e6206f9e924fb3931891bf3a64b392 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.169893 24442 tablet_replica.cc:333] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.170615 24442 raft_consensus.cc:2243] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.171201 24442 raft_consensus.cc:2272] T 84aa327d1e74484291d8031bfc9a9463 P 04e6206f9e924fb3931891bf3a64b392 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:50.173620 24442 tablet_replica.cc:333] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392: stopping tablet replica
I20260709 12:12:50.174437 24442 raft_consensus.cc:2243] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:50.175827 24442 raft_consensus.cc:2272] T 39e6df07fdde400cbbefc675d486ab4a P 04e6206f9e924fb3931891bf3a64b392 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:50.195379 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:12:50.439666 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.461408 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.515893 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:50.519040 26304 consensus_peers.cc:597] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.643883 26304 consensus_peers.cc:597] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.661495 26304 consensus_peers.cc:597] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.710817 26304 consensus_peers.cc:597] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.775583 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.809170 26304 consensus_peers.cc:597] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:12:50.815744 26304 consensus_peers.cc:597] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:50.816525 26304 consensus_peers.cc:597] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:12:50.874997 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.053535 32284 raft_consensus.cc:493] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.054236 32284 raft_consensus.cc:515] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.056625 32284 leader_election.cc:290] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:51.064333 26303 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
W20260709 12:12:51.065090 26304 leader_election.cc:336] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:51.065685 26304 leader_election.cc:304] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:51.066540 32284 raft_consensus.cc:2749] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:51.067186 26304 consensus_peers.cc:597] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.117503 32284 raft_consensus.cc:493] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.118363 32284 raft_consensus.cc:515] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } attrs { replace: true } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.121847 32284 leader_election.cc:290] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:51.127497 26303 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
W20260709 12:12:51.130313 26304 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:51.130909 26304 leader_election.cc:304] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:51.131713 32284 raft_consensus.cc:2749] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:51.132601 26304 leader_election.cc:336] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:51.157764 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:12:51.167251 32270 raft_consensus.cc:493] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.167979 32270 raft_consensus.cc:515] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.170480 32270 leader_election.cc:290] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:51.176198 26304 leader_election.cc:336] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
W20260709 12:12:51.177452 26303 leader_election.cc:336] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
I20260709 12:12:51.177872 26303 leader_election.cc:304] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:51.178750 32270 raft_consensus.cc:2749] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:51.193288 26304 consensus_peers.cc:597] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Couldn't send request to peer c781e437472a42e2a6162b67b1c7bbbd. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:51.234439 32284 raft_consensus.cc:493] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.235131 32284 raft_consensus.cc:515] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.238418 32284 leader_election.cc:290] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:51.251771 26303 leader_election.cc:336] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
W20260709 12:12:51.253046 26304 leader_election.cc:336] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:51.253582 26304 leader_election.cc:304] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:51.254462 32270 raft_consensus.cc:2749] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:51.280715 26304 consensus_peers.cc:597] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:12:51.296465 32270 raft_consensus.cc:493] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.297219 32270 raft_consensus.cc:515] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.299912 32270 leader_election.cc:290] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:51.302304 24442 tablet_server.cc:179] TabletServer@127.23.222.132:0 shutting down...
W20260709 12:12:51.310755 26303 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
W20260709 12:12:51.315958 26304 leader_election.cc:336] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:51.316460 26304 leader_election.cc:304] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:51.317221 32285 raft_consensus.cc:2749] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:51.367805 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:51.369098 24442 tablet_replica.cc:333] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.370101 24442 raft_consensus.cc:2243] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.371012 24442 raft_consensus.cc:2272] T 481bb8b350a240b0a487c38c13791369 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.374538 24442 tablet_replica.cc:333] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.375386 24442 raft_consensus.cc:2243] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.376227 24442 raft_consensus.cc:2272] T 66ff605dcfe14eb0bba410038f643c24 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.379545 24442 tablet_replica.cc:333] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.380432 24442 raft_consensus.cc:2243] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.381238 24442 raft_consensus.cc:2272] T 2842bb8137e14414992e2306de44989b P 8481c5f6be5b4faa9fe7c83301759f65 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.384482 24442 tablet_replica.cc:333] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.385329 24442 raft_consensus.cc:2243] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.386287 24442 raft_consensus.cc:2272] T 6640372ef1e64554b6b1025b28173499 P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.389631 24442 tablet_replica.cc:333] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.390784 24442 raft_consensus.cc:2243] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.392174 24442 raft_consensus.cc:2272] T d430da6a4c644f538698b570759feb1e P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.395455 24442 tablet_replica.cc:333] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.396387 24442 raft_consensus.cc:2243] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.397181 24442 raft_consensus.cc:2272] T 6c38995c6d4645379acd1dcc03a8a65f P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.400393 24442 tablet_replica.cc:333] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.401268 24442 raft_consensus.cc:2243] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.402520 24442 pending_rounds.cc:70] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Trying to abort 1 pending ops.
I20260709 12:12:51.402781 24442 pending_rounds.cc:77] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305622198256816128 op_type: NO_OP noop_request { }
I20260709 12:12:51.403133 24442 raft_consensus.cc:2889] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:51.403462 24442 raft_consensus.cc:2272] T 05b25fb15a3f49599d4e372d287c828a P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.405865 26304 consensus_peers.cc:597] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:51.406623 24442 tablet_replica.cc:333] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.407568 24442 raft_consensus.cc:2243] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.409114 24442 raft_consensus.cc:2272] T bed4e4bd0407478d9750209db4d90dca P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.412637 24442 tablet_replica.cc:333] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.413628 24442 raft_consensus.cc:2243] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.414456 24442 raft_consensus.cc:2272] T 2eaf15c7f3ab41eea32890f20f50b4fd P 8481c5f6be5b4faa9fe7c83301759f65 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.417657 24442 tablet_replica.cc:333] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.418591 24442 raft_consensus.cc:2243] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.419442 24442 raft_consensus.cc:2272] T 5a1b2a1b70ef4f4f93481fcf3c72c5e4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.422529 24442 tablet_replica.cc:333] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.423300 24442 raft_consensus.cc:2243] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.424392 24442 raft_consensus.cc:2272] T fca1ee2242e042518b1c8986c3bd8955 P 8481c5f6be5b4faa9fe7c83301759f65 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.427291 24442 tablet_replica.cc:333] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.428093 24442 raft_consensus.cc:2243] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.429211 24442 raft_consensus.cc:2272] T fa0600a571a0457f804bf9bf88fd9fd4 P 8481c5f6be5b4faa9fe7c83301759f65 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.432152 24442 tablet_replica.cc:333] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.432452 32270 raft_consensus.cc:493] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.433024 24442 raft_consensus.cc:2243] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.433017 32270 raft_consensus.cc:515] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.434414 24442 raft_consensus.cc:2272] T 20c583a2390b4b6d955b01e778798db7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.435307 32270 leader_election.cc:290] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:51.438094 24442 tablet_replica.cc:333] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.438616 32270 raft_consensus.cc:493] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.439082 24442 raft_consensus.cc:2243] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.439237 32270 raft_consensus.cc:515] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c781e437472a42e2a6162b67b1c7bbbd" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 39349 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
I20260709 12:12:51.441020 24442 raft_consensus.cc:2272] T 460a9cbf9985461f9237f09b4f5ca854 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.441200 32285 raft_consensus.cc:493] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 04e6206f9e924fb3931891bf3a64b392)
I20260709 12:12:51.441800 32285 raft_consensus.cc:515] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "56b5d00aa592407c9d5e67a03a961508" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 43875 } } peers { permanent_uuid: "04e6206f9e924fb3931891bf3a64b392" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44413 } } peers { permanent_uuid: "8481c5f6be5b4faa9fe7c83301759f65" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 39515 } attrs { promote: false } }
W20260709 12:12:51.443591 26303 leader_election.cc:336] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
I20260709 12:12:51.444094 32285 leader_election.cc:290] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
I20260709 12:12:51.444430 24442 tablet_replica.cc:333] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
W20260709 12:12:51.444849 26304 leader_election.cc:336] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:51.445350 26304 leader_election.cc:304] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:51.445371 24442 raft_consensus.cc:2243] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.447460 32285 raft_consensus.cc:2706] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Received pre-election callback for term 19 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:12:51.447981 24442 raft_consensus.cc:2272] T 60795798854e400987349043af926b8a P 8481c5f6be5b4faa9fe7c83301759f65 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.446982 32270 leader_election.cc:290] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349), 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413)
W20260709 12:12:51.450024 26303 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
W20260709 12:12:51.452409 26303 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 04e6206f9e924fb3931891bf3a64b392 (127.23.222.131:44413): Network error: Client connection negotiation failed: client connection to 127.23.222.131:44413: connect: Connection refused (error 111)
I20260709 12:12:51.454771 24442 tablet_replica.cc:333] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
W20260709 12:12:51.455334 26304 leader_election.cc:336] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:12:51.455765 26304 leader_election.cc:304] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, 56b5d00aa592407c9d5e67a03a961508
I20260709 12:12:51.455885 24442 raft_consensus.cc:2243] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.456440 32285 raft_consensus.cc:2749] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:51.456861 26304 leader_election.cc:336] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c781e437472a42e2a6162b67b1c7bbbd (127.23.222.130:39349): Network error: Client connection negotiation failed: client connection to 127.23.222.130:39349: connect: Connection refused (error 111)
I20260709 12:12:51.456938 24442 raft_consensus.cc:2272] T b5d5870a1cad42d2813f1ca36a619afe P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.457418 26304 leader_election.cc:304] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8481c5f6be5b4faa9fe7c83301759f65; no voters: 04e6206f9e924fb3931891bf3a64b392, c781e437472a42e2a6162b67b1c7bbbd
I20260709 12:12:51.458091 32285 raft_consensus.cc:2749] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:51.460469 24442 tablet_replica.cc:333] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.461383 24442 raft_consensus.cc:2243] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.462292 24442 raft_consensus.cc:2272] T e8ccce4d8eb845e4b0f90ae503e00da5 P 8481c5f6be5b4faa9fe7c83301759f65 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.465364 24442 tablet_replica.cc:333] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.466192 24442 raft_consensus.cc:2243] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.467406 24442 raft_consensus.cc:2272] T d5b02303361d43d1903c3e943b866b64 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.470638 24442 tablet_replica.cc:333] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.471616 24442 raft_consensus.cc:2243] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.472450 24442 raft_consensus.cc:2272] T 2103e4c71b8f462bbb8a59f34359b34a P 8481c5f6be5b4faa9fe7c83301759f65 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:51.473228 26304 consensus_peers.cc:597] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 -> Peer 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): Couldn't send request to peer 56b5d00aa592407c9d5e67a03a961508. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:12:51.475270 24442 tablet_replica.cc:333] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.475942 24442 raft_consensus.cc:2243] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.476967 24442 raft_consensus.cc:2272] T b1deffe0cca244839dc0d8c35e1c9292 P 8481c5f6be5b4faa9fe7c83301759f65 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.479602 24442 tablet_replica.cc:333] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.480237 24442 raft_consensus.cc:2243] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.480801 24442 raft_consensus.cc:2272] T 5a8d705bac7f4cac8af41b0b3de03011 P 8481c5f6be5b4faa9fe7c83301759f65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.483379 24442 tablet_replica.cc:333] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.483991 24442 raft_consensus.cc:2243] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.484898 24442 raft_consensus.cc:2272] T b7b82e0d41f14cc2baa1e889ed4c7312 P 8481c5f6be5b4faa9fe7c83301759f65 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.487169 24442 tablet_replica.cc:333] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.487814 24442 raft_consensus.cc:2243] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.488461 24442 raft_consensus.cc:2272] T c287ffad962949a7a7a740c373130b71 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.490741 24442 tablet_replica.cc:333] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.491405 24442 raft_consensus.cc:2243] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.492280 24442 raft_consensus.cc:2272] T 39e6df07fdde400cbbefc675d486ab4a P 8481c5f6be5b4faa9fe7c83301759f65 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.494727 24442 tablet_replica.cc:333] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.495337 24442 raft_consensus.cc:2243] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.496345 24442 raft_consensus.cc:2272] T 5de0ecbf35224b6aa22571e4a88d71c0 P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.498862 24442 tablet_replica.cc:333] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.499430 24442 raft_consensus.cc:2243] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.500303 24442 raft_consensus.cc:2272] T b28e719d6586469e8c186ce7b5af6bc7 P 8481c5f6be5b4faa9fe7c83301759f65 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.502574 24442 tablet_replica.cc:333] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.503135 24442 raft_consensus.cc:2243] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:51.503710 24442 raft_consensus.cc:2272] T badc1c7146be42a1bb728a36f96a38ab P 8481c5f6be5b4faa9fe7c83301759f65 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.506470 24442 tablet_replica.cc:333] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.507020 24442 raft_consensus.cc:2243] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.507917 24442 raft_consensus.cc:2272] T d95d45dfde7e4e1ea3a9df8d3a6c8ede P 8481c5f6be5b4faa9fe7c83301759f65 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.510422 24442 tablet_replica.cc:333] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65: stopping tablet replica
I20260709 12:12:51.510953 24442 raft_consensus.cc:2243] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:51.512183 24442 raft_consensus.cc:2272] T 830afb4bf9c747ab89c652d34a9aedef P 8481c5f6be5b4faa9fe7c83301759f65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:51.922693 24442 tablet_server.cc:196] TabletServer@127.23.222.132:0 shutdown complete.
I20260709 12:12:51.988039 24442 master.cc:562] Master@127.23.222.190:33735 shutting down...
W20260709 12:12:52.852571 25548 debug-util.cc:398] Leaking SignalData structure 0x7b0800174820 after lost signal to thread 24445
W20260709 12:12:52.853899 25548 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2e40 after lost signal to thread 25551
W20260709 12:13:00.584445 25502 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111) [suppressed 224 similar messages]
W20260709 12:13:00.588816 25502 catalog_manager.cc:4755] TS 56b5d00aa592407c9d5e67a03a961508 (127.23.222.129:43875): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 481bb8b350a240b0a487c38c13791369: Network error: Client connection negotiation failed: client connection to 127.23.222.129:43875: connect: Connection refused (error 111)
I20260709 12:13:00.767699 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:00.768767 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:00.769133 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P 522441a6317141cea1e624f44af51018: stopping tablet replica
I20260709 12:13:01.000520 24442 master.cc:584] Master@127.23.222.190:33735 shutdown complete.
I20260709 12:13:01.061043 24442 test_util.cc:182] -----------------------------------------------
I20260709 12:13:01.061303 24442 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894803819-24442-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (225165 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:13:01.065411 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:41543
I20260709 12:13:01.066838 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:01.075182 32290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.074954 32292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.074926 32289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.078851 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:01.084046 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:01.084383 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:01.084579 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599181084555 us; error 0 us; skew 500 ppm
I20260709 12:13:01.085199 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:01.088301 24442 webserver.cc:533] Webserver started at http://127.23.222.190:33575/ using document root <none> and password file <none>
I20260709 12:13:01.088884 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:01.089108 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:01.089424 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:01.090970 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "468c04fd684147d397b43a0e496059ff"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.096388 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:01.101116 32297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.102068 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:01.102489 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "468c04fd684147d397b43a0e496059ff"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.102851 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:01.142481 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:01.144169 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:01.193255 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:41543
I20260709 12:13:01.193392 32348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:41543 every 8 connection(s)
I20260709 12:13:01.198571 32349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:01.210211 32349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff: Bootstrap starting.
I20260709 12:13:01.215396 32349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:01.220397 32349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff: No bootstrap required, opened a new log
I20260709 12:13:01.222956 32349 raft_consensus.cc:359] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468c04fd684147d397b43a0e496059ff" member_type: VOTER }
I20260709 12:13:01.223434 32349 raft_consensus.cc:385] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:01.223659 32349 raft_consensus.cc:740] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 468c04fd684147d397b43a0e496059ff, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.224311 32349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468c04fd684147d397b43a0e496059ff" member_type: VOTER }
I20260709 12:13:01.224797 32349 raft_consensus.cc:399] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:01.225029 32349 raft_consensus.cc:493] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:01.225275 32349 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:01.230051 32349 raft_consensus.cc:515] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468c04fd684147d397b43a0e496059ff" member_type: VOTER }
I20260709 12:13:01.230702 32349 leader_election.cc:304] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 468c04fd684147d397b43a0e496059ff; no voters: 
I20260709 12:13:01.232087 32349 leader_election.cc:290] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:01.232580 32352 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:01.234222 32352 raft_consensus.cc:697] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 1 LEADER]: Becoming Leader. State: Replica: 468c04fd684147d397b43a0e496059ff, State: Running, Role: LEADER
I20260709 12:13:01.235061 32352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468c04fd684147d397b43a0e496059ff" member_type: VOTER }
I20260709 12:13:01.235652 32349 sys_catalog.cc:565] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:01.244453 32354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 468c04fd684147d397b43a0e496059ff. Latest consensus state: current_term: 1 leader_uuid: "468c04fd684147d397b43a0e496059ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468c04fd684147d397b43a0e496059ff" member_type: VOTER } }
I20260709 12:13:01.244697 32353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "468c04fd684147d397b43a0e496059ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "468c04fd684147d397b43a0e496059ff" member_type: VOTER } }
I20260709 12:13:01.245419 32354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:01.245478 32353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:01.247852 32362 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:01.253863 32362 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:01.255148 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:01.264415 32362 catalog_manager.cc:1383] Generated new cluster ID: cd21aeef97664082b53ee135c5ececdf
I20260709 12:13:01.264810 32362 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:01.280095 32362 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:01.281653 32362 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:01.300565 32362 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff: Generated new TSK 0
I20260709 12:13:01.301403 32362 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:01.323189 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:01.332019 32370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.333068 32371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.335330 32373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.336277 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:01.339226 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:01.339494 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:01.339627 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599181339614 us; error 0 us; skew 500 ppm
I20260709 12:13:01.340539 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:01.343592 24442 webserver.cc:533] Webserver started at http://127.23.222.129:33781/ using document root <none> and password file <none>
I20260709 12:13:01.344110 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:01.344457 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:01.344852 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:01.346225 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "51f23763442f4ea3a702c32e00616cb0"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.352234 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:13:01.356351 32378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.357218 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:01.357575 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "51f23763442f4ea3a702c32e00616cb0"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.357903 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:01.376535 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:01.378065 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:01.380017 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:01.383399 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:01.383667 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.383955 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:01.384146 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.441485 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:40497
I20260709 12:13:01.441598 32440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:40497 every 8 connection(s)
I20260709 12:13:01.448277 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:01.458209 32445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.459185 32446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.461172 32448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.463771 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:01.467463 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:01.467701 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:01.467923 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599181467904 us; error 0 us; skew 500 ppm
I20260709 12:13:01.468639 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:01.471778 24442 webserver.cc:533] Webserver started at http://127.23.222.130:37153/ using document root <none> and password file <none>
I20260709 12:13:01.472481 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:01.472726 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:01.473062 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:01.475330 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "b2729a5e5b834a958c61bb5487a0c22c"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.475696 32441 heartbeater.cc:344] Connected to a master server at 127.23.222.190:41543
I20260709 12:13:01.476157 32441 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:01.477046 32441 heartbeater.cc:507] Master 127.23.222.190:41543 requested a full tablet report, sending...
I20260709 12:13:01.479825 32314 ts_manager.cc:194] Registered new tserver with Master: 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:01.481269 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:01.482115 32314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34444
I20260709 12:13:01.485893 32453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.486995 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:01.487290 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "b2729a5e5b834a958c61bb5487a0c22c"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.487569 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:01.510447 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:01.511902 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:01.513633 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:01.516754 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:01.516957 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.517318 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:01.517465 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.569957 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:43389
I20260709 12:13:01.570091 32515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:43389 every 8 connection(s)
I20260709 12:13:01.575749 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:01.585300 32519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.585760 32520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.589468 24442 server_base.cc:1061] running on GCE node
W20260709 12:13:01.590240 32522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.591476 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:13:01.591553 32516 heartbeater.cc:344] Connected to a master server at 127.23.222.190:41543
W20260709 12:13:01.591756 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:01.592052 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599181592024 us; error 0 us; skew 500 ppm
I20260709 12:13:01.592120 32516 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:01.592756 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:01.593360 32516 heartbeater.cc:507] Master 127.23.222.190:41543 requested a full tablet report, sending...
I20260709 12:13:01.596279 24442 webserver.cc:533] Webserver started at http://127.23.222.131:45719/ using document root <none> and password file <none>
I20260709 12:13:01.596302 32314 ts_manager.cc:194] Registered new tserver with Master: b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:01.597066 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:01.597339 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:01.597662 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:01.598472 32314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34456
I20260709 12:13:01.599272 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "22a81a2a176240d78cb878810a3d56b5"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.605175 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:01.609580 32527 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.610611 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:01.610949 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "22a81a2a176240d78cb878810a3d56b5"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.611220 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:01.637427 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:01.639187 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:01.641121 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:01.644263 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:01.644600 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.644904 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:01.645112 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.696914 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:33379
I20260709 12:13:01.697237 32589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:33379 every 8 connection(s)
I20260709 12:13:01.702767 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:01.712182 32593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.715117 32594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.716094 32590 heartbeater.cc:344] Connected to a master server at 127.23.222.190:41543
I20260709 12:13:01.716722 32590 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:01.718014 32590 heartbeater.cc:507] Master 127.23.222.190:41543 requested a full tablet report, sending...
W20260709 12:13:01.718818 32596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.719897 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:01.720561 32314 ts_manager.cc:194] Registered new tserver with Master: 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:01.721262 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:01.721671 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:01.721884 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599181721860 us; error 0 us; skew 500 ppm
I20260709 12:13:01.722420 32314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34468
I20260709 12:13:01.722662 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:01.726217 24442 webserver.cc:533] Webserver started at http://127.23.222.132:36179/ using document root <none> and password file <none>
I20260709 12:13:01.726856 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:01.727077 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:01.727401 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:01.728806 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-3-root/instance:
uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.733922 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:01.738474 32601 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.739518 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:01.739859 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-3-root
uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:01.740181 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:01.759534 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:01.761209 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:01.762780 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:01.765403 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:01.765676 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.765962 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:01.766160 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.823997 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.132:36207
I20260709 12:13:01.824150 32663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.132:36207 every 8 connection(s)
I20260709 12:13:01.841616 32664 heartbeater.cc:344] Connected to a master server at 127.23.222.190:41543
I20260709 12:13:01.842229 32664 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:01.843220 32664 heartbeater.cc:507] Master 127.23.222.190:41543 requested a full tablet report, sending...
I20260709 12:13:01.845679 32314 ts_manager.cc:194] Registered new tserver with Master: 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:01.846228 24442 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018470565s
I20260709 12:13:01.847548 32314 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34474
I20260709 12:13:01.879029 32314 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34486:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:13:02.164345 32629 tablet_service.cc:1511] Processing CreateTablet for tablet 0d77a8828de54acbb915f5d831758a82 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:02.170539 32481 tablet_service.cc:1511] Processing CreateTablet for tablet ffe193066934411da2b11565c9080849 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:02.172297 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe193066934411da2b11565c9080849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.174453 32477 tablet_service.cc:1511] Processing CreateTablet for tablet 44a4a0eeeeed495daa87b1a26cd67b0c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:02.176290 32477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a4a0eeeeed495daa87b1a26cd67b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.175918 32554 tablet_service.cc:1511] Processing CreateTablet for tablet ffe193066934411da2b11565c9080849 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:02.177652 32554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe193066934411da2b11565c9080849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.179188 32550 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb4854351aa4a79bb253ee589d7f204 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:02.179610 32478 tablet_service.cc:1511] Processing CreateTablet for tablet 06b9cf0a93e546baaa54ea1b0262ced2 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:02.180639 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb4854351aa4a79bb253ee589d7f204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.181202 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b9cf0a93e546baaa54ea1b0262ced2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.180894 32552 tablet_service.cc:1511] Processing CreateTablet for tablet 06b9cf0a93e546baaa54ea1b0262ced2 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:02.182371 32552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b9cf0a93e546baaa54ea1b0262ced2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.183575 32479 tablet_service.cc:1511] Processing CreateTablet for tablet cb64ed4d5ede43d7a1a18158c71fa6e9 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:02.174487 32555 tablet_service.cc:1511] Processing CreateTablet for tablet 0d77a8828de54acbb915f5d831758a82 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:02.186718 32480 tablet_service.cc:1511] Processing CreateTablet for tablet 0db16bbcbab34732ad62610122fd4ddd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:02.179610 32553 tablet_service.cc:1511] Processing CreateTablet for tablet cb64ed4d5ede43d7a1a18158c71fa6e9 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:02.188853 32549 tablet_service.cc:1511] Processing CreateTablet for tablet 6017d03fcc5c4811bf6139c2858334c1 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:02.189479 32553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb64ed4d5ede43d7a1a18158c71fa6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.190459 32549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017d03fcc5c4811bf6139c2858334c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.191078 32475 tablet_service.cc:1511] Processing CreateTablet for tablet 6017d03fcc5c4811bf6139c2858334c1 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:02.191675 32476 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb4854351aa4a79bb253ee589d7f204 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:02.177228 32551 tablet_service.cc:1511] Processing CreateTablet for tablet c3105a924eb24b24ad8e380d6d3d0ce8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:02.193799 32551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3105a924eb24b24ad8e380d6d3d0ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.194236 32474 tablet_service.cc:1511] Processing CreateTablet for tablet a4179064b9784670ae3b11664ecb7205 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:02.197149 32629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d77a8828de54acbb915f5d831758a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.196837 32548 tablet_service.cc:1511] Processing CreateTablet for tablet a4aab3c02fcc4c58932074e364ed6a3a (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:02.197307 32473 tablet_service.cc:1511] Processing CreateTablet for tablet c29f3259972241c7bafe8cef3a1a0acd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:02.198890 32548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4aab3c02fcc4c58932074e364ed6a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.200171 32472 tablet_service.cc:1511] Processing CreateTablet for tablet 742b68eafd5b45f688f8cfcabc3fa421 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:02.202828 32547 tablet_service.cc:1511] Processing CreateTablet for tablet c29f3259972241c7bafe8cef3a1a0acd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:02.204715 32555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d77a8828de54acbb915f5d831758a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.205545 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29f3259972241c7bafe8cef3a1a0acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.209553 32479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb64ed4d5ede43d7a1a18158c71fa6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.211648 32546 tablet_service.cc:1511] Processing CreateTablet for tablet 742b68eafd5b45f688f8cfcabc3fa421 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:02.213423 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 742b68eafd5b45f688f8cfcabc3fa421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.230485 32624 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb4854351aa4a79bb253ee589d7f204 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:02.231621 32627 tablet_service.cc:1511] Processing CreateTablet for tablet cb64ed4d5ede43d7a1a18158c71fa6e9 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:02.232405 32624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb4854351aa4a79bb253ee589d7f204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.233145 32627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb64ed4d5ede43d7a1a18158c71fa6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.233960 32406 tablet_service.cc:1511] Processing CreateTablet for tablet 0d77a8828de54acbb915f5d831758a82 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:02.235543 32406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d77a8828de54acbb915f5d831758a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.235630 32626 tablet_service.cc:1511] Processing CreateTablet for tablet 44a4a0eeeeed495daa87b1a26cd67b0c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:02.238157 32628 tablet_service.cc:1511] Processing CreateTablet for tablet 0db16bbcbab34732ad62610122fd4ddd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:02.239457 32623 tablet_service.cc:1511] Processing CreateTablet for tablet a4179064b9784670ae3b11664ecb7205 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:02.243678 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a4a0eeeeed495daa87b1a26cd67b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.243386 32621 tablet_service.cc:1511] Processing CreateTablet for tablet c29f3259972241c7bafe8cef3a1a0acd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:02.244853 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29f3259972241c7bafe8cef3a1a0acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.241847 32622 tablet_service.cc:1511] Processing CreateTablet for tablet a4aab3c02fcc4c58932074e364ed6a3a (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:02.246302 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4aab3c02fcc4c58932074e364ed6a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.241813 32625 tablet_service.cc:1511] Processing CreateTablet for tablet c3105a924eb24b24ad8e380d6d3d0ce8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
W20260709 12:13:02.249208 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:02.251078 32620 tablet_service.cc:1511] Processing CreateTablet for tablet 5c526ec290504c2cb183b2a374401881 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:02.251000 32628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db16bbcbab34732ad62610122fd4ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.271880 32620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c526ec290504c2cb183b2a374401881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.272706 32405 tablet_service.cc:1511] Processing CreateTablet for tablet ffe193066934411da2b11565c9080849 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:02.274345 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe193066934411da2b11565c9080849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.279073 32625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3105a924eb24b24ad8e380d6d3d0ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.282635 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4179064b9784670ae3b11664ecb7205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.284528 32404 tablet_service.cc:1511] Processing CreateTablet for tablet 0db16bbcbab34732ad62610122fd4ddd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:02.286867 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 6017d03fcc5c4811bf6139c2858334c1 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:02.287429 32403 tablet_service.cc:1511] Processing CreateTablet for tablet 06b9cf0a93e546baaa54ea1b0262ced2 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:02.288569 32397 tablet_service.cc:1511] Processing CreateTablet for tablet 742b68eafd5b45f688f8cfcabc3fa421 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:02.290022 32402 tablet_service.cc:1511] Processing CreateTablet for tablet 44a4a0eeeeed495daa87b1a26cd67b0c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:02.290383 32472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 742b68eafd5b45f688f8cfcabc3fa421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.292532 32401 tablet_service.cc:1511] Processing CreateTablet for tablet c3105a924eb24b24ad8e380d6d3d0ce8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:02.295096 32398 tablet_service.cc:1511] Processing CreateTablet for tablet a4aab3c02fcc4c58932074e364ed6a3a (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:02.296415 32404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db16bbcbab34732ad62610122fd4ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.297202 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017d03fcc5c4811bf6139c2858334c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.299213 32399 tablet_service.cc:1511] Processing CreateTablet for tablet a4179064b9784670ae3b11664ecb7205 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:02.300621 32399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4179064b9784670ae3b11664ecb7205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.301425 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 742b68eafd5b45f688f8cfcabc3fa421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.306589 32476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb4854351aa4a79bb253ee589d7f204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.316443 32473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29f3259972241c7bafe8cef3a1a0acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.327818 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db16bbcbab34732ad62610122fd4ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.334555 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3105a924eb24b24ad8e380d6d3d0ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.352415 32629 tablet_service.cc:1511] Processing CreateTablet for tablet 6938102bc7ee4183b10405f4f5a64ea8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:02.348107 32626 tablet_service.cc:1511] Processing CreateTablet for tablet 04ab32935e4b45bbba4aad698d4ec782 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:02.359243 32684 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:02.363037 32474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4179064b9784670ae3b11664ecb7205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.368705 32629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6938102bc7ee4183b10405f4f5a64ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.399415 32547 tablet_service.cc:1511] Processing CreateTablet for tablet 04ab32935e4b45bbba4aad698d4ec782 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:02.401079 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ab32935e4b45bbba4aad698d4ec782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.403467 32621 tablet_service.cc:1511] Processing CreateTablet for tablet 77a5f824f56a4e53b1594064803caed0 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:02.404994 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a5f824f56a4e53b1594064803caed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.405077 32475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6017d03fcc5c4811bf6139c2858334c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.414179 32481 tablet_service.cc:1511] Processing CreateTablet for tablet 5c526ec290504c2cb183b2a374401881 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:02.415760 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c526ec290504c2cb183b2a374401881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.373674 32403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b9cf0a93e546baaa54ea1b0262ced2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.440753 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a4a0eeeeed495daa87b1a26cd67b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.439671 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ab32935e4b45bbba4aad698d4ec782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.448316 32478 tablet_service.cc:1511] Processing CreateTablet for tablet b6ff9d1de2ed4684838a43a1803e9ccd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:02.449967 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ff9d1de2ed4684838a43a1803e9ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.454449 32620 tablet_service.cc:1511] Processing CreateTablet for tablet bbfc9fe93f5a498db41f61396d176cc8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:02.456046 32620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfc9fe93f5a498db41f61396d176cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.455717 32622 tablet_service.cc:1511] Processing CreateTablet for tablet 4fca74c83e8b4439b6ce7442ee076351 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:02.466828 32685 tablet_bootstrap.cc:492] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:02.467590 32406 tablet_service.cc:1511] Processing CreateTablet for tablet 5c526ec290504c2cb183b2a374401881 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:02.470026 32477 tablet_service.cc:1511] Processing CreateTablet for tablet 849d745295ee45abb8a522d542819654 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:02.470090 32554 tablet_service.cc:1511] Processing CreateTablet for tablet bbfc9fe93f5a498db41f61396d176cc8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:02.471604 32477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849d745295ee45abb8a522d542819654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.471673 32554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfc9fe93f5a498db41f61396d176cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.473886 32627 tablet_service.cc:1511] Processing CreateTablet for tablet 849d745295ee45abb8a522d542819654 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:02.437435 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 04ab32935e4b45bbba4aad698d4ec782 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:02.476991 32548 tablet_service.cc:1511] Processing CreateTablet for tablet b6ff9d1de2ed4684838a43a1803e9ccd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:02.478499 32548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ff9d1de2ed4684838a43a1803e9ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.479240 32479 tablet_service.cc:1511] Processing CreateTablet for tablet bbfc9fe93f5a498db41f61396d176cc8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:02.480635 32479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfc9fe93f5a498db41f61396d176cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.480744 32686 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:02.482628 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4aab3c02fcc4c58932074e364ed6a3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.484102 32406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c526ec290504c2cb183b2a374401881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.485339 32441 heartbeater.cc:499] Master 127.23.222.190:41543 was elected leader, sending a full tablet report...
I20260709 12:13:02.486384 32687 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:02.491436 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ab32935e4b45bbba4aad698d4ec782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.496600 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca74c83e8b4439b6ce7442ee076351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.498492 32552 tablet_service.cc:1511] Processing CreateTablet for tablet 7044cb8c255c4809b2a90cfe5ab09f03 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:02.500308 32552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7044cb8c255c4809b2a90cfe5ab09f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.505573 32627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849d745295ee45abb8a522d542819654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.504675 32472 tablet_service.cc:1511] Processing CreateTablet for tablet 6938102bc7ee4183b10405f4f5a64ea8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:02.506023 32550 tablet_service.cc:1511] Processing CreateTablet for tablet 849d745295ee45abb8a522d542819654 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:02.525156 32685 tablet_bootstrap.cc:654] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.530519 32623 tablet_service.cc:1511] Processing CreateTablet for tablet 81fcb8b26b8c4216b02b917f1868b9f6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:02.532527 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fcb8b26b8c4216b02b917f1868b9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.484794 32546 tablet_service.cc:1511] Processing CreateTablet for tablet 77a5f824f56a4e53b1594064803caed0 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:02.506949 32472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6938102bc7ee4183b10405f4f5a64ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.577950 32405 tablet_service.cc:1511] Processing CreateTablet for tablet b6ff9d1de2ed4684838a43a1803e9ccd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:02.579447 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ff9d1de2ed4684838a43a1803e9ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.592350 32473 tablet_service.cc:1511] Processing CreateTablet for tablet 7044cb8c255c4809b2a90cfe5ab09f03 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:02.593984 32473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7044cb8c255c4809b2a90cfe5ab09f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.597679 32551 tablet_service.cc:1511] Processing CreateTablet for tablet 81fcb8b26b8c4216b02b917f1868b9f6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:02.639356 32555 tablet_service.cc:1511] Processing CreateTablet for tablet 5316a99ba60a464aba3539ee4660a867 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:02.601514 32516 heartbeater.cc:499] Master 127.23.222.190:41543 was elected leader, sending a full tablet report...
I20260709 12:13:02.606601 32625 tablet_service.cc:1511] Processing CreateTablet for tablet 83e414e6422547db852244112d5dd011 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:02.644613 32624 tablet_service.cc:1511] Processing CreateTablet for tablet 5316a99ba60a464aba3539ee4660a867 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:02.646063 32397 tablet_service.cc:1511] Processing CreateTablet for tablet 77a5f824f56a4e53b1594064803caed0 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:02.609055 32403 tablet_service.cc:1511] Processing CreateTablet for tablet 6938102bc7ee4183b10405f4f5a64ea8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:02.613154 32684 tablet_bootstrap.cc:654] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.617306 32553 tablet_service.cc:1511] Processing CreateTablet for tablet 83e414e6422547db852244112d5dd011 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:02.623831 32474 tablet_service.cc:1511] Processing CreateTablet for tablet 4fca74c83e8b4439b6ce7442ee076351 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:02.626892 32549 tablet_service.cc:1511] Processing CreateTablet for tablet 952141f15b834977950b348862ca5603 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:02.634290 32628 tablet_service.cc:1511] Processing CreateTablet for tablet 70f9e9a08efa4169b31414570a994868 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:02.600683 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 849d745295ee45abb8a522d542819654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.607758 32687 tablet_bootstrap.cc:654] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.648577 32686 tablet_bootstrap.cc:654] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:02.653800 32481 tablet_service.cc:1511] Processing CreateTablet for tablet 83e414e6422547db852244112d5dd011 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:02.655599 32398 tablet_service.cc:1511] Processing CreateTablet for tablet 7044cb8c255c4809b2a90cfe5ab09f03 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:02.657696 32477 tablet_service.cc:1511] Processing CreateTablet for tablet 952141f15b834977950b348862ca5603 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:02.660105 32625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e414e6422547db852244112d5dd011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.678917 32403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6938102bc7ee4183b10405f4f5a64ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.682928 32553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e414e6422547db852244112d5dd011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.683610 32406 tablet_service.cc:1511] Processing CreateTablet for tablet 4fca74c83e8b4439b6ce7442ee076351 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:02.685118 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7044cb8c255c4809b2a90cfe5ab09f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.687407 32624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5316a99ba60a464aba3539ee4660a867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.689973 32628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f9e9a08efa4169b31414570a994868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.687289 32555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5316a99ba60a464aba3539ee4660a867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.693118 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a5f824f56a4e53b1594064803caed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.695369 32551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fcb8b26b8c4216b02b917f1868b9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.709059 32549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952141f15b834977950b348862ca5603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.717607 32474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca74c83e8b4439b6ce7442ee076351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.689870 32402 tablet_service.cc:1511] Processing CreateTablet for tablet 81fcb8b26b8c4216b02b917f1868b9f6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:02.722882 32477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952141f15b834977950b348862ca5603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.725430 32590 heartbeater.cc:499] Master 127.23.222.190:41543 was elected leader, sending a full tablet report...
I20260709 12:13:02.731297 32475 tablet_service.cc:1511] Processing CreateTablet for tablet f17317629dbe497ca572ad72ffb1249f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:02.732792 32547 tablet_service.cc:1511] Processing CreateTablet for tablet f17317629dbe497ca572ad72ffb1249f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:02.739854 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e414e6422547db852244112d5dd011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.743994 32685 tablet_bootstrap.cc:492] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:02.744623 32685 ts_tablet_manager.cc:1403] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.278s	user 0.008s	sys 0.014s
I20260709 12:13:02.757661 32404 tablet_service.cc:1511] Processing CreateTablet for tablet 952141f15b834977950b348862ca5603 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:02.770851 32475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17317629dbe497ca572ad72ffb1249f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.734144 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17317629dbe497ca572ad72ffb1249f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.774456 32622 tablet_service.cc:1511] Processing CreateTablet for tablet 5be4cc379dc24cf4aa09e4242241c03f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:02.775982 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be4cc379dc24cf4aa09e4242241c03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.776240 32626 tablet_service.cc:1511] Processing CreateTablet for tablet 11a8671dc5b3469c99a2ac31a6c25e5c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:02.777645 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a8671dc5b3469c99a2ac31a6c25e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.721614 32406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca74c83e8b4439b6ce7442ee076351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.789306 32686 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:02.791172 32627 tablet_service.cc:1511] Processing CreateTablet for tablet f17317629dbe497ca572ad72ffb1249f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:02.793079 32627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17317629dbe497ca572ad72ffb1249f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.795523 32401 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9e92d778004203bc647bbdae1a3e28 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:02.800032 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a5f824f56a4e53b1594064803caed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.799665 32405 tablet_service.cc:1511] Processing CreateTablet for tablet 11a8671dc5b3469c99a2ac31a6c25e5c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:02.790122 32686 ts_tablet_manager.cc:1403] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.310s	user 0.010s	sys 0.022s
I20260709 12:13:02.807231 32404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952141f15b834977950b348862ca5603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.807623 32399 tablet_service.cc:1511] Processing CreateTablet for tablet 70f9e9a08efa4169b31414570a994868 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:02.798844 32476 tablet_service.cc:1511] Processing CreateTablet for tablet 70f9e9a08efa4169b31414570a994868 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:02.822902 32480 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9e92d778004203bc647bbdae1a3e28 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:02.823535 32685 raft_consensus.cc:359] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:02.824414 32685 raft_consensus.cc:385] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.824622 32476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f9e9a08efa4169b31414570a994868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.824764 32685 raft_consensus.cc:740] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.827652 32686 raft_consensus.cc:359] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:02.828451 32686 raft_consensus.cc:385] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.828756 32686 raft_consensus.cc:740] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.837988 32478 tablet_service.cc:1511] Processing CreateTablet for tablet 11a8671dc5b3469c99a2ac31a6c25e5c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:02.839498 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a8671dc5b3469c99a2ac31a6c25e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.824533 32684 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:02.842332 32684 ts_tablet_manager.cc:1403] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.484s	user 0.016s	sys 0.007s
I20260709 12:13:02.843199 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9e92d778004203bc647bbdae1a3e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.809738 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 5316a99ba60a464aba3539ee4660a867 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:02.851480 32664 heartbeater.cc:499] Master 127.23.222.190:41543 was elected leader, sending a full tablet report...
I20260709 12:13:02.863283 32685 consensus_queue.cc:260] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:02.866725 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fcb8b26b8c4216b02b917f1868b9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.867945 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9e92d778004203bc647bbdae1a3e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.868793 32399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f9e9a08efa4169b31414570a994868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.869477 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5316a99ba60a464aba3539ee4660a867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.871548 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a8671dc5b3469c99a2ac31a6c25e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.895444 32621 tablet_service.cc:1511] Processing CreateTablet for tablet b91b8d6a020d469ba3542974ba93b7a6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:02.895864 32684 raft_consensus.cc:359] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:02.896306 32472 tablet_service.cc:1511] Processing CreateTablet for tablet b91b8d6a020d469ba3542974ba93b7a6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:02.897111 32684 raft_consensus.cc:385] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:02.897246 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91b8d6a020d469ba3542974ba93b7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.897548 32684 raft_consensus.cc:740] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:02.913203 32554 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9e92d778004203bc647bbdae1a3e28 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:02.939675 32554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9e92d778004203bc647bbdae1a3e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.939388 32684 consensus_queue.cc:260] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:02.944813 32685 ts_tablet_manager.cc:1434] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.200s	user 0.007s	sys 0.004s
I20260709 12:13:02.945513 32687 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:02.829550 32686 consensus_queue.cc:260] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:02.946063 32685 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:02.950580 32548 tablet_service.cc:1511] Processing CreateTablet for tablet 5be4cc379dc24cf4aa09e4242241c03f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:02.898108 32472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91b8d6a020d469ba3542974ba93b7a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:02.957366 32591 tablet.cc:2406] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:02.946122 32687 ts_tablet_manager.cc:1403] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.460s	user 0.013s	sys 0.024s
W20260709 12:13:03.011509 32301 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 60658.2us
I20260709 12:13:03.027222 32404 tablet_service.cc:1511] Processing CreateTablet for tablet 5be4cc379dc24cf4aa09e4242241c03f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:03.028860 32404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be4cc379dc24cf4aa09e4242241c03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.029026 32687 raft_consensus.cc:359] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:03.029913 32692 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.029928 32687 raft_consensus.cc:385] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.030481 32692 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:03.043454 32477 tablet_service.cc:1511] Processing CreateTablet for tablet d33572d24cb94b1593a46886bf0bbee9 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:03.030475 32687 raft_consensus.cc:740] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.058974 32687 consensus_queue.cc:260] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:03.059123 32548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be4cc379dc24cf4aa09e4242241c03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.056593 32684 ts_tablet_manager.cc:1434] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.214s	user 0.007s	sys 0.004s
I20260709 12:13:03.059764 32477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33572d24cb94b1593a46886bf0bbee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:02.965689 32550 tablet_service.cc:1511] Processing CreateTablet for tablet b91b8d6a020d469ba3542974ba93b7a6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:03.071285 32692 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:03.095974 32546 tablet_service.cc:1511] Processing CreateTablet for tablet d33572d24cb94b1593a46886bf0bbee9 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:03.104324 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33572d24cb94b1593a46886bf0bbee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.063090 32622 tablet_service.cc:1511] Processing CreateTablet for tablet 2433debd51544aefbf04917c84186bbd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:03.105129 32685 tablet_bootstrap.cc:654] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.106535 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2433debd51544aefbf04917c84186bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.108668 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91b8d6a020d469ba3542974ba93b7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.059502 32403 tablet_service.cc:1511] Processing CreateTablet for tablet d33572d24cb94b1593a46886bf0bbee9 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:03.131340 32403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d33572d24cb94b1593a46886bf0bbee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.135705 32684 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:03.142695 32687 ts_tablet_manager.cc:1434] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.144s	user 0.011s	sys 0.005s
I20260709 12:13:03.143968 32687 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:03.145617 32693 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.146201 32693 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.160598 32693 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:03.183409 32694 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.184098 32694 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.214322 32397 tablet_service.cc:1511] Processing CreateTablet for tablet 2433debd51544aefbf04917c84186bbd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:03.215957 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2433debd51544aefbf04917c84186bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.226528 32694 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:03.239558 32686 ts_tablet_manager.cc:1434] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.435s	user 0.010s	sys 0.012s
I20260709 12:13:03.245347 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:03.250995 32686 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:03.254014 32529 leader_election.cc:343] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.246116 32481 tablet_service.cc:1511] Processing CreateTablet for tablet 2433debd51544aefbf04917c84186bbd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:03.258438 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:03.259724 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2433debd51544aefbf04917c84186bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.261776 32686 tablet_bootstrap.cc:654] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.268626 32547 tablet_service.cc:1511] Processing CreateTablet for tablet 58c938626ada4501bedecbdab942f204 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:03.271817 32696 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.272423 32480 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9e9d432cb84622a564a7fcd6938824 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:03.273895 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9e9d432cb84622a564a7fcd6938824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.270155 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c938626ada4501bedecbdab942f204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.272469 32696 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:03.300133 32621 tablet_service.cc:1511] Processing CreateTablet for tablet 58c938626ada4501bedecbdab942f204 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:03.301779 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c938626ada4501bedecbdab942f204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.303452 32696 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:03.310738 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:03.313108 32684 tablet_bootstrap.cc:654] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.314244 32548 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9e9d432cb84622a564a7fcd6938824 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:03.315222 32687 tablet_bootstrap.cc:654] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.318210 32548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9e9d432cb84622a564a7fcd6938824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.319474 32405 tablet_service.cc:1511] Processing CreateTablet for tablet 58c938626ada4501bedecbdab942f204 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:03.322036 32626 tablet_service.cc:1511] Processing CreateTablet for tablet 6d9e9d432cb84622a564a7fcd6938824 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:03.320919 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c938626ada4501bedecbdab942f204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.332759 32400 tablet_service.cc:1511] Processing CreateTablet for tablet c52ca9ed28fe425ea8235a5d0d8dfe70 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:03.337791 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9e9d432cb84622a564a7fcd6938824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.366874 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52ca9ed28fe425ea8235a5d0d8dfe70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.374397 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:03.377074 32605 leader_election.cc:343] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:03.390846 32530 leader_election.cc:343] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.391733 32530 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:03.392793 32692 raft_consensus.cc:2749] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.423040 32622 tablet_service.cc:1511] Processing CreateTablet for tablet f2c0c583bb864a7c91ac49bf45615523 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:03.424998 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0c583bb864a7c91ac49bf45615523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.427414 32546 tablet_service.cc:1511] Processing CreateTablet for tablet c52ca9ed28fe425ea8235a5d0d8dfe70 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:03.429090 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52ca9ed28fe425ea8235a5d0d8dfe70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.437202 32686 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:03.437896 32686 ts_tablet_manager.cc:1403] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.006s
I20260709 12:13:03.449319 32404 tablet_service.cc:1511] Processing CreateTablet for tablet f2c0c583bb864a7c91ac49bf45615523 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:03.450218 32547 tablet_service.cc:1511] Processing CreateTablet for tablet 685b2b95e9684decb8a771394db66391 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:03.451761 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685b2b95e9684decb8a771394db66391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.451608 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:03.452556 32416 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:03.450601 32685 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:03.454087 32685 ts_tablet_manager.cc:1403] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.508s	user 0.020s	sys 0.009s
I20260709 12:13:03.459539 32404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0c583bb864a7c91ac49bf45615523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.458781 32402 tablet_service.cc:1511] Processing CreateTablet for tablet 685b2b95e9684decb8a771394db66391 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:03.461483 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685b2b95e9684decb8a771394db66391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.462721 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:03.463510 32639 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:03.458781 32626 tablet_service.cc:1511] Processing CreateTablet for tablet 685b2b95e9684decb8a771394db66391 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:03.464984 32380 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:03.465597 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685b2b95e9684decb8a771394db66391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.466017 32694 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.466601 32694 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.467036 32694 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.467868 32603 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:03.496454 32472 tablet_service.cc:1511] Processing CreateTablet for tablet c52ca9ed28fe425ea8235a5d0d8dfe70 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:03.498109 32472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52ca9ed28fe425ea8235a5d0d8dfe70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.498019 32477 tablet_service.cc:1511] Processing CreateTablet for tablet f2c0c583bb864a7c91ac49bf45615523 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:03.498432 32478 tablet_service.cc:1511] Processing CreateTablet for tablet efe7ed2268914c5f801a07f22ed353c6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:03.499536 32477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c0c583bb864a7c91ac49bf45615523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.500170 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe7ed2268914c5f801a07f22ed353c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.513206 32550 tablet_service.cc:1511] Processing CreateTablet for tablet efe7ed2268914c5f801a07f22ed353c6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:03.496449 32684 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:03.514474 32627 tablet_service.cc:1511] Processing CreateTablet for tablet efe7ed2268914c5f801a07f22ed353c6 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:03.514993 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe7ed2268914c5f801a07f22ed353c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.515877 32627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe7ed2268914c5f801a07f22ed353c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.521929 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:03.522229 32686 raft_consensus.cc:359] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.523048 32686 raft_consensus.cc:385] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.523386 32686 raft_consensus.cc:740] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
W20260709 12:13:03.524099 32382 leader_election.cc:343] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.524255 32686 consensus_queue.cc:260] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.529868 32397 tablet_service.cc:1511] Processing CreateTablet for tablet 7a112a8d877942bfb7ce438f35b505b4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:03.530572 32693 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:03.530810 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 63255.4us
I20260709 12:13:03.531093 32693 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.531354 32397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a112a8d877942bfb7ce438f35b505b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.531563 32693 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.532763 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:03.536115 32685 raft_consensus.cc:359] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.537019 32685 raft_consensus.cc:385] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.537511 32685 raft_consensus.cc:740] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.514909 32684 ts_tablet_manager.cc:1403] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.389s	user 0.018s	sys 0.012s
W20260709 12:13:03.540997 32455 leader_election.cc:343] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.551545 32476 tablet_service.cc:1511] Processing CreateTablet for tablet 7a112a8d877942bfb7ce438f35b505b4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:03.553158 32476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a112a8d877942bfb7ce438f35b505b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.556195 32687 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:03.556883 32687 ts_tablet_manager.cc:1403] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.413s	user 0.013s	sys 0.013s
I20260709 12:13:03.557011 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:03.560405 32455 leader_election.cc:343] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.560994 32455 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:03.561817 32696 raft_consensus.cc:2749] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.563300 32694 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.565646 32694 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:03.567130 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:03.568843 32549 tablet_service.cc:1511] Processing CreateTablet for tablet 7a112a8d877942bfb7ce438f35b505b4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:03.570355 32549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a112a8d877942bfb7ce438f35b505b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.570472 32685 consensus_queue.cc:260] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.569151 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:03.574852 32686 ts_tablet_manager.cc:1434] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.004s
I20260709 12:13:03.575980 32686 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:03.579571 32382 leader_election.cc:343] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.560156 32684 raft_consensus.cc:359] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:03.588881 32684 raft_consensus.cc:385] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.589392 32684 raft_consensus.cc:740] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.590397 32684 consensus_queue.cc:260] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:03.590960 32685 ts_tablet_manager.cc:1434] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.002s
I20260709 12:13:03.610415 32685 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:03.592811 32621 tablet_service.cc:1511] Processing CreateTablet for tablet b9c944e1e0c34336964f60256dfc70ce (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:03.594485 32687 raft_consensus.cc:359] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.597375 32400 tablet_service.cc:1511] Processing CreateTablet for tablet b9c944e1e0c34336964f60256dfc70ce (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:03.626180 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c944e1e0c34336964f60256dfc70ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.627167 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c944e1e0c34336964f60256dfc70ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.627990 32405 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8288c4510048649fa8421e99bbcdb5 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:03.600589 32481 tablet_service.cc:1511] Processing CreateTablet for tablet b9c944e1e0c34336964f60256dfc70ce (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:03.629437 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8288c4510048649fa8421e99bbcdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.629670 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c944e1e0c34336964f60256dfc70ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.606148 32623 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8288c4510048649fa8421e99bbcdb5 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:03.616410 32687 raft_consensus.cc:385] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.630409 32687 raft_consensus.cc:740] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.630959 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8288c4510048649fa8421e99bbcdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.631536 32687 consensus_queue.cc:260] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.642632 32687 ts_tablet_manager.cc:1434] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.000s
I20260709 12:13:03.629216 32693 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.652069 32639 raft_consensus.cc:2393] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:03.653975 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:03.605358 32548 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8288c4510048649fa8421e99bbcdb5 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:03.655349 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
W20260709 12:13:03.655681 32605 leader_election.cc:343] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.656318 32416 raft_consensus.cc:2393] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:03.656519 32548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8288c4510048649fa8421e99bbcdb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.655717 32380 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:03.658191 32715 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.659049 32603 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:03.662909 32478 tablet_service.cc:1511] Processing CreateTablet for tablet d15504aa6b6247adba3539950c1023f4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:03.664777 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15504aa6b6247adba3539950c1023f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.664992 32686 tablet_bootstrap.cc:654] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.673847 32696 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.674739 32696 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.678015 32687 tablet_bootstrap.cc:492] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:03.680783 32693 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:03.681979 32693 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.711284 32550 tablet_service.cc:1511] Processing CreateTablet for tablet d15504aa6b6247adba3539950c1023f4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:03.713407 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15504aa6b6247adba3539950c1023f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.716526 32687 tablet_bootstrap.cc:654] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.724138 32696 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:03.724929 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:03.729447 32455 leader_election.cc:343] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.748893 32684 ts_tablet_manager.cc:1434] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.209s	user 0.037s	sys 0.036s
I20260709 12:13:03.749630 32623 tablet_service.cc:1511] Processing CreateTablet for tablet d15504aa6b6247adba3539950c1023f4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:03.750298 32684 tablet_bootstrap.cc:492] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:03.757352 32692 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.757766 32685 tablet_bootstrap.cc:654] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.757944 32692 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.757865 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:03.759467 32565 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:03.760875 32457 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:03.761446 32692 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:03.762882 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:03.763607 32491 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:03.764261 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15504aa6b6247adba3539950c1023f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.765964 32696 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.766207 32684 tablet_bootstrap.cc:654] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.766444 32696 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.766886 32696 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:03.745280 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 86330.5us
I20260709 12:13:03.770223 32530 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:03.771227 32692 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:03.771173 32405 tablet_service.cc:1511] Processing CreateTablet for tablet a9a0efab86054946bbce18dc6e29c467 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:03.771752 32692 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.772125 32692 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.772708 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a0efab86054946bbce18dc6e29c467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.773533 32547 tablet_service.cc:1511] Processing CreateTablet for tablet a9a0efab86054946bbce18dc6e29c467 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:03.774876 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a0efab86054946bbce18dc6e29c467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.776206 32480 tablet_service.cc:1511] Processing CreateTablet for tablet a9a0efab86054946bbce18dc6e29c467 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:03.782536 32692 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.788091 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a0efab86054946bbce18dc6e29c467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.789592 32686 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:03.790477 32686 ts_tablet_manager.cc:1403] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.011s
I20260709 12:13:03.782141 32696 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.799506 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:03.800606 32687 tablet_bootstrap.cc:492] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:03.806385 32687 ts_tablet_manager.cc:1403] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.007s
I20260709 12:13:03.807381 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:03.808354 32491 raft_consensus.cc:2393] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:03.808769 32402 tablet_service.cc:1511] Processing CreateTablet for tablet 2d29e303af234432859c20b561429b5e (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:03.810323 32696 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:03.810472 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d29e303af234432859c20b561429b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.811533 32478 tablet_service.cc:1511] Processing CreateTablet for tablet 2d29e303af234432859c20b561429b5e (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:03.813652 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d29e303af234432859c20b561429b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.819372 32692 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:03.819600 32622 tablet_service.cc:1511] Processing CreateTablet for tablet 2d29e303af234432859c20b561429b5e (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:03.821029 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d29e303af234432859c20b561429b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.794049 32686 raft_consensus.cc:359] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.819299 32687 raft_consensus.cc:359] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:03.824110 32687 raft_consensus.cc:385] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.824481 32687 raft_consensus.cc:740] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.825563 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:03.825348 32687 consensus_queue.cc:260] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:03.826584 32565 raft_consensus.cc:2393] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 1: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:03.828765 32546 tablet_service.cc:1511] Processing CreateTablet for tablet 6668e0bc0681434bb7a16d07ca609ebd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:03.823696 32686 raft_consensus.cc:385] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.830101 32686 raft_consensus.cc:740] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.831305 32626 tablet_service.cc:1511] Processing CreateTablet for tablet 6668e0bc0681434bb7a16d07ca609ebd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:03.832698 32626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6668e0bc0681434bb7a16d07ca609ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.836916 32687 ts_tablet_manager.cc:1434] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:13:03.838054 32687 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:03.830276 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6668e0bc0681434bb7a16d07ca609ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.831277 32686 consensus_queue.cc:260] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.842981 32416 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:03.859642 32687 tablet_bootstrap.cc:654] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.864969 32684 tablet_bootstrap.cc:492] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:03.865588 32684 ts_tablet_manager.cc:1403] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.008s
I20260709 12:13:03.868865 32684 raft_consensus.cc:359] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:03.869645 32684 raft_consensus.cc:385] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.873766 32687 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:03.874933 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 6668e0bc0681434bb7a16d07ca609ebd (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:03.879598 32687 ts_tablet_manager.cc:1403] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.016s
I20260709 12:13:03.885219 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6668e0bc0681434bb7a16d07ca609ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.889480 32550 tablet_service.cc:1511] Processing CreateTablet for tablet 79e5da2812114608bc846e1630ec618e (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:03.869982 32684 raft_consensus.cc:740] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.882925 32685 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:03.886879 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:03.890887 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e5da2812114608bc846e1630ec618e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.892000 32685 ts_tablet_manager.cc:1403] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.282s	user 0.023s	sys 0.004s
I20260709 12:13:03.893484 32684 consensus_queue.cc:260] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:03.894447 32715 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.894968 32715 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.876241 32481 tablet_service.cc:1511] Processing CreateTablet for tablet 79e5da2812114608bc846e1630ec618e (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:03.888454 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:03.897877 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e5da2812114608bc846e1630ec618e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.898753 32529 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:03.899690 32692 raft_consensus.cc:2749] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:03.887619 32687 raft_consensus.cc:359] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.903635 32687 raft_consensus.cc:385] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.904019 32687 raft_consensus.cc:740] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.908874 32687 consensus_queue.cc:260] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.912909 32621 tablet_service.cc:1511] Processing CreateTablet for tablet 79e5da2812114608bc846e1630ec618e (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:03.914603 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79e5da2812114608bc846e1630ec618e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.914623 32684 ts_tablet_manager.cc:1434] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.005s
I20260709 12:13:03.916507 32684 tablet_bootstrap.cc:492] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:03.918442 32685 raft_consensus.cc:359] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.919279 32685 raft_consensus.cc:385] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.919597 32685 raft_consensus.cc:740] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.920414 32685 consensus_queue.cc:260] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.924150 32715 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:03.925980 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:03.927453 32687 ts_tablet_manager.cc:1434] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
W20260709 12:13:03.928648 32382 leader_election.cc:343] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.932224 32685 ts_tablet_manager.cc:1434] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.004s
I20260709 12:13:03.942059 32685 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:03.947265 32687 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:03.951272 32685 tablet_bootstrap.cc:654] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.955322 32687 tablet_bootstrap.cc:654] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.963670 32685 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:03.964290 32685 ts_tablet_manager.cc:1403] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:13:03.965986 32402 tablet_service.cc:1511] Processing CreateTablet for tablet 23a3d4e0554c4f00956aa265c66fe82c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:03.967860 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a3d4e0554c4f00956aa265c66fe82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.968952 32716 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.969686 32684 tablet_bootstrap.cc:654] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:03.969553 32716 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:03.975857 32685 raft_consensus.cc:359] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.976791 32685 raft_consensus.cc:385] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:03.976183 32481 tablet_service.cc:1511] Processing CreateTablet for tablet 23a3d4e0554c4f00956aa265c66fe82c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:03.977138 32685 raft_consensus.cc:740] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:03.978005 32685 consensus_queue.cc:260] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:03.978574 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a3d4e0554c4f00956aa265c66fe82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.966172 32416 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:03.979524 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:03.981166 32692 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:03.983016 32603 leader_election.cc:343] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:03.983273 32686 ts_tablet_manager.cc:1434] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.192s	user 0.006s	sys 0.006s
I20260709 12:13:03.981889 32692 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:03.975880 32716 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:03.992939 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:03.993945 32686 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:03.993031 32455 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:03.995930 32696 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.014817 32692 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:04.009864 32529 leader_election.cc:343] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.024068 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:04.026175 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:04.027892 32529 leader_election.cc:343] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.028509 32529 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:04.029767 32692 raft_consensus.cc:2749] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.031526 32623 tablet_service.cc:1511] Processing CreateTablet for tablet b37b1dfe917c4fe7bcb6254184f6b369 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:04.031957 32405 tablet_service.cc:1511] Processing CreateTablet for tablet b37b1dfe917c4fe7bcb6254184f6b369 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:04.033046 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b1dfe917c4fe7bcb6254184f6b369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.033182 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b1dfe917c4fe7bcb6254184f6b369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.035487 32480 tablet_service.cc:1511] Processing CreateTablet for tablet b37b1dfe917c4fe7bcb6254184f6b369 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:04.036864 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37b1dfe917c4fe7bcb6254184f6b369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.042217 32686 tablet_bootstrap.cc:654] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.049556 32685 ts_tablet_manager.cc:1434] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.085s	user 0.022s	sys 0.015s
I20260709 12:13:04.041308 32696 raft_consensus.cc:697] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
W20260709 12:13:04.052284 32381 leader_election.cc:343] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.052920 32381 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:04.054675 32715 raft_consensus.cc:2749] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.056639 32687 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:04.056954 32546 tablet_service.cc:1511] Processing CreateTablet for tablet 0377240aa66c46c3ab6d99efb7e3bcd4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:04.063870 32687 ts_tablet_manager.cc:1403] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.120s	user 0.009s	sys 0.023s
I20260709 12:13:04.064778 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0377240aa66c46c3ab6d99efb7e3bcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.052726 32550 tablet_service.cc:1511] Processing CreateTablet for tablet 23a3d4e0554c4f00956aa265c66fe82c (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:04.073400 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a3d4e0554c4f00956aa265c66fe82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.074400 32730 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.075129 32730 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.078951 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:04.080724 32457 leader_election.cc:343] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.082049 32685 tablet_bootstrap.cc:492] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:04.084776 32716 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.085407 32716 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.090373 32621 tablet_service.cc:1511] Processing CreateTablet for tablet 0377240aa66c46c3ab6d99efb7e3bcd4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:04.090646 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:04.091931 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0377240aa66c46c3ab6d99efb7e3bcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.092087 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:04.092847 32491 raft_consensus.cc:2468] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:04.070343 32696 consensus_queue.cc:237] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:04.094969 32604 leader_election.cc:343] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.096479 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:04.101862 32604 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:04.103507 32717 raft_consensus.cc:2804] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.098328 32565 raft_consensus.cc:2468] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:04.105083 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:04.105726 32605 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:04.106948 32455 leader_election.cc:343] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.107218 32693 raft_consensus.cc:2804] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.107872 32693 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.108394 32693 raft_consensus.cc:3060] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.110311 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 0377240aa66c46c3ab6d99efb7e3bcd4 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:04.111438 32685 tablet_bootstrap.cc:654] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.098456 32716 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.107506 32455 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:04.113615 32729 raft_consensus.cc:2749] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.115259 32478 tablet_service.cc:1511] Processing CreateTablet for tablet b2b7dc13dad9450593f677a27d195620 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:04.116647 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b7dc13dad9450593f677a27d195620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.117832 32547 tablet_service.cc:1511] Processing CreateTablet for tablet b2b7dc13dad9450593f677a27d195620 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:04.104038 32717 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.118863 32717 raft_consensus.cc:3060] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.119241 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b7dc13dad9450593f677a27d195620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.111790 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0377240aa66c46c3ab6d99efb7e3bcd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.135982 32717 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.139453 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
W20260709 12:13:04.141180 32603 leader_election.cc:343] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.149266 32687 raft_consensus.cc:359] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.150154 32687 raft_consensus.cc:385] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.150512 32687 raft_consensus.cc:740] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.151504 32623 tablet_service.cc:1511] Processing CreateTablet for tablet b2b7dc13dad9450593f677a27d195620 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:04.127465 32730 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:04.153091 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b7dc13dad9450593f677a27d195620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.154783 32686 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:04.159003 32686 ts_tablet_manager.cc:1403] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.165s	user 0.016s	sys 0.029s
I20260709 12:13:04.168318 32684 tablet_bootstrap.cc:492] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:04.169064 32684 ts_tablet_manager.cc:1403] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.253s	user 0.012s	sys 0.005s
I20260709 12:13:04.170652 32717 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:04.164906 32693 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.171978 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:04.171681 32314 catalog_manager.cc:5697] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.172593 32491 raft_consensus.cc:3060] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.173511 32693 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.178030 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:04.178741 32565 raft_consensus.cc:3060] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.180769 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:04.182482 32604 leader_election.cc:343] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.177736 32687 consensus_queue.cc:260] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.185364 32491 raft_consensus.cc:2468] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:04.186807 32604 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:04.187544 32402 tablet_service.cc:1511] Processing CreateTablet for tablet a593854682354a35bcbf4a59a26baa0f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:04.190033 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a593854682354a35bcbf4a59a26baa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.187443 32687 ts_tablet_manager.cc:1434] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.000s
I20260709 12:13:04.194412 32687 tablet_bootstrap.cc:492] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:04.188598 32693 raft_consensus.cc:2804] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.195436 32693 raft_consensus.cc:697] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:04.196399 32693 consensus_queue.cc:237] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.210958 32480 tablet_service.cc:1511] Processing CreateTablet for tablet a593854682354a35bcbf4a59a26baa0f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:04.211313 32684 raft_consensus.cc:359] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.212173 32684 raft_consensus.cc:385] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.212500 32684 raft_consensus.cc:740] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.212623 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a593854682354a35bcbf4a59a26baa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.214363 32621 tablet_service.cc:1511] Processing CreateTablet for tablet d282ad4f6b644e9c8c6690342f7c3844 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:04.217310 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d282ad4f6b644e9c8c6690342f7c3844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.216878 32684 consensus_queue.cc:260] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.218182 32546 tablet_service.cc:1511] Processing CreateTablet for tablet a593854682354a35bcbf4a59a26baa0f (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:04.219723 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a593854682354a35bcbf4a59a26baa0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.219864 32684 ts_tablet_manager.cc:1434] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 12:13:04.221081 32684 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:04.221683 32400 tablet_service.cc:1511] Processing CreateTablet for tablet d282ad4f6b644e9c8c6690342f7c3844 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:04.222951 32696 raft_consensus.cc:493] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.223567 32696 raft_consensus.cc:515] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.215725 32565 raft_consensus.cc:2468] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:04.226073 32696 leader_election.cc:290] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.225960 32605 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:04.223168 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d282ad4f6b644e9c8c6690342f7c3844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.227362 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:04.228942 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:04.229705 32564 raft_consensus.cc:2468] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:04.230466 32717 raft_consensus.cc:2804] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.230997 32717 raft_consensus.cc:697] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:04.231407 32457 leader_election.cc:304] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:04.231897 32717 consensus_queue.cc:237] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.235939 32696 raft_consensus.cc:2804] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.236408 32696 raft_consensus.cc:493] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.236758 32696 raft_consensus.cc:3060] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.213835 32686 raft_consensus.cc:359] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.238394 32686 raft_consensus.cc:385] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.242348 32686 raft_consensus.cc:740] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
W20260709 12:13:04.243129 32455 leader_election.cc:343] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.241941 32687 tablet_bootstrap.cc:654] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.243396 32686 consensus_queue.cc:260] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.253983 32686 ts_tablet_manager.cc:1434] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 12:13:04.253602 32478 tablet_service.cc:1511] Processing CreateTablet for tablet d282ad4f6b644e9c8c6690342f7c3844 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:04.255411 32478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d282ad4f6b644e9c8c6690342f7c3844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.257984 32730 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.258679 32730 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.269584 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:04.273574 32457 leader_election.cc:343] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.277050 32550 tablet_service.cc:1511] Processing CreateTablet for tablet 83f3ae065257465b93b73378b55d5cda (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:04.279810 32685 tablet_bootstrap.cc:492] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:04.279656 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:04.280515 32685 ts_tablet_manager.cc:1403] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.199s	user 0.009s	sys 0.015s
I20260709 12:13:04.280809 32416 raft_consensus.cc:2468] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:04.267074 32730 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.282773 32455 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:04.284561 32730 raft_consensus.cc:2804] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.285091 32730 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.285657 32730 raft_consensus.cc:3060] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.285496 32312 catalog_manager.cc:5697] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.287285 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f3ae065257465b93b73378b55d5cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.293815 32621 tablet_service.cc:1511] Processing CreateTablet for tablet 83f3ae065257465b93b73378b55d5cda (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:04.295408 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f3ae065257465b93b73378b55d5cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.288818 32696 raft_consensus.cc:515] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.295806 32684 tablet_bootstrap.cc:654] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.307906 32685 raft_consensus.cc:359] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.308799 32685 raft_consensus.cc:385] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.309118 32685 raft_consensus.cc:740] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.312037 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:04.314797 32400 tablet_service.cc:1511] Processing CreateTablet for tablet 83f3ae065257465b93b73378b55d5cda (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:04.319379 32686 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:04.322717 32717 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.323478 32717 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.327912 32400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83f3ae065257465b93b73378b55d5cda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.332376 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:04.333135 32491 raft_consensus.cc:2468] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:04.334244 32687 tablet_bootstrap.cc:492] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:04.337873 32604 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:04.339286 32716 raft_consensus.cc:2804] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.339803 32716 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.341975 32716 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.343575 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:04.345211 32605 leader_election.cc:343] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:04.346920 32455 leader_election.cc:343] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.347509 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:04.335121 32685 consensus_queue.cc:260] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.348181 32564 raft_consensus.cc:3060] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.350461 32685 ts_tablet_manager.cc:1434] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.001s
I20260709 12:13:04.341274 32717 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.352581 32480 tablet_service.cc:1511] Processing CreateTablet for tablet 13de05a5967f4ae1b37b49953488e4e0 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:04.340610 32696 leader_election.cc:290] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.354001 32480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13de05a5967f4ae1b37b49953488e4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.354609 32550 tablet_service.cc:1511] Processing CreateTablet for tablet 13de05a5967f4ae1b37b49953488e4e0 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:04.357189 32684 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:04.358567 32623 tablet_service.cc:1511] Processing CreateTablet for tablet 13de05a5967f4ae1b37b49953488e4e0 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:04.360185 32623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13de05a5967f4ae1b37b49953488e4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.361018 32687 ts_tablet_manager.cc:1403] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.010s
I20260709 12:13:04.360724 32402 tablet_service.cc:1511] Processing CreateTablet for tablet 47c6ae8960954c14a3cb5f43eddaeab8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:04.364729 32687 raft_consensus.cc:359] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.365563 32687 raft_consensus.cc:385] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.365267 32621 tablet_service.cc:1511] Processing CreateTablet for tablet fe1ca85c249841679ee6e347dcf446ea (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:04.365957 32684 ts_tablet_manager.cc:1403] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.145s	user 0.016s	sys 0.017s
I20260709 12:13:04.366658 32621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1ca85c249841679ee6e347dcf446ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.366837 32481 tablet_service.cc:1511] Processing CreateTablet for tablet 47c6ae8960954c14a3cb5f43eddaeab8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:04.368111 32481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c6ae8960954c14a3cb5f43eddaeab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.362109 32402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c6ae8960954c14a3cb5f43eddaeab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.372442 32546 tablet_service.cc:1511] Processing CreateTablet for tablet 47c6ae8960954c14a3cb5f43eddaeab8 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:04.365912 32687 raft_consensus.cc:740] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.378839 32686 tablet_bootstrap.cc:654] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.382467 32550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13de05a5967f4ae1b37b49953488e4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.384943 32405 tablet_service.cc:1511] Processing CreateTablet for tablet fe1ca85c249841679ee6e347dcf446ea (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:04.386358 32405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1ca85c249841679ee6e347dcf446ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.386159 32687 consensus_queue.cc:260] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.387531 32685 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
W20260709 12:13:04.388253 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:04.376530 32564 raft_consensus.cc:2468] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:04.396440 32546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c6ae8960954c14a3cb5f43eddaeab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.390333 32476 tablet_service.cc:1511] Processing CreateTablet for tablet fe1ca85c249841679ee6e347dcf446ea (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:04.399744 32476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe1ca85c249841679ee6e347dcf446ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.408201 32547 tablet_service.cc:1511] Processing CreateTablet for tablet d02b4d51cd3f4b3295717f352f048a01 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:04.409734 32547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02b4d51cd3f4b3295717f352f048a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.396306 32457 leader_election.cc:304] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:04.412994 32696 raft_consensus.cc:2804] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.413509 32696 raft_consensus.cc:697] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:04.408211 32622 tablet_service.cc:1511] Processing CreateTablet for tablet d02b4d51cd3f4b3295717f352f048a01 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:04.416081 32622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02b4d51cd3f4b3295717f352f048a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.417737 32404 tablet_service.cc:1511] Processing CreateTablet for tablet d02b4d51cd3f4b3295717f352f048a01 (DEFAULT_TABLE table=test-workload [id=72753e6949e641ae8dc96ea6bfbfc439]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:04.418505 32696 consensus_queue.cc:237] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.419634 32404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02b4d51cd3f4b3295717f352f048a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:04.351085 32730 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.428668 32730 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.429504 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:04.429816 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:04.430233 32416 raft_consensus.cc:3060] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:04.431515 32457 leader_election.cc:343] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.432370 32684 raft_consensus.cc:359] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.433447 32684 raft_consensus.cc:385] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.433833 32684 raft_consensus.cc:740] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.436935 32716 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.440898 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:04.441555 32491 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.441823 32687 ts_tablet_manager.cc:1434] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.002s
I20260709 12:13:04.443306 32687 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:04.448532 32416 raft_consensus.cc:2468] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:04.449977 32455 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:04.450892 32730 raft_consensus.cc:2804] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.451598 32730 raft_consensus.cc:697] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:04.452674 32730 consensus_queue.cc:237] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.461176 32716 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:04.467154 32684 consensus_queue.cc:260] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.515393 32491 raft_consensus.cc:2468] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:04.516842 32604 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:04.517886 32716 raft_consensus.cc:2804] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:04.518450 32716 raft_consensus.cc:697] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:04.519428 32716 consensus_queue.cc:237] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.504873 32731 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.522660 32731 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.524711 32731 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:04.527745 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:04.532114 32684 ts_tablet_manager.cc:1434] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.166s	user 0.011s	sys 0.000s
W20260709 12:13:04.532740 32529 leader_election.cc:343] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.533337 32684 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:04.533921 32729 consensus_queue.cc:1048] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.525686 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:04.536043 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:04.536667 32605 leader_election.cc:343] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:04.539227 32530 leader_election.cc:343] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.539930 32530 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:04.522177 32687 tablet_bootstrap.cc:654] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.545558 32731 raft_consensus.cc:2749] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.547047 32685 tablet_bootstrap.cc:654] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.556954 32686 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:04.557715 32686 ts_tablet_manager.cc:1403] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.260s	user 0.031s	sys 0.061s
I20260709 12:13:04.557802 32684 tablet_bootstrap.cc:654] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.562551 32687 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
W20260709 12:13:04.596805 32299 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 91573.9us
W20260709 12:13:04.603161 32301 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 90866.9us
I20260709 12:13:04.615510 32312 catalog_manager.cc:5697] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.633644 32687 ts_tablet_manager.cc:1403] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.190s	user 0.015s	sys 0.000s
W20260709 12:13:04.640365 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 98508us
I20260709 12:13:04.644694 32685 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:04.645632 32685 ts_tablet_manager.cc:1403] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.258s	user 0.011s	sys 0.010s
W20260709 12:13:04.646863 32603 consensus_peers.cc:597] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:04.639369 32686 raft_consensus.cc:359] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.652343 32686 raft_consensus.cc:385] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.652863 32686 raft_consensus.cc:740] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.653999 32686 consensus_queue.cc:260] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.661409 32686 ts_tablet_manager.cc:1434] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.103s	user 0.014s	sys 0.002s
I20260709 12:13:04.666574 32684 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:04.667105 32685 raft_consensus.cc:359] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.667889 32684 ts_tablet_manager.cc:1403] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.019s
I20260709 12:13:04.668322 32685 raft_consensus.cc:385] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.668781 32685 raft_consensus.cc:740] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.669804 32685 consensus_queue.cc:260] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.674029 32685 ts_tablet_manager.cc:1434] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 12:13:04.673900 32684 raft_consensus.cc:359] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.680774 32684 raft_consensus.cc:385] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.681130 32684 raft_consensus.cc:740] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.682155 32684 consensus_queue.cc:260] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.684571 32696 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.685400 32684 ts_tablet_manager.cc:1434] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:13:04.687248 32684 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:04.679944 32685 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:04.696585 32686 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:04.696169 32730 consensus_queue.cc:1048] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.685626 32696 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.699293 32684 tablet_bootstrap.cc:654] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.693996 32311 catalog_manager.cc:5697] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.711170 32687 raft_consensus.cc:359] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.714442 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:04.708495 32312 catalog_manager.cc:5697] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.725009 32717 consensus_queue.cc:1048] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:04.722126 32685 tablet_bootstrap.cc:654] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.731247 32490 raft_consensus.cc:3060] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.726858 32687 raft_consensus.cc:385] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.715345 32696 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:04.736403 32687 raft_consensus.cc:740] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.744668 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:04.746271 32564 raft_consensus.cc:2393] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:04.748134 32457 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:04.747915 32687 consensus_queue.cc:260] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.775417 32686 tablet_bootstrap.cc:654] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.780496 32687 ts_tablet_manager.cc:1434] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.146s	user 0.013s	sys 0.005s
I20260709 12:13:04.792096 32729 raft_consensus.cc:2749] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:04.795934 32687 tablet_bootstrap.cc:492] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:04.810422 32686 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:04.811267 32686 ts_tablet_manager.cc:1403] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.012s
I20260709 12:13:04.812081 32684 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:04.812672 32684 ts_tablet_manager.cc:1403] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.126s	user 0.028s	sys 0.048s
I20260709 12:13:04.814515 32716 consensus_queue.cc:1048] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.815472 32686 raft_consensus.cc:359] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.816242 32686 raft_consensus.cc:385] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.819087 32684 raft_consensus.cc:359] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.820184 32686 raft_consensus.cc:740] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.821931 32686 consensus_queue.cc:260] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.820703 32684 raft_consensus.cc:385] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.824549 32686 ts_tablet_manager.cc:1434] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:13:04.826051 32685 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:04.826839 32685 ts_tablet_manager.cc:1403] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.148s	user 0.025s	sys 0.015s
I20260709 12:13:04.823091 32684 raft_consensus.cc:740] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.829856 32684 consensus_queue.cc:260] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.830325 32685 raft_consensus.cc:359] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.831106 32685 raft_consensus.cc:385] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.831436 32685 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.833446 32685 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.836282 32685 ts_tablet_manager.cc:1434] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:04.835843 32311 catalog_manager.cc:5697] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.837399 32684 ts_tablet_manager.cc:1434] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:13:04.837771 32685 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:04.843415 32687 tablet_bootstrap.cc:654] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.847245 32684 tablet_bootstrap.cc:492] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:04.839129 32686 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:04.851758 32716 consensus_queue.cc:1048] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:04.855996 32686 tablet_bootstrap.cc:654] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.868562 32684 tablet_bootstrap.cc:654] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.870306 32685 tablet_bootstrap.cc:654] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.876672 32687 tablet_bootstrap.cc:492] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:04.877269 32687 ts_tablet_manager.cc:1403] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.003s
I20260709 12:13:04.877688 32685 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:04.881194 32685 ts_tablet_manager.cc:1403] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.008s
I20260709 12:13:04.881022 32687 raft_consensus.cc:359] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.881844 32687 raft_consensus.cc:385] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.882167 32687 raft_consensus.cc:740] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.883124 32687 consensus_queue.cc:260] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.885592 32687 ts_tablet_manager.cc:1434] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:04.887542 32687 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:04.888018 32685 raft_consensus.cc:359] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.892489 32685 raft_consensus.cc:385] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.892845 32685 raft_consensus.cc:740] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.895226 32685 consensus_queue.cc:260] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:04.897728 32687 tablet_bootstrap.cc:654] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.898166 32684 tablet_bootstrap.cc:492] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:04.898828 32684 ts_tablet_manager.cc:1403] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.018s
I20260709 12:13:04.899708 32685 ts_tablet_manager.cc:1434] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:13:04.909605 32685 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:04.914270 32686 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:04.902056 32684 raft_consensus.cc:359] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.915089 32684 raft_consensus.cc:385] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.915431 32684 raft_consensus.cc:740] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.915266 32686 ts_tablet_manager.cc:1403] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.007s
I20260709 12:13:04.916370 32684 consensus_queue.cc:260] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.923477 32684 ts_tablet_manager.cc:1434] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:13:04.924837 32684 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:04.929721 32685 tablet_bootstrap.cc:654] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.932006 32684 tablet_bootstrap.cc:654] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.937016 32686 raft_consensus.cc:359] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.938230 32686 raft_consensus.cc:385] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.938661 32686 raft_consensus.cc:740] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.939796 32686 consensus_queue.cc:260] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.943219 32686 ts_tablet_manager.cc:1434] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.005s
I20260709 12:13:04.943893 32729 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.944132 32684 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:04.944731 32684 ts_tablet_manager.cc:1403] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:13:04.944845 32687 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:04.944480 32729 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.945545 32687 ts_tablet_manager.cc:1403] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.029s
I20260709 12:13:04.948387 32684 raft_consensus.cc:359] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.947012 32729 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:04.950043 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:04.950960 32686 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:04.949156 32684 raft_consensus.cc:385] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.949128 32687 raft_consensus.cc:359] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.949383 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:04.951920 32687 raft_consensus.cc:385] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:04.952067 32455 leader_election.cc:343] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:04.952263 32687 raft_consensus.cc:740] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.953202 32687 consensus_queue.cc:260] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.952147 32639 raft_consensus.cc:2468] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:04.951531 32684 raft_consensus.cc:740] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.955752 32687 ts_tablet_manager.cc:1434] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:13:04.956636 32684 consensus_queue.cc:260] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:04.957746 32687 tablet_bootstrap.cc:492] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:04.958773 32455 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:04.959059 32684 ts_tablet_manager.cc:1434] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 12:13:04.960278 32686 tablet_bootstrap.cc:654] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.960544 32684 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:04.965224 32716 raft_consensus.cc:493] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.965883 32687 tablet_bootstrap.cc:654] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.965764 32716 raft_consensus.cc:515] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:04.969424 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:04.970364 32416 raft_consensus.cc:2468] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:04.973631 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:04.974591 32490 raft_consensus.cc:2468] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:04.976400 32603 leader_election.cc:304] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:04.976694 32684 tablet_bootstrap.cc:654] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:04.977530 32765 raft_consensus.cc:2804] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.977948 32765 raft_consensus.cc:493] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.978299 32765 raft_consensus.cc:3060] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.978466 32687 tablet_bootstrap.cc:492] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:04.979027 32687 ts_tablet_manager.cc:1403] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:13:04.982519 32687 raft_consensus.cc:359] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.983368 32687 raft_consensus.cc:385] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:04.983505 32756 raft_consensus.cc:2804] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:04.983705 32687 raft_consensus.cc:740] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:04.983940 32756 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.984314 32756 raft_consensus.cc:3060] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.984683 32687 consensus_queue.cc:260] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:04.988457 32564 raft_consensus.cc:3060] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:04.992012 32716 leader_election.cc:290] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.002280 32696 consensus_queue.cc:1048] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.004101 32696 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.004628 32696 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:05.004827 32605 consensus_peers.cc:597] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:05.011592 32715 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.012528 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.012408 32715 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.013331 32565 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:05.014961 32457 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:05.015918 32729 raft_consensus.cc:2804] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.016520 32729 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.016830 32685 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:05.016965 32729 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.017387 32685 ts_tablet_manager.cc:1403] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.004s
I20260709 12:13:05.020745 32756 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.022166 32765 raft_consensus.cc:515] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.029459 32715 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.030144 32715 raft_consensus.cc:493] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.030637 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:05.031284 32490 raft_consensus.cc:3060] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.031287 32685 raft_consensus.cc:359] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.032181 32685 raft_consensus.cc:385] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.032475 32685 raft_consensus.cc:740] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.033160 32685 consensus_queue.cc:260] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.030640 32715 raft_consensus.cc:515] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.035355 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.036036 32639 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:05.037662 32380 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.022233 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.040540 32765 leader_election.cc:290] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.055681 32685 ts_tablet_manager.cc:1434] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 12:13:05.040355 32730 consensus_queue.cc:1048] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:05.058894 32749 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.073038 32749 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.058732 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:05.059558 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:05.058758   310 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.058014 32565 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:05.061136 32684 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:05.062500 32685 tablet_bootstrap.cc:492] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:05.073782 32716 consensus_queue.cc:1048] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.075693 32684 ts_tablet_manager.cc:1403] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.115s	user 0.027s	sys 0.025s
I20260709 12:13:05.068674 32729 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.056972 32756 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:05.070318 32687 ts_tablet_manager.cc:1434] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 12:13:05.075512 32414 raft_consensus.cc:3060] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.079293 32687 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:05.075419 32639 raft_consensus.cc:3060] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.084792 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.085381 32638 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:05.087437 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:05.087704 32749 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.091462 32415 raft_consensus.cc:3060] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.075078 32730 consensus_queue.cc:1048] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:05.094125 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.095279 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:05.096017 32686 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:05.096159 32416 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
W20260709 12:13:05.097023 32530 leader_election.cc:343] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.097880 32529 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:05.099848 32455 leader_election.cc:343] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.101250 32686 ts_tablet_manager.cc:1403] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.151s	user 0.034s	sys 0.072s
I20260709 12:13:05.104839 32686 raft_consensus.cc:359] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.105845 32686 raft_consensus.cc:385] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.106171 32686 raft_consensus.cc:740] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.077080 32696 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.107692 32414 raft_consensus.cc:2468] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:05.109267 32603 leader_election.cc:304] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.110443 32716 raft_consensus.cc:2804] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.110965 32716 raft_consensus.cc:697] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:05.111436 32490 raft_consensus.cc:2468] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:05.112527 32685 tablet_bootstrap.cc:654] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.111979 32716 consensus_queue.cc:237] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.113943 32715 leader_election.cc:290] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:05.075731   310 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.106931 32749 raft_consensus.cc:2804] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.106986 32686 consensus_queue.cc:260] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.114974 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.117640 32687 tablet_bootstrap.cc:654] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.118059 32686 ts_tablet_manager.cc:1434] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:05.119663 32686 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:05.123323   314 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.124167   314 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.127617   314 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:05.130318 32686 tablet_bootstrap.cc:654] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.130390 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.120939 32749 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.120774   310 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.145251 32696 raft_consensus.cc:493] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.148207 32749 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.158707 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:05.159482 32729 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.159893 32414 raft_consensus.cc:2393] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:05.162418 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.164604 32314 catalog_manager.cc:5697] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.171605 32684 raft_consensus.cc:359] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.174327 32684 raft_consensus.cc:385] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.174726 32684 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.177395 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:05.177660 32382 leader_election.cc:304] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:05.178166 32637 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.181913 32685 tablet_bootstrap.cc:492] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:05.182600 32685 ts_tablet_manager.cc:1403] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.120s	user 0.023s	sys 0.014s
I20260709 12:13:05.185782 32685 raft_consensus.cc:359] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.186856 32685 raft_consensus.cc:385] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.170292 32696 raft_consensus.cc:515] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.191169 32696 leader_election.cc:290] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.187222 32685 raft_consensus.cc:740] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.176020 32638 raft_consensus.cc:2393] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:05.203984 32684 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.206568   314 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:05.214426 32685 consensus_queue.cc:260] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.215574   314 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.217941 32685 ts_tablet_manager.cc:1434] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:13:05.219682 32685 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:05.219828 32715 raft_consensus.cc:2749] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.221328 32529 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:05.175904 32639 raft_consensus.cc:2468] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:05.202577 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.223208   313 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.234023 32687 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:05.234735 32687 ts_tablet_manager.cc:1403] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.156s	user 0.024s	sys 0.001s
W20260709 12:13:05.237010 32455 leader_election.cc:343] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.237891 32696 consensus_queue.cc:1048] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.238226 32687 raft_consensus.cc:359] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.239058 32687 raft_consensus.cc:385] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.239356 32687 raft_consensus.cc:740] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.240262 32684 ts_tablet_manager.cc:1434] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.164s	user 0.009s	sys 0.002s
I20260709 12:13:05.240094 32687 consensus_queue.cc:260] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.241571 32684 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:05.241772 32687 ts_tablet_manager.cc:1434] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:05.242664 32685 tablet_bootstrap.cc:654] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.242897   314 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.243386 32687 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:05.243821 32715 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.244390 32715 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.238637   313 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.247452 32715 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:05.248678 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.249503 32565 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:05.250355 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.251853 32382 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.257087 32455 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:05.262328 32729 raft_consensus.cc:2804] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.262959 32729 raft_consensus.cc:697] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:05.263837 32729 consensus_queue.cc:237] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.264274 32749 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.266716 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:05.268170 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:05.268814 32414 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.276314 32749 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.290349 32749 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.291098 32749 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.291675 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:05.292387 32491 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.293243 32529 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:05.294659   313 raft_consensus.cc:2749] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.260041 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.297645 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.298380 32636 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
W20260709 12:13:05.298494 32457 leader_election.cc:343] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.299116 32457 leader_election.cc:304] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:05.293623 32749 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:05.302307 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:05.306644 32684 tablet_bootstrap.cc:654] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.270452 32715 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:05.312233 32686 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:05.313560   311 raft_consensus.cc:2749] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.314177 32637 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:05.312897 32686 ts_tablet_manager.cc:1403] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.194s	user 0.033s	sys 0.015s
I20260709 12:13:05.320197 32414 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:05.321339 32455 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:05.260134   310 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.306687 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:05.311957 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.311560 32715 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.326875   311 raft_consensus.cc:2804] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.330017 32639 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:05.331867   311 raft_consensus.cc:697] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:05.328610 32564 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.334780   310 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.335695 32685 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:05.325695 32529 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:05.336282 32685 ts_tablet_manager.cc:1403] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.117s	user 0.043s	sys 0.011s
I20260709 12:13:05.338076 32749 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:05.338460 32529 leader_election.cc:343] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.338968 32749 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.339444 32749 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.339656 32529 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.340555   313 raft_consensus.cc:2804] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.340739 32491 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:05.341042   313 raft_consensus.cc:697] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:05.341651 32687 tablet_bootstrap.cc:654] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.332819   311 consensus_queue.cc:237] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.338027 32686 raft_consensus.cc:359] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.343724 32686 raft_consensus.cc:385] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.344129 32686 raft_consensus.cc:740] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.343369 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:05.342126   313 consensus_queue.cc:237] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.346108 32565 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.345813 32686 consensus_queue.cc:260] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.329360 32715 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.348366 32686 ts_tablet_manager.cc:1434] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:13:05.354128 32685 raft_consensus.cc:359] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.355122 32685 raft_consensus.cc:385] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.355501 32685 raft_consensus.cc:740] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.368578 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:05.369434 32637 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.371097 32685 consensus_queue.cc:260] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.389957 32684 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:05.390821 32684 ts_tablet_manager.cc:1403] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.002s
W20260709 12:13:05.392392 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:05.398348 32686 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:05.398836 32684 raft_consensus.cc:359] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.399904 32684 raft_consensus.cc:385] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.400312 32684 raft_consensus.cc:740] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.402987   322 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.404891   322 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.408774   322 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.409091 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.411744 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.412514 32639 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:05.414299 32380 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
W20260709 12:13:05.415604 32381 leader_election.cc:343] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.411801 32685 ts_tablet_manager.cc:1434] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.075s	user 0.003s	sys 0.005s
I20260709 12:13:05.419461 32685 tablet_bootstrap.cc:492] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:05.420298 32564 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:05.438344   322 raft_consensus.cc:2804] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.445860 32684 consensus_queue.cc:260] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.441215   322 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.451489   322 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.459651 32637 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:05.459765 32749 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.461438 32380 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.462870 32416 raft_consensus.cc:3060] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.464867   327 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.465847   327 raft_consensus.cc:697] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:05.466799   327 consensus_queue.cc:237] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.453033 32715 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.473362 32715 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:05.474007 32749 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:05.474946 32684 ts_tablet_manager.cc:1434] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:13:05.475236 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:05.475685 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:05.476246 32684 tablet_bootstrap.cc:492] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:05.476366 32564 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.478870 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:05.479529 32639 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:05.482892 32529 leader_election.cc:343] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.483202 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:05.483927 32637 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.486016 32686 tablet_bootstrap.cc:654] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.492105 32687 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:05.492913 32687 ts_tablet_manager.cc:1403] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.250s	user 0.013s	sys 0.005s
I20260709 12:13:05.493548   322 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.499127 32313 catalog_manager.cc:5697] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.502701 32685 tablet_bootstrap.cc:654] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.502861 32639 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:05.504230 32312 catalog_manager.cc:5697] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.507388 32380 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.507297 32687 raft_consensus.cc:359] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.508533 32687 raft_consensus.cc:385] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.508787   310 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.508939 32687 raft_consensus.cc:740] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.510164 32687 consensus_queue.cc:260] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.511415 32565 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:05.512504 32687 ts_tablet_manager.cc:1434] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:13:05.519591 32684 tablet_bootstrap.cc:654] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.511572 32312 catalog_manager.cc:5697] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.526957 32564 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:05.527460 32314 catalog_manager.cc:5697] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.537487 32637 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:05.541294 32529 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:05.542207 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:05.542984 32491 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.543758 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:05.544694 32637 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.547099 32749 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.547662 32749 raft_consensus.cc:697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:05.548570 32749 consensus_queue.cc:237] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.552311 32687 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:05.553025 32685 tablet_bootstrap.cc:492] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:05.553516 32685 ts_tablet_manager.cc:1403] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.005s
I20260709 12:13:05.530547   310 raft_consensus.cc:697] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:05.562892   310 consensus_queue.cc:237] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.568894 32564 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.557806   322 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.571619 32491 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:05.578634 32381 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:05.578806 32685 raft_consensus.cc:359] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.579614 32685 raft_consensus.cc:385] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.579499 32715 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:05.579510   322 raft_consensus.cc:2804] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.583928   322 raft_consensus.cc:697] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:05.584858   322 consensus_queue.cc:237] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.586342 32685 raft_consensus.cc:740] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.578652 32684 tablet_bootstrap.cc:492] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:05.587369 32684 ts_tablet_manager.cc:1403] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.000s
I20260709 12:13:05.592621 32685 consensus_queue.cc:260] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.596550 32686 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:05.597294 32686 ts_tablet_manager.cc:1403] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.222s	user 0.013s	sys 0.002s
I20260709 12:13:05.587970 32715 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.611666 32685 ts_tablet_manager.cc:1434] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.003s
I20260709 12:13:05.612994 32685 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:05.609647 32686 raft_consensus.cc:359] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.618880 32686 raft_consensus.cc:385] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.619323 32686 raft_consensus.cc:740] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.620518 32686 consensus_queue.cc:260] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.623816 32686 ts_tablet_manager.cc:1434] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 12:13:05.626367 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.626765 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.629033 32381 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:05.630349   327 raft_consensus.cc:2749] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:05.631402 32715 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.633703 32687 tablet_bootstrap.cc:654] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.639174 32637 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:05.643162 32684 raft_consensus.cc:359] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.644011 32684 raft_consensus.cc:385] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.644306 32684 raft_consensus.cc:740] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.645066 32684 consensus_queue.cc:260] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:05.626587   332 log.cc:927] Time spent T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:13:05.653056 32684 ts_tablet_manager.cc:1434] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:13:05.656420 32686 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:05.655802 32765 consensus_queue.cc:1048] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.667590 32765 raft_consensus.cc:493] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.668673 32685 tablet_bootstrap.cc:654] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.668372 32765 raft_consensus.cc:515] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.672358 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.678656 32686 tablet_bootstrap.cc:654] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.679777 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.673390 32765 leader_election.cc:290] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:05.678243 32491 raft_consensus.cc:2468] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
W20260709 12:13:05.685537 32605 leader_election.cc:343] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.686816 32604 leader_election.cc:304] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:05.688236   331 raft_consensus.cc:2804] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.688675   331 raft_consensus.cc:493] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.689531   331 raft_consensus.cc:3060] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.691236 32684 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:05.701356 32686 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:05.702661 32686 ts_tablet_manager.cc:1403] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.008s
I20260709 12:13:05.703230   331 raft_consensus.cc:515] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.708976 32686 raft_consensus.cc:359] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.709775 32686 raft_consensus.cc:385] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.710047 32686 raft_consensus.cc:740] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.710822 32686 consensus_queue.cc:260] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.713594 32686 ts_tablet_manager.cc:1434] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:13:05.714756 32686 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:05.718588 32716 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.719444 32716 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.720156 32717 consensus_queue.cc:1048] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:05.721906 32686 tablet_bootstrap.cc:654] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.723140 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:05.723855 32416 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:05.717798 32312 catalog_manager.cc:5697] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.725805 32603 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.726872 32765 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.726342 32312 catalog_manager.cc:5697] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.727281 32765 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.727667 32765 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.731173   322 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.731757   322 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.733557 32716 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:05.738013 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:05.739032 32565 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:05.744122   322 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.722441 32311 catalog_manager.cc:5697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.746861 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.747896   331 leader_election.cc:290] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:05.756567 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.758420 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:05.759119 32491 raft_consensus.cc:3060] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.760708 32686 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:05.761236 32686 ts_tablet_manager.cc:1403] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.027s
I20260709 12:13:05.761550 32684 tablet_bootstrap.cc:654] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.748044 32637 raft_consensus.cc:2393] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:05.764443 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:05.765583 32381 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:05.764413 32686 raft_consensus.cc:359] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.766314 32686 raft_consensus.cc:385] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.766681 32686 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
W20260709 12:13:05.766889 32605 leader_election.cc:343] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.766945   322 raft_consensus.cc:3060] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.767675 32686 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.771075 32686 ts_tablet_manager.cc:1434] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:13:05.772401 32686 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:05.775972   322 raft_consensus.cc:2749] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.778535 32687 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:05.779137 32687 ts_tablet_manager.cc:1403] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.248s	user 0.023s	sys 0.013s
I20260709 12:13:05.780922 32686 tablet_bootstrap.cc:654] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.783638   323 consensus_queue.cc:1048] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.789925 32687 raft_consensus.cc:359] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.791774 32687 raft_consensus.cc:385] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.792102 32687 raft_consensus.cc:740] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.798059 32686 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:05.798669 32684 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:05.798743 32686 ts_tablet_manager.cc:1403] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.011s
I20260709 12:13:05.799345 32684 ts_tablet_manager.cc:1403] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.010s
I20260709 12:13:05.802194 32686 raft_consensus.cc:359] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.802961 32685 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:05.802985 32686 raft_consensus.cc:385] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.803509 32685 ts_tablet_manager.cc:1403] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.191s	user 0.023s	sys 0.005s
I20260709 12:13:05.804746 32684 raft_consensus.cc:359] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.805490 32684 raft_consensus.cc:385] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.805785 32684 raft_consensus.cc:740] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.806581 32684 consensus_queue.cc:260] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.806854 32685 raft_consensus.cc:359] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.807610 32685 raft_consensus.cc:385] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:05.807904 32685 raft_consensus.cc:740] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.808585 32685 consensus_queue.cc:260] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.803508 32686 raft_consensus.cc:740] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:05.811659 32686 consensus_queue.cc:260] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.792881 32687 consensus_queue.cc:260] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:05.824501 32685 ts_tablet_manager.cc:1434] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:05.827183 32684 ts_tablet_manager.cc:1434] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:13:05.830786 32687 ts_tablet_manager.cc:1434] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:13:05.832249 32686 ts_tablet_manager.cc:1434] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.005s
I20260709 12:13:05.842999 32684 tablet_bootstrap.cc:492] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:05.821571 32765 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.846701 32685 tablet_bootstrap.cc:492] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:05.853051 32686 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:05.857498 32687 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:05.867105 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:05.867928 32565 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.868055 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:05.868675 32416 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.869239 32686 tablet_bootstrap.cc:654] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.869928 32765 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:05.879964 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 45071.9us
I20260709 12:13:05.872857   311 consensus_queue.cc:1048] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:13:05.905155 32565 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:05.905495 32730 consensus_queue.cc:1048] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.909610 32605 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:05.910434   322 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.911839   331 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.912678   331 raft_consensus.cc:697] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:05.913770 32491 raft_consensus.cc:2468] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:05.917802 32685 tablet_bootstrap.cc:654] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.917773   311 consensus_queue.cc:1048] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:05.919960 32416 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:05.921399 32604 leader_election.cc:304] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:05.922693 32765 raft_consensus.cc:2804] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:05.923192 32765 raft_consensus.cc:697] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:05.924057 32765 consensus_queue.cc:237] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.926194 32716 raft_consensus.cc:493] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.926784 32716 raft_consensus.cc:515] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:05.913632   331 consensus_queue.cc:237] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:05.929039 32716 leader_election.cc:290] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:05.931030 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.931073 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:05.933403 32603 leader_election.cc:343] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:05.933996 32604 leader_election.cc:343] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.934682 32604 leader_election.cc:304] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:05.935134   313 consensus_queue.cc:1048] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:05.937033   313 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.937565   313 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:05.946574 32684 tablet_bootstrap.cc:654] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.947329   313 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:05.941845 32716 raft_consensus.cc:2749] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:05.924057 32687 tablet_bootstrap.cc:654] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:05.949612 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:05.955858 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:05.964627   351 log.cc:927] Time spent T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:13:05.966202   313 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.966822   313 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:05.959265 32529 leader_election.cc:343] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.969121   313 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:05.969368 32530 leader_election.cc:343] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:05.970055 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:05.970873 32414 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:05.971832 32530 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:05.985358 32687 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:05.985999 32687 ts_tablet_manager.cc:1403] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.007s
I20260709 12:13:05.988363 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:05.989187 32490 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:05.991173 32529 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:05.992220 32749 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:05.992619 32749 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.992998 32749 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:05.989053 32564 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:05.999889 32715 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.001497 32715 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.005002 32686 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.005594 32686 ts_tablet_manager.cc:1403] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.002s
I20260709 12:13:05.977959   313 raft_consensus.cc:2749] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:06.021643 32684 tablet_bootstrap.cc:492] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.022547 32684 ts_tablet_manager.cc:1403] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.188s	user 0.010s	sys 0.006s
I20260709 12:13:06.029047 32687 raft_consensus.cc:359] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.030216 32687 raft_consensus.cc:385] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.030620 32687 raft_consensus.cc:740] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.034374   313 consensus_queue.cc:1048] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.036746 32687 consensus_queue.cc:260] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.047785 32687 ts_tablet_manager.cc:1434] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
I20260709 12:13:06.064313 32686 raft_consensus.cc:359] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.064700 32684 raft_consensus.cc:359] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.065464 32684 raft_consensus.cc:385] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.065742 32684 raft_consensus.cc:740] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.066828   310 consensus_queue.cc:1048] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.065135 32686 raft_consensus.cc:385] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.068265 32686 raft_consensus.cc:740] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.071245 32687 tablet_bootstrap.cc:492] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:06.071998 32684 consensus_queue.cc:260] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.074393 32686 consensus_queue.cc:260] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.074652 32312 catalog_manager.cc:5697] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.077152 32416 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.082501 32312 catalog_manager.cc:5697] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.086580 32686 ts_tablet_manager.cc:1434] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 12:13:06.091892 32684 ts_tablet_manager.cc:1434] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.003s
I20260709 12:13:06.093611 32684 tablet_bootstrap.cc:492] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:06.101739 32684 tablet_bootstrap.cc:654] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.104898 32749 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.108870 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:06.109846 32414 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.114149 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:06.110391 32749 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:06.125229 32686 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:06.124408 32489 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.132627 32685 tablet_bootstrap.cc:492] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:06.133309 32685 ts_tablet_manager.cc:1403] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.295s	user 0.011s	sys 0.010s
I20260709 12:13:06.138298 32636 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:06.141259 32489 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:06.142243   310 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.142611 32530 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:06.154196   365 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:06.155993 32684 tablet_bootstrap.cc:492] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.156553 32684 ts_tablet_manager.cc:1403] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.013s
I20260709 12:13:06.143788   313 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.157127   313 raft_consensus.cc:697] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:06.160872   313 consensus_queue.cc:237] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.164405 32685 raft_consensus.cc:359] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.167836 32685 raft_consensus.cc:385] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.168881 32684 raft_consensus.cc:359] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.169691 32684 raft_consensus.cc:385] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.169991 32684 raft_consensus.cc:740] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.171723 32684 consensus_queue.cc:260] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.172820 32686 tablet_bootstrap.cc:654] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.175439 32684 ts_tablet_manager.cc:1434] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:13:06.168303 32685 raft_consensus.cc:740] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.176743 32687 tablet_bootstrap.cc:654] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.178987 32685 consensus_queue.cc:260] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.196633   310 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.197358   310 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.199698 32684 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:06.199748 32685 ts_tablet_manager.cc:1434] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.002s
I20260709 12:13:06.206933 32414 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:06.207682 32749 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.213762   310 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:06.215488 32685 tablet_bootstrap.cc:492] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:06.220079 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.226903 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.250852 32717 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.251436 32717 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.256326 32380 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:06.262907   310 raft_consensus.cc:2749] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:06.263742 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:06.269905 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.270766 32563 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
W20260709 12:13:06.271185 32604 leader_election.cc:343] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.272434 32605 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.274559 32765 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:06.274966 32765 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.275310 32765 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.276391 32685 tablet_bootstrap.cc:654] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.276033   310 consensus_queue.cc:1048] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.276628 32717 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:06.285753 32686 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.286456 32686 ts_tablet_manager.cc:1403] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.171s	user 0.010s	sys 0.007s
I20260709 12:13:06.290156 32686 raft_consensus.cc:359] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.291049 32686 raft_consensus.cc:385] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.291342 32686 raft_consensus.cc:740] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.292153 32686 consensus_queue.cc:260] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.298502 32686 ts_tablet_manager.cc:1434] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:13:06.302748 32687 tablet_bootstrap.cc:492] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:06.303351 32687 ts_tablet_manager.cc:1403] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.233s	user 0.022s	sys 0.014s
I20260709 12:13:06.306531   365 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.307348   365 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.308233 32686 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:06.311070 32684 tablet_bootstrap.cc:654] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.311825 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:06.314050 32530 leader_election.cc:343] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.315274   365 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:06.316525 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.317307 32636 raft_consensus.cc:2468] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:06.317608 32765 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.319123 32529 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.320849 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:06.322153   365 raft_consensus.cc:2804] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:06.323572   365 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.324098   365 raft_consensus.cc:3060] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.324458 32686 tablet_bootstrap.cc:654] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.317291 32687 raft_consensus.cc:359] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.326871 32687 raft_consensus.cc:385] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.327175 32687 raft_consensus.cc:740] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.328107 32687 consensus_queue.cc:260] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:06.329005 32604 leader_election.cc:343] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.331848 32685 tablet_bootstrap.cc:492] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:06.332427 32685 ts_tablet_manager.cc:1403] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.020s
I20260709 12:13:06.335430 32685 raft_consensus.cc:359] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.336143 32685 raft_consensus.cc:385] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.336439 32685 raft_consensus.cc:740] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.331851 32687 ts_tablet_manager.cc:1434] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:13:06.339178 32687 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:06.341326 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:06.342039 32564 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.337984 32685 consensus_queue.cc:260] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.348122 32687 tablet_bootstrap.cc:654] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.348582 32765 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:06.352195 32685 ts_tablet_manager.cc:1434] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:13:06.352859 32686 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.353431 32686 ts_tablet_manager.cc:1403] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.002s
I20260709 12:13:06.353658 32685 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:06.356077   365 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.356559 32749 raft_consensus.cc:493] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.364310 32749 raft_consensus.cc:515] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.367588 32749 leader_election.cc:290] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:06.358002 32564 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:06.362480 32685 tablet_bootstrap.cc:654] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.362586   331 consensus_queue.cc:1048] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:06.356678 32686 raft_consensus.cc:359] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.372762 32686 raft_consensus.cc:385] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.373267 32686 raft_consensus.cc:740] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.374107 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.374064 32686 consensus_queue.cc:260] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.376596 32686 ts_tablet_manager.cc:1434] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:13:06.378074 32686 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:06.378829 32684 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.369315 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:06.379372 32684 ts_tablet_manager.cc:1403] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.008s
I20260709 12:13:06.383211 32530 leader_election.cc:304] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.384344 32686 tablet_bootstrap.cc:654] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.387468 32749 raft_consensus.cc:2749] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:06.390507 32684 raft_consensus.cc:359] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.391345 32684 raft_consensus.cc:385] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.391718 32684 raft_consensus.cc:740] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.396510 32684 consensus_queue.cc:260] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.398947   331 consensus_queue.cc:1048] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.421480 32684 ts_tablet_manager.cc:1434] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 12:13:06.421662 32605 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.423156 32684 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:06.423476   331 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.424206   331 raft_consensus.cc:697] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:06.425326   331 consensus_queue.cc:237] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.437959 32765 consensus_queue.cc:1048] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:06.446561 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:06.448925 32530 leader_election.cc:343] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.464388   310 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.465421   310 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.470311   310 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:06.472733 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:06.474822 32382 leader_election.cc:343] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.472781 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:06.477283 32684 tablet_bootstrap.cc:654] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:06.477813 32381 leader_election.cc:343] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.490753 32381 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.482578   352 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.492702   352 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.494727 32687 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:06.495301 32687 ts_tablet_manager.cc:1403] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.051s
I20260709 12:13:06.495365   352 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:06.496177   310 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:06.482918 32686 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.497193 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.498689 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:06.499419 32416 raft_consensus.cc:2468] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:06.498715 32687 raft_consensus.cc:359] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
W20260709 12:13:06.501538 32455 leader_election.cc:343] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.501950 32687 raft_consensus.cc:385] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.502413 32455 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:06.486647 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:06.503903 32637 raft_consensus.cc:3060] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.505378 32685 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:06.505911 32685 ts_tablet_manager.cc:1403] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.153s	user 0.027s	sys 0.044s
I20260709 12:13:06.497237 32686 ts_tablet_manager.cc:1403] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.120s	user 0.049s	sys 0.027s
I20260709 12:13:06.509289 32685 raft_consensus.cc:359] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.502599 32687 raft_consensus.cc:740] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.503412   352 raft_consensus.cc:2804] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:06.510512   352 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.510907   352 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.510789 32312 catalog_manager.cc:5697] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.514901 32564 raft_consensus.cc:3060] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.485247   365 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:06.510069 32685 raft_consensus.cc:385] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:06.515204 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:06.525687 32686 raft_consensus.cc:359] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.532866 32687 consensus_queue.cc:260] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.543726 32686 raft_consensus.cc:385] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.544057 32686 raft_consensus.cc:740] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.540817 32310 catalog_manager.cc:5697] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.525944 32685 raft_consensus.cc:740] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.544837 32686 consensus_queue.cc:260] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.545279 32685 consensus_queue.cc:260] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.545853 32687 ts_tablet_manager.cc:1434] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:13:06.534459 32717 consensus_queue.cc:1048] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:13:06.547585 32687 tablet_bootstrap.cc:492] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:06.547638 32686 ts_tablet_manager.cc:1434] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:13:06.549014 32686 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:06.549948 32685 ts_tablet_manager.cc:1434] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 12:13:06.551203 32685 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:06.536573   352 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.555764 32686 tablet_bootstrap.cc:654] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.533789 32637 raft_consensus.cc:2468] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:06.557240 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:06.558370 32529 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:06.558946 32455 leader_election.cc:343] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.560113 32684 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.559955   365 raft_consensus.cc:2804] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.560741 32684 ts_tablet_manager.cc:1403] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.000s
I20260709 12:13:06.560763   365 raft_consensus.cc:697] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:06.562704   365 consensus_queue.cc:237] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.563931 32684 raft_consensus.cc:359] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.564693 32684 raft_consensus.cc:385] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.564970 32684 raft_consensus.cc:740] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.565896 32684 consensus_queue.cc:260] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.568106 32684 ts_tablet_manager.cc:1434] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:06.568812   352 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:06.569268 32684 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:06.576253 32687 tablet_bootstrap.cc:654] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.579440 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:06.581262 32415 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.585031 32684 tablet_bootstrap.cc:654] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.578730   310 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.586795 32686 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.587440 32686 ts_tablet_manager.cc:1403] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.015s
I20260709 12:13:06.586675   310 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.588289 32687 tablet_bootstrap.cc:492] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:06.590502 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:06.591339 32687 ts_tablet_manager.cc:1403] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.001s
W20260709 12:13:06.594113 32381 leader_election.cc:343] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.594491 32687 raft_consensus.cc:359] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.595201 32687 raft_consensus.cc:385] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.595460 32687 raft_consensus.cc:740] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.596246   310 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:06.597806 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.599252 32686 raft_consensus.cc:359] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:06.605334 32382 leader_election.cc:343] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.605568 32686 raft_consensus.cc:385] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.605849 32382 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.606698   310 raft_consensus.cc:2749] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:06.605867 32686 raft_consensus.cc:740] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.596158 32687 consensus_queue.cc:260] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.607846 32686 consensus_queue.cc:260] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.609887 32686 ts_tablet_manager.cc:1434] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:13:06.609887 32687 ts_tablet_manager.cc:1434] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:13:06.611264 32686 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:06.611264 32687 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:06.612035 32685 tablet_bootstrap.cc:654] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.619858 32687 tablet_bootstrap.cc:654] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.602805 32684 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.608959 32311 catalog_manager.cc:5697] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.620844 32684 ts_tablet_manager.cc:1403] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.003s
I20260709 12:13:06.624306   365 consensus_queue.cc:1048] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.620086 32686 tablet_bootstrap.cc:654] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.627774 32415 raft_consensus.cc:2468] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:06.624650 32684 raft_consensus.cc:359] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.628469 32684 raft_consensus.cc:385] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.628777 32684 raft_consensus.cc:740] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.629547 32684 consensus_queue.cc:260] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.629783 32455 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:06.635629   352 raft_consensus.cc:2804] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.636325   352 raft_consensus.cc:697] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:06.637215   352 consensus_queue.cc:237] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.644729 32684 ts_tablet_manager.cc:1434] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:13:06.646462 32684 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:06.653755 32686 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.654378 32686 ts_tablet_manager.cc:1403] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 12:13:06.655223   323 raft_consensus.cc:493] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.655611 32685 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:06.656114 32685 ts_tablet_manager.cc:1403] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.011s
I20260709 12:13:06.655776   323 raft_consensus.cc:515] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.657382 32686 raft_consensus.cc:359] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.658150 32686 raft_consensus.cc:385] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.658363   323 leader_election.cc:290] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:06.658515 32686 raft_consensus.cc:740] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.659190 32685 raft_consensus.cc:359] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.659415 32686 consensus_queue.cc:260] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.659884 32685 raft_consensus.cc:385] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.660681 32685 raft_consensus.cc:740] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.662376 32684 tablet_bootstrap.cc:654] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.664203 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.665011 32637 raft_consensus.cc:2468] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:06.666311 32685 consensus_queue.cc:260] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.667389 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:06.668340 32415 raft_consensus.cc:2468] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:06.669719 32686 ts_tablet_manager.cc:1434] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:13:06.676312 32455 leader_election.cc:304] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:06.678526   352 raft_consensus.cc:2804] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:06.679112   352 raft_consensus.cc:493] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.679563   352 raft_consensus.cc:3060] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.679755 32685 ts_tablet_manager.cc:1434] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:13:06.680812   368 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.681473   368 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.687623 32685 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:06.690200 32686 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:06.694170   313 consensus_queue.cc:1048] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:06.710546   323 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.711220   323 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.712446 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:06.714074 32530 leader_election.cc:343] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.713510   368 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:06.715022 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.718164 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.719089 32563 raft_consensus.cc:2393] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:06.719969 32310 catalog_manager.cc:5697] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.722945 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:06.723701 32416 raft_consensus.cc:2468] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:06.725467 32455 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:06.726356   311 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.727614 32529 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.729935   313 raft_consensus.cc:2804] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:06.730358   313 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.730711   313 raft_consensus.cc:3060] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.731141   310 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.731693   310 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.732865 32685 tablet_bootstrap.cc:654] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.736526   331 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.737174   331 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.742909 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.744148 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.745035 32564 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:06.746397 32382 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
W20260709 12:13:06.747093 32605 leader_election.cc:343] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.734104   310 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:06.748004 32715 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:06.748546 32715 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.748967 32715 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.756208   331 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:06.757387 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:06.758455   323 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:06.759652 32603 leader_election.cc:343] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.761123 32603 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:06.762727   331 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:06.768798   311 raft_consensus.cc:2749] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:06.783515 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 56898.7us
I20260709 12:13:06.783835   403 raft_consensus.cc:493] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.784749   403 raft_consensus.cc:515] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:06.787820   403 leader_election.cc:290] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:06.792630 32687 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:06.797223 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:06.797537 32684 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.798466 32684 ts_tablet_manager.cc:1403] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.152s	user 0.058s	sys 0.043s
W20260709 12:13:06.799280 32457 leader_election.cc:343] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.800132 32687 ts_tablet_manager.cc:1403] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.189s	user 0.028s	sys 0.037s
I20260709 12:13:06.803687 32686 tablet_bootstrap.cc:654] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.805580   352 raft_consensus.cc:515] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.808086 32715 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.823076 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:06.824141 32563 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.830075 32715 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:06.851970 32686 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:06.852980 32686 ts_tablet_manager.cc:1403] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.009s
I20260709 12:13:06.842973   313 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.858745   313 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:06.861759 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:06.861912 32684 raft_consensus.cc:359] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.862937 32684 raft_consensus.cc:385] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.863225 32684 raft_consensus.cc:740] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
W20260709 12:13:06.863809 32530 leader_election.cc:343] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.864567 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:06.864926 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:06.863878 32687 raft_consensus.cc:359] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.865520 32687 raft_consensus.cc:385] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.865553 32636 raft_consensus.cc:3060] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.865906 32687 raft_consensus.cc:740] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
W20260709 12:13:06.866377 32455 leader_election.cc:343] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.866930 32455 leader_election.cc:304] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:06.866760 32687 consensus_queue.cc:260] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.868696   352 leader_election.cc:290] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:06.869308   405 raft_consensus.cc:2749] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:06.871516 32687 ts_tablet_manager.cc:1434] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:13:06.874907 32687 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:06.875011 32636 raft_consensus.cc:2468] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:06.863904 32684 consensus_queue.cc:260] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.861754 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:06.877722 32416 raft_consensus.cc:3060] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.881969 32687 tablet_bootstrap.cc:654] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.885371 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:06.886045 32414 raft_consensus.cc:3060] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.887036 32563 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:06.887748 32684 ts_tablet_manager.cc:1434] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.001s
I20260709 12:13:06.888937 32684 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:06.893452 32455 leader_election.cc:304] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:06.901234 32382 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:06.905038   404 raft_consensus.cc:2804] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.905726   404 raft_consensus.cc:697] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:06.906672   404 consensus_queue.cc:237] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.915140 32416 raft_consensus.cc:2468] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:06.919610 32529 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.917330 32685 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:06.921185   313 raft_consensus.cc:2804] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.921379 32685 ts_tablet_manager.cc:1403] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.234s	user 0.049s	sys 0.029s
I20260709 12:13:06.921761   313 raft_consensus.cc:697] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:06.922756   313 consensus_queue.cc:237] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.918112 32684 tablet_bootstrap.cc:654] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:06.931804   310 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:06.933048   310 raft_consensus.cc:697] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:06.934054   310 consensus_queue.cc:237] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:06.934996 32716 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.935711 32716 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:06.938447 32685 raft_consensus.cc:359] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.942277 32716 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:06.939178 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:06.943163 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:06.944329 32413 raft_consensus.cc:2393] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:06.945493 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:06.948172 32381 leader_election.cc:343] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:06.949393 32381 leader_election.cc:343] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:06.951861 32716 consensus_queue.cc:1048] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.953120 32686 raft_consensus.cc:359] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.939213 32685 raft_consensus.cc:385] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.979053 32716 consensus_queue.cc:1048] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:06.979454 32685 raft_consensus.cc:740] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.980545 32685 consensus_queue.cc:260] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.981319 32414 raft_consensus.cc:2468] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:06.983968 32685 ts_tablet_manager.cc:1434] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:13:06.985533 32685 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:06.958158 32687 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:06.970916   368 consensus_queue.cc:1048] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:06.986763 32687 ts_tablet_manager.cc:1403] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.112s	user 0.044s	sys 0.029s
I20260709 12:13:06.975965 32684 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:06.988124 32684 ts_tablet_manager.cc:1403] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.007s
I20260709 12:13:06.977922 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:06.991822 32604 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:06.993180   331 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:06.992942 32684 raft_consensus.cc:359] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:06.993803 32684 raft_consensus.cc:385] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:06.994098 32684 raft_consensus.cc:740] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:06.995446 32684 consensus_queue.cc:260] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.009142 32684 ts_tablet_manager.cc:1434] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:07.011507 32684 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:07.011729 32685 tablet_bootstrap.cc:654] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.013711 32311 catalog_manager.cc:5697] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.000744 32686 raft_consensus.cc:385] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.015316 32686 raft_consensus.cc:740] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.016170 32686 consensus_queue.cc:260] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.004205 32765 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.017939 32765 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.020217 32765 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:07.021456 32530 consensus_peers.cc:597] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.021890 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.001461 32687 raft_consensus.cc:359] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.023120 32687 raft_consensus.cc:385] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:07.023491 32603 leader_election.cc:343] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.023504 32687 raft_consensus.cc:740] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.031328 32687 consensus_queue.cc:260] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.036085 32687 ts_tablet_manager.cc:1434] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 12:13:07.037340 32687 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:07.045913 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:07.047322   409 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.050585   409 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.051613 32685 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:07.052282 32685 ts_tablet_manager.cc:1403] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.000s
I20260709 12:13:07.052939   409 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:07.053823 32684 tablet_bootstrap.cc:654] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.055040 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:07.055938 32685 raft_consensus.cc:359] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:07.056664 32382 leader_election.cc:343] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.056953 32685 raft_consensus.cc:385] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.057469 32685 raft_consensus.cc:740] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.058503 32685 consensus_queue.cc:260] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.061280 32685 ts_tablet_manager.cc:1434] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:13:07.061353 32311 catalog_manager.cc:5697] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.062668 32685 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:07.063227 32687 tablet_bootstrap.cc:654] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.047748 32312 catalog_manager.cc:5697] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.049645 32686 ts_tablet_manager.cc:1434] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.196s	user 0.009s	sys 0.000s
I20260709 12:13:07.070173 32686 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:07.075996   331 raft_consensus.cc:2749] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.076841 32684 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:07.077477 32684 ts_tablet_manager.cc:1403] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.004s
W20260709 12:13:07.047580 32604 leader_election.cc:343] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.078811 32604 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:07.080585 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.081082 32717 raft_consensus.cc:2749] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.081261 32637 raft_consensus.cc:2468] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:07.081812 32717 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.082248 32717 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.082599 32380 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:07.085597 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:07.085716   409 raft_consensus.cc:2804] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.085856 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.086337   409 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.086724 32717 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.083670 32684 raft_consensus.cc:359] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.088056 32684 raft_consensus.cc:385] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.088899 32684 raft_consensus.cc:740] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.089639 32684 consensus_queue.cc:260] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.093075 32684 ts_tablet_manager.cc:1434] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:13:07.093533 32685 tablet_bootstrap.cc:654] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.094200 32684 tablet_bootstrap.cc:492] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:07.086728   409 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:07.099251 32605 leader_election.cc:343] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.101440 32684 tablet_bootstrap.cc:654] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.124259 32687 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:07.124814 32687 ts_tablet_manager.cc:1403] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.005s
I20260709 12:13:07.126168 32686 tablet_bootstrap.cc:654] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.129011 32687 raft_consensus.cc:359] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.130234 32687 raft_consensus.cc:385] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.130725 32687 raft_consensus.cc:740] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.131973 32687 consensus_queue.cc:260] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.135958 32687 ts_tablet_manager.cc:1434] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.001s
I20260709 12:13:07.141808   404 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.142688   404 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.146446 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.146782   404 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:07.147192 32414 raft_consensus.cc:2468] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:07.147953 32687 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:07.149809 32455 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:07.150745   323 raft_consensus.cc:2804] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.150765 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:07.157065 32457 leader_election.cc:343] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.151124   323 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.164244 32687 tablet_bootstrap.cc:654] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.161391   323 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.191867   409 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.193729 32415 raft_consensus.cc:2393] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:07.198287 32603 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.200018   331 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.225814 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:07.226728   409 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:07.236141 32717 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.237318 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:07.237318 32717 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:07.239910 32382 leader_election.cc:343] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.240113 32717 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.247673   405 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.248239   405 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.249639 32687 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:07.250272 32687 ts_tablet_manager.cc:1403] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.008s
I20260709 12:13:07.250466   405 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:07.252888 32685 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:07.253424 32685 ts_tablet_manager.cc:1403] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.191s	user 0.028s	sys 0.074s
I20260709 12:13:07.254431 32684 tablet_bootstrap.cc:492] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:07.254886 32684 ts_tablet_manager.cc:1403] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.161s	user 0.027s	sys 0.030s
I20260709 12:13:07.257575 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:07.257961 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.258569   323 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.257576 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.259086   418 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.259670 32413 raft_consensus.cc:2393] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 1: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:07.260082 32686 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:07.259630   418 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.260563 32686 ts_tablet_manager.cc:1403] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.191s	user 0.021s	sys 0.039s
I20260709 12:13:07.264437   323 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:07.264508 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.246978   331 raft_consensus.cc:2749] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.265625 32687 raft_consensus.cc:359] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.267552 32687 raft_consensus.cc:385] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.267813 32687 raft_consensus.cc:740] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.262192   418 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.265684 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:07.270658 32605 leader_election.cc:343] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.270826   323 consensus_queue.cc:1048] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:07.271054 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:07.272354 32455 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.271579 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:07.271879 32715 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.268893 32685 raft_consensus.cc:359] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.273586 32715 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.273711 32685 raft_consensus.cc:385] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.273985 32686 raft_consensus.cc:359] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.273315   323 consensus_queue.cc:1048] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:13:07.271389 32529 leader_election.cc:343] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.275578 32687 consensus_queue.cc:260] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.274906 32684 raft_consensus.cc:359] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.276902 32684 raft_consensus.cc:385] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.277210 32684 raft_consensus.cc:740] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.277268 32715 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:07.277221 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.274878 32686 raft_consensus.cc:385] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.274560 32685 raft_consensus.cc:740] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.278143 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:07.278427 32687 ts_tablet_manager.cc:1434] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:13:07.278044 32684 consensus_queue.cc:260] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.278858 32563 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:07.272555 32413 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.279120 32685 consensus_queue.cc:260] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.278425 32686 raft_consensus.cc:740] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.282531 32687 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:07.283108 32684 ts_tablet_manager.cc:1434] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:13:07.283563 32382 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:07.284169 32684 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:07.278178 32639 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:07.286537 32715 raft_consensus.cc:2804] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.286954 32715 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.287274 32715 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:07.286319 32457 leader_election.cc:343] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:07.310374 32603 leader_election.cc:343] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.282004 32686 consensus_queue.cc:260] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.316890 32686 ts_tablet_manager.cc:1434] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:13:07.318017 32686 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:07.315728 32603 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.319169 32717 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.314760 32685 ts_tablet_manager.cc:1434] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.003s
I20260709 12:13:07.325992 32687 tablet_bootstrap.cc:654] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.326951 32685 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:07.330858 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.332983   323 raft_consensus.cc:3060] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.331967 32413 raft_consensus.cc:2468] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:07.348865   352 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.351135   352 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.337342 32639 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
W20260709 12:13:07.337852 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 65592.4us
I20260709 12:13:07.360256 32529 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.361524   418 raft_consensus.cc:2804] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.361819   418 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.362026   418 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.369532 32685 tablet_bootstrap.cc:654] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.366861   352 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.375134 32687 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:07.375727 32687 ts_tablet_manager.cc:1403] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.012s
I20260709 12:13:07.376394 32684 tablet_bootstrap.cc:654] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.379287 32687 raft_consensus.cc:359] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.380210 32687 raft_consensus.cc:385] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.380560 32687 raft_consensus.cc:740] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.381673 32687 consensus_queue.cc:260] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.387647   368 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.388064   409 consensus_queue.cc:1048] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:07.388443   368 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.397627 32455 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:07.381974 32715 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.408546   418 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.409011 32715 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:07.409879 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:07.410737   368 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.411194   352 raft_consensus.cc:2804] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:07.413890   352 raft_consensus.cc:697] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:07.413932 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.414928   352 consensus_queue.cc:237] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.416119 32564 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.416319 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.417021 32638 raft_consensus.cc:2468] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:07.418390 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.418494 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:07.419239 32635 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.423056 32749 consensus_queue.cc:1048] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:07.425264   418 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.414937 32415 raft_consensus.cc:2393] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:07.426959 32687 ts_tablet_manager.cc:1434] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:13:07.412603 32686 tablet_bootstrap.cc:654] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.430213 32687 tablet_bootstrap.cc:492] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:07.439695   405 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.440557   405 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.441593   323 raft_consensus.cc:2749] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.443951 32529 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.444460 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:07.446619 32749 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.449812 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:07.450645 32636 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.451346 32564 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:07.452745   418 consensus_queue.cc:1048] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:07.455307 32382 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
W20260709 12:13:07.459856 32529 leader_election.cc:343] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.460078   409 raft_consensus.cc:2804] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:07.461114   409 raft_consensus.cc:697] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:07.468583   405 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.470453 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.462220   409 consensus_queue.cc:237] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.429492 32637 raft_consensus.cc:2468] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:07.488312 32684 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:07.489091 32684 ts_tablet_manager.cc:1403] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.205s	user 0.007s	sys 0.021s
I20260709 12:13:07.496086   323 consensus_queue.cc:1048] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:07.500954 32687 tablet_bootstrap.cc:654] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.509650 32684 raft_consensus.cc:359] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.510771 32684 raft_consensus.cc:385] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.511191 32684 raft_consensus.cc:740] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.512334 32684 consensus_queue.cc:260] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.513518 32635 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:07.507830 32636 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:07.515961 32529 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.516389 32684 ts_tablet_manager.cc:1434] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 12:13:07.517184   418 raft_consensus.cc:2804] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:07.517727   418 raft_consensus.cc:697] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:07.518632   418 consensus_queue.cc:237] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.519326 32684 tablet_bootstrap.cc:492] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:07.532094 32310 catalog_manager.cc:5697] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.535187 32685 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:07.535969 32685 ts_tablet_manager.cc:1403] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.209s	user 0.007s	sys 0.014s
I20260709 12:13:07.531261 32380 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
W20260709 12:13:07.507371 32455 leader_election.cc:343] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.546128 32715 raft_consensus.cc:2804] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:07.546846 32715 raft_consensus.cc:697] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:07.548098 32715 consensus_queue.cc:237] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:07.558180 32686 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:07.558826 32686 ts_tablet_manager.cc:1403] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.241s	user 0.009s	sys 0.011s
I20260709 12:13:07.553207 32313 catalog_manager.cc:5697] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.566681 32684 tablet_bootstrap.cc:654] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.582768 32490 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.589154 32686 raft_consensus.cc:359] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.590306 32686 raft_consensus.cc:385] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.590678 32686 raft_consensus.cc:740] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.598373 32686 consensus_queue.cc:260] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.601457 32686 ts_tablet_manager.cc:1434] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.004s
W20260709 12:13:07.578410 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 75075.6us
I20260709 12:13:07.630471   439 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.633963 32686 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:07.631119   439 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.660930 32687 tablet_bootstrap.cc:492] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:07.661564 32687 ts_tablet_manager.cc:1403] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.232s	user 0.024s	sys 0.010s
I20260709 12:13:07.664502 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:07.678639 32489 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:07.670646 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.680043 32635 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:07.679904 32687 raft_consensus.cc:359] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.680696 32687 raft_consensus.cc:385] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.680992 32687 raft_consensus.cc:740] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.682837 32380 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:07.666158   439 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:07.685642   439 consensus_queue.cc:1048] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:07.674685 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:07.676806   438 log.cc:927] Time spent T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:13:07.688467 32637 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:07.681712 32687 consensus_queue.cc:260] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.688979 32686 tablet_bootstrap.cc:654] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.668176 32310 catalog_manager.cc:5697] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.647763 32749 raft_consensus.cc:2749] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.698704 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.699442 32684 tablet_bootstrap.cc:492] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:07.700002 32684 ts_tablet_manager.cc:1403] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.024s
I20260709 12:13:07.708576 32684 raft_consensus.cc:359] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.711128 32684 raft_consensus.cc:385] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.711576 32684 raft_consensus.cc:740] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.712536 32684 consensus_queue.cc:260] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.691850   310 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.715874 32413 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:07.716554   310 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.720741   310 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.723878 32685 raft_consensus.cc:359] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.728382 32685 raft_consensus.cc:385] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.729214 32685 raft_consensus.cc:740] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.730209 32685 consensus_queue.cc:260] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.732692 32685 ts_tablet_manager.cc:1434] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.196s	user 0.006s	sys 0.003s
I20260709 12:13:07.719949 32455 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:07.725641 32687 ts_tablet_manager.cc:1434] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:13:07.739035   352 raft_consensus.cc:2804] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.739524   352 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.741768   352 raft_consensus.cc:3060] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.747136 32684 ts_tablet_manager.cc:1434] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.002s
I20260709 12:13:07.750388 32684 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:07.751533 32687 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:07.752410 32685 tablet_bootstrap.cc:492] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:07.766660   331 raft_consensus.cc:493] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.767309   331 raft_consensus.cc:515] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.768615   310 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.769716   331 leader_election.cc:290] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:07.773092 32684 tablet_bootstrap.cc:654] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.786770   323 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.787433   323 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:07.791010 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:07.791368   323 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:07.796308   310 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:07.796562 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:07.798892   405 consensus_queue.cc:1048] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:07.799572 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:07.802580 32455 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:07.804009   452 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.804456   452 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.804818   452 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.806821 32637 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:07.811844 32605 leader_election.cc:343] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:07.838979 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:07.839898 32489 raft_consensus.cc:2468] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:07.842624 32687 tablet_bootstrap.cc:654] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.847843   352 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.849712 32686 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:07.849628 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:07.850437 32686 ts_tablet_manager.cc:1403] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.221s	user 0.024s	sys 0.016s
I20260709 12:13:07.853193   418 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.853793   418 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:07.855108 32686 raft_consensus.cc:359] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.855866 32686 raft_consensus.cc:385] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.856132 32686 raft_consensus.cc:740] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.856912 32686 consensus_queue.cc:260] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.861562 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:07.863029 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:07.864941   418 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:07.851714 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:07.866168 32686 ts_tablet_manager.cc:1434] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:13:07.869462 32686 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:07.871033   352 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:07.871503 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:07.872187 32639 raft_consensus.cc:3060] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.873147 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:07.876408 32604 leader_election.cc:304] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:07.877249   331 raft_consensus.cc:2804] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:07.877631   331 raft_consensus.cc:493] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.878005   331 raft_consensus.cc:3060] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.877022 32455 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:07.888355 32313 catalog_manager.cc:5697] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.890452 32414 raft_consensus.cc:2393] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:07.893594 32637 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:07.895614 32380 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:07.896569   310 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:07.897078   310 raft_consensus.cc:697] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:07.897998 32529 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:07.898010   310 consensus_queue.cc:237] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:07.902477   418 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.903939   323 raft_consensus.cc:2749] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:07.939950 32639 raft_consensus.cc:2468] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:07.997562 32686 tablet_bootstrap.cc:654] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.996165   452 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.008611 32685 tablet_bootstrap.cc:654] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.004750   331 raft_consensus.cc:515] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.034116   452 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:08.034848 32684 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:08.036545 32684 ts_tablet_manager.cc:1403] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.286s	user 0.015s	sys 0.012s
I20260709 12:13:08.050983   331 leader_election.cc:290] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:08.061880 32687 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:08.062619 32687 ts_tablet_manager.cc:1403] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.321s	user 0.013s	sys 0.013s
I20260709 12:13:08.052383   418 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.068540 32687 raft_consensus.cc:359] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:08.069478 32687 raft_consensus.cc:385] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.069819 32687 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.070626 32687 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:08.074873 32687 ts_tablet_manager.cc:1434] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:08.161339 32687 tablet_bootstrap.cc:492] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:08.166733 32684 raft_consensus.cc:359] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.167687 32684 raft_consensus.cc:385] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.167981 32684 raft_consensus.cc:740] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.610598 32491 raft_consensus.cc:3060] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.617118   464 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.617929   464 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.620379   464 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:08.168784 32684 consensus_queue.cc:260] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.625589   464 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.626297   464 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.629041   464 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:08.630415 32684 ts_tablet_manager.cc:1434] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.594s	user 0.008s	sys 0.010s
W20260709 12:13:08.630812 32684 ts_tablet_manager.cc:1467] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Tablet startup took 593ms
I20260709 12:13:08.637518 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:08.638574 32634 raft_consensus.cc:2393] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
W20260709 12:13:08.631147 32684 ts_tablet_manager.cc:1469] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Trace:
0709 12:13:03.061835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.062032 (+   197us) service_pool.cc:224] Handling call
0709 12:13:03.105376 (+ 43344us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:03.105520 (+   144us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:03.338712 (+233192us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:03.386545 (+ 47833us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:03.387248 (+   703us) inbound_call.cc:177] Queueing success response
0709 12:13:07.749883 (+4362635us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:13:08.036927 (+287044us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:13:08.164206 (+127279us) tablet_replica.cc:261] Starting instrumentation
0709 12:13:08.164780 (+   574us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":245,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":141,"tablet-open.queue_time_us":4362753}
I20260709 12:13:08.645265   465 consensus_queue.cc:1048] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:08.645529   464 consensus_queue.cc:1048] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:08.648448 32684 tablet_bootstrap.cc:492] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:08.651715 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:08.656802 32638 raft_consensus.cc:2468] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:08.669342 32684 tablet_bootstrap.cc:654] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.670830   310 consensus_queue.cc:1048] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:08.677750 32380 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:08.682317   465 raft_consensus.cc:2804] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.683043   465 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.683553   465 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.696460   465 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.699854   465 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:08.705880 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:08.706679 32414 raft_consensus.cc:3060] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.707793 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:08.716169 32687 tablet_bootstrap.cc:654] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.720014 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:08.720873 32637 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:08.722425 32685 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.011s	sys 0.000s
W20260709 12:13:08.722836 32685 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.001s
I20260709 12:13:08.725281 32685 tablet_bootstrap.cc:492] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:08.725798 32685 ts_tablet_manager.cc:1403] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.975s	user 0.019s	sys 0.010s
I20260709 12:13:08.702096 32455 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:08.726807   452 raft_consensus.cc:2804] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.727324   452 raft_consensus.cc:697] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:08.729120 32685 raft_consensus.cc:359] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.730737 32414 raft_consensus.cc:2468] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:08.729297   452 consensus_queue.cc:237] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.730032 32685 raft_consensus.cc:385] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.741662 32685 raft_consensus.cc:740] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.742573 32685 consensus_queue.cc:260] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.745648 32685 ts_tablet_manager.cc:1434] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:13:08.766855   405 consensus_queue.cc:1048] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:08.775794 32686 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:08.776441 32686 ts_tablet_manager.cc:1403] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.907s	user 0.035s	sys 0.009s
I20260709 12:13:08.797307 32717 raft_consensus.cc:493] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.816982 32717 raft_consensus.cc:515] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.818192 32637 raft_consensus.cc:2468] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:08.819370 32717 leader_election.cc:290] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:08.821394 32380 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:08.822809   439 raft_consensus.cc:2804] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.823315   439 raft_consensus.cc:697] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:08.795897   465 consensus_queue.cc:1048] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:13:08.824342   439 consensus_queue.cc:237] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.823208 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
W20260709 12:13:08.907838 32529 consensus_peers.cc:597] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:08.909837   310 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.910468   310 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:08.915037 32686 raft_consensus.cc:359] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:08.916072 32686 raft_consensus.cc:385] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.916390 32686 raft_consensus.cc:740] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.917284 32686 consensus_queue.cc:260] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:08.917881 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:08.923352 32687 tablet_bootstrap.cc:492] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:08.924014 32687 ts_tablet_manager.cc:1403] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.765s	user 0.018s	sys 0.016s
I20260709 12:13:08.925133   452 raft_consensus.cc:493] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:08.925861   452 raft_consensus.cc:515] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:08.930356 32489 raft_consensus.cc:2393] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:08.918994   310 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:08.931074   452 leader_election.cc:290] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:08.927757 32561 raft_consensus.cc:2468] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:08.941578 32382 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:08.942719   445 raft_consensus.cc:2804] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:08.943137   445 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.943485   445 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:08.939067 32686 ts_tablet_manager.cc:1434] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.162s	user 0.010s	sys 0.000s
I20260709 12:13:08.939465 32489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59926 (request call id 19) took 1066 ms. Trace:
I20260709 12:13:08.947543 32489 rpcz_store.cc:276] 0709 12:13:07.872763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.872894 (+   131us) service_pool.cc:224] Handling call
0709 12:13:08.939077 (+1066183us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400a31bd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:08.939342 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429094656}
I20260709 12:13:08.947382 32687 raft_consensus.cc:359] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.949869 32687 raft_consensus.cc:385] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.950233 32687 raft_consensus.cc:740] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.951061 32687 consensus_queue.cc:260] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.959535 32684 tablet_bootstrap.cc:492] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:08.961145 32684 ts_tablet_manager.cc:1403] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.313s	user 0.030s	sys 0.014s
I20260709 12:13:08.962755 32686 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:08.964592 32687 ts_tablet_manager.cc:1434] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
W20260709 12:13:08.945108 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 215994us
W20260709 12:13:08.968480   476 log.cc:927] Time spent T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:13:08.971972 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:08.963397   418 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:08.993366   418 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:08.993861 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:08.994658 32488 raft_consensus.cc:2468] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:08.995759   418 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:08.996652 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:08.997365 32562 raft_consensus.cc:3060] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.001317 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.002794   452 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.989985   310 consensus_queue.cc:1048] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:13:09.003392   452 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.005570   452 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:09.005962 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:08.977274 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:08.982362 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:08.983867 32715 consensus_queue.cc:1048] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.015110 32715 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.015686 32715 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.022382 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.019181 32455 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:09.024672 32685 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:09.042722 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.025749   445 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.047585 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:09.048517 32561 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.019985 32604 leader_election.cc:304] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:09.054105 32415 raft_consensus.cc:1240] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:13:09.054508 32717 raft_consensus.cc:2804] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.054931 32717 raft_consensus.cc:493] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.055294 32717 raft_consensus.cc:3060] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.057044 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:09.021176 32381 leader_election.cc:343] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.060250 32381 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:09.061753   409 raft_consensus.cc:2749] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.020169 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.031500 32313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34468 (request call id 41) took 1350 ms. Trace:
I20260709 12:13:09.062402 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:09.063793 32605 leader_election.cc:343] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.064610   418 consensus_queue.cc:1048] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.067000 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:09.067747 32485 raft_consensus.cc:3060] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.068378 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:09.073182 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.063009 32313 rpcz_store.cc:276] 0709 12:13:07.681572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.689826 (+  8254us) service_pool.cc:224] Handling call
0709 12:13:09.031400 (+1341574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:07.911440 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:07.912024 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:07.912080 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:13:07.912100 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:07.912477 (+   377us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:07.912551 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:07.912584 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:07.912805 (+   221us) tablet.cc:701] Row locks acquired
0709 12:13:07.912824 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:13:07.912985 (+   161us) write_op.cc:270] Start()
0709 12:13:07.913263 (+   278us) write_op.cc:276] Timestamp: P: 1783599187912934 usec, L: 0
0709 12:13:07.913289 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:13:07.914016 (+   727us) log.cc:844] Serialized 543 byte log entry
0709 12:13:08.628404 (+714388us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18002ac760. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdb679241d 00007fbdb679471a 00007fbdb67946a8 00007fbdb6794628 00007fbdb67945e3 00007fbdb67937fc 00007fbdb8bc62f6 00007fbdb8bc0aa8 00007fbdb2d67310
0709 12:13:08.628461 (+    57us) op_driver.cc:464] REPLICATION: finished
0709 12:13:08.793332 (+164871us) write_op.cc:301] APPLY: starting
0709 12:13:08.795437 (+  2105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:08.798018 (+  2581us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:08.798042 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:08.821307 (+ 23265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:08.821486 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:08.821538 (+    52us) write_op.cc:312] APPLY: finished
0709 12:13:08.821753 (+   215us) log.cc:844] Serialized 22 byte log entry
0709 12:13:08.821939 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:08.822032 (+    93us) write_op.cc:454] Released schema lock
0709 12:13:08.822074 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:08.822507 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:08.822536 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":80337,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":151325,"apply.run_cpu_time_us":1855,"apply.run_wall_time_us":39147,"num_ops":1,"prepare.queue_time_us":162,"prepare.run_cpu_time_us":2866,"prepare.run_wall_time_us":2866,"replication_time_us":5791,"spinlock_wait_cycles":26083712,"thread_start_us":111662,"threads_started":1}]]}
I20260709 12:13:09.024004 32684 raft_consensus.cc:359] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.113565 32684 raft_consensus.cc:385] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.113922 32684 raft_consensus.cc:740] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.114667 32684 consensus_queue.cc:260] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.116623 32684 ts_tablet_manager.cc:1434] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.155s	user 0.005s	sys 0.000s
I20260709 12:13:09.117669 32684 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:09.081167   405 raft_consensus.cc:2749] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.026753 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:09.082058 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 79816.5us
I20260709 12:13:09.084347   482 consensus_queue.cc:1048] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.085525 32562 raft_consensus.cc:2468] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:09.122371   445 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:09.087294 32457 leader_election.cc:343] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.124243 32605 leader_election.cc:304] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:09.125119   331 raft_consensus.cc:2804] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.089784 32685 tablet_bootstrap.cc:654] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.088459 32687 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:09.125612   331 raft_consensus.cc:697] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:09.074182 32633 raft_consensus.cc:2393] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 1: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:09.126542   331 consensus_queue.cc:237] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.031889 32715 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:09.104182 32561 raft_consensus.cc:2468] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:09.107331 32310 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34444 (request call id 43) took 1218 ms. Trace:
I20260709 12:13:09.129329 32686 tablet_bootstrap.cc:654] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.128675 32310 rpcz_store.cc:276] 0709 12:13:07.889199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.889359 (+   160us) service_pool.cc:224] Handling call
0709 12:13:09.107226 (+1217867us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20290,"reported_tablets":4}
I20260709 12:13:09.131443 32382 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:09.137880 32715 raft_consensus.cc:2804] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:13:09.144134 32381 leader_election.cc:343] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.159076 32311 catalog_manager.cc:5697] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } }
W20260709 12:13:09.154022 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 94160.3us
I20260709 12:13:09.163328 32715 raft_consensus.cc:697] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
W20260709 12:13:09.176038 32345 debug-util.cc:398] Leaking SignalData structure 0x7b080005d020 after lost signal to thread 24445
W20260709 12:13:09.177471 32345 debug-util.cc:398] Leaking SignalData structure 0x7b080004a700 after lost signal to thread 32348
I20260709 12:13:09.178006 32687 tablet_bootstrap.cc:654] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.178544 32717 raft_consensus.cc:515] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.180306 32562 raft_consensus.cc:1240] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:13:09.182837 32715 consensus_queue.cc:237] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.188273 32455 leader_election.cc:304] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:09.189484   483 raft_consensus.cc:2749] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:09.190251   405 consensus_queue.cc:1059] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.191186   405 raft_consensus.cc:3055] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:09.191550   405 raft_consensus.cc:740] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:09.192404   405 consensus_queue.cc:260] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.154345 32530 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:09.192984 32685 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:09.198941 32685 ts_tablet_manager.cc:1403] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.175s	user 0.025s	sys 0.021s
W20260709 12:13:09.199457 32345 debug-util.cc:398] Leaking SignalData structure 0x7b080026ff80 after lost signal to thread 32440
I20260709 12:13:09.200855 32684 tablet_bootstrap.cc:654] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:09.207114 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 58929.5us
I20260709 12:13:09.208514   477 raft_consensus.cc:2749] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:09.196403 32380 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:09.211297   465 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.197162 32485 raft_consensus.cc:2468] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:09.192894 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:09.216692 32605 leader_election.cc:343] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:09.219928 32345 debug-util.cc:398] Leaking SignalData structure 0x7b080036d380 after lost signal to thread 32515
I20260709 12:13:09.220412   465 raft_consensus.cc:2749] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:09.222306 32345 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9680 after lost signal to thread 32589
I20260709 12:13:09.193768 32717 leader_election.cc:290] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:09.233752   331 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.234401   331 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.228071   405 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:09.237911 32345 debug-util.cc:398] Leaking SignalData structure 0x7b0800096e20 after lost signal to thread 32663
I20260709 12:13:09.239826   331 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:09.259771   491 log.cc:927] Time spent T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:13:09.266217 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.268090 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:09.270318 32603 leader_election.cc:343] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.279448   483 consensus_queue.cc:1048] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.249513 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:09.282948 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:09.283756 32489 raft_consensus.cc:3060] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:09.286669 32605 leader_election.cc:343] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.287382 32605 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:09.288924   331 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.288920 32686 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
W20260709 12:13:09.290271 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:09.290685 32686 ts_tablet_manager.cc:1403] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.336s	user 0.017s	sys 0.002s
W20260709 12:13:09.291098 32455 leader_election.cc:343] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.291693 32455 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:09.301779   482 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.331702 32687 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:09.332496 32687 ts_tablet_manager.cc:1403] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.244s	user 0.025s	sys 0.012s
I20260709 12:13:09.336994 32687 raft_consensus.cc:359] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:09.343364 32686 raft_consensus.cc:359] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.344228 32686 raft_consensus.cc:385] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.344491 32686 raft_consensus.cc:740] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.345269 32686 consensus_queue.cc:260] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.355039 32686 ts_tablet_manager.cc:1434] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.002s
I20260709 12:13:09.358675 32686 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:09.367508 32685 raft_consensus.cc:359] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.368598 32685 raft_consensus.cc:385] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.368908 32685 raft_consensus.cc:740] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.370967   310 consensus_queue.cc:1048] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.374202   483 consensus_queue.cc:1048] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.369690 32685 consensus_queue.cc:260] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.400882 32685 ts_tablet_manager.cc:1434] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.201s	user 0.007s	sys 0.000s
I20260709 12:13:09.407980 32686 tablet_bootstrap.cc:654] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.409412 32489 raft_consensus.cc:2468] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:09.411229 32685 tablet_bootstrap.cc:492] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:09.338068 32687 raft_consensus.cc:385] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.414141 32687 raft_consensus.cc:740] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.416518 32687 consensus_queue.cc:260] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:09.452100 32604 leader_election.cc:304] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:09.453538 32717 raft_consensus.cc:2804] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.454357 32717 raft_consensus.cc:697] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:09.455554 32717 consensus_queue.cc:237] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.457721 32489 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.463449 32687 ts_tablet_manager.cc:1434] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.131s	user 0.012s	sys 0.000s
I20260709 12:13:09.466631 32684 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:09.467228 32684 ts_tablet_manager.cc:1403] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.350s	user 0.008s	sys 0.016s
I20260709 12:13:09.470300 32687 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:09.493573 32687 tablet_bootstrap.cc:654] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.506857   489 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.507498   489 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.509845   489 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:09.512187 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.505607 32684 raft_consensus.cc:359] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.515024 32684 raft_consensus.cc:385] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.515302 32684 raft_consensus.cc:740] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.515858 32684 consensus_queue.cc:260] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:09.514104 32605 leader_election.cc:343] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.517678   465 consensus_queue.cc:1048] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:09.524184   463 consensus_queue.cc:1048] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.524983 32685 tablet_bootstrap.cc:654] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.531421 32686 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:09.531991 32686 ts_tablet_manager.cc:1403] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.006s
I20260709 12:13:09.534188 32684 ts_tablet_manager.cc:1434] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 12:13:09.535611 32684 tablet_bootstrap.cc:492] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:09.541191 32687 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:09.541772 32687 ts_tablet_manager.cc:1403] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.008s
I20260709 12:13:09.548593 32684 tablet_bootstrap.cc:654] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.545017 32687 raft_consensus.cc:359] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.555374 32687 raft_consensus.cc:385] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.536567 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:09.555809 32687 raft_consensus.cc:740] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.546180 32717 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.563797 32687 consensus_queue.cc:260] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.567946 32686 raft_consensus.cc:359] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.568593 32686 raft_consensus.cc:385] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.568811 32686 raft_consensus.cc:740] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.569588 32687 ts_tablet_manager.cc:1434] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.005s
W20260709 12:13:09.570068 32604 leader_election.cc:343] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.570641 32604 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:09.571463   463 raft_consensus.cc:2749] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.574648 32686 consensus_queue.cc:260] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.575536 32685 tablet_bootstrap.cc:492] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:09.575376 32491 raft_consensus.cc:1275] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:13:09.576246 32491 pending_rounds.cc:85] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: Aborting all ops after (but not including) 0
I20260709 12:13:09.576447 32685 ts_tablet_manager.cc:1403] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.003s
I20260709 12:13:09.576501 32491 pending_rounds.cc:107] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:09.577086 32491 raft_consensus.cc:2889] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:09.582321 32686 ts_tablet_manager.cc:1434] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.004s
I20260709 12:13:09.583494 32686 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:09.584455 32685 raft_consensus.cc:359] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.585186 32685 raft_consensus.cc:385] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.585450 32685 raft_consensus.cc:740] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.586251 32685 consensus_queue.cc:260] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.587740 32715 consensus_queue.cc:1048] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.588227 32685 ts_tablet_manager.cc:1434] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:13:09.589469 32685 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:09.566994 32717 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.591522 32686 tablet_bootstrap.cc:654] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.612882 32717 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:09.613814 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:09.615820 32605 leader_election.cc:343] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.618197 32684 tablet_bootstrap.cc:492] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:09.620769 32684 ts_tablet_manager.cc:1403] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.007s
I20260709 12:13:09.622403 32685 tablet_bootstrap.cc:654] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.621990 32565 raft_consensus.cc:1275] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:09.624246   409 consensus_queue.cc:1048] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.626533 32684 raft_consensus.cc:359] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.627310 32684 raft_consensus.cc:385] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.627589 32684 raft_consensus.cc:740] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.628325 32684 consensus_queue.cc:260] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.633183   463 consensus_queue.cc:1048] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:09.637638 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:09.638479 32411 raft_consensus.cc:2468] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:09.645697 32686 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:09.646384 32686 ts_tablet_manager.cc:1403] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.033s
I20260709 12:13:09.650079 32686 raft_consensus.cc:359] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.650856 32686 raft_consensus.cc:385] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.650928 32685 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:09.651190 32686 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.651464 32685 ts_tablet_manager.cc:1403] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.011s
I20260709 12:13:09.651938 32686 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.630067 32684 ts_tablet_manager.cc:1434] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:13:09.654299 32686 ts_tablet_manager.cc:1434] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:13:09.654726 32685 raft_consensus.cc:359] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.655234 32603 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:09.655726 32686 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:09.656559   463 raft_consensus.cc:2804] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.656980   463 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.657328   463 raft_consensus.cc:3060] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.655516 32685 raft_consensus.cc:385] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.660295 32685 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.661293 32685 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.663169 32686 tablet_bootstrap.cc:654] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.663416 32685 ts_tablet_manager.cc:1434] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:09.664742 32685 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:09.673730 32685 tablet_bootstrap.cc:654] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.679831 32686 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:09.680119 32684 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:09.680505 32686 ts_tablet_manager.cc:1403] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:13:09.683266   463 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.689091   463 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:09.689702 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:09.691342 32605 leader_election.cc:343] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.685634 32686 raft_consensus.cc:359] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.693070 32686 raft_consensus.cc:385] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.693455 32686 raft_consensus.cc:740] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.694424 32686 consensus_queue.cc:260] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.697530 32686 ts_tablet_manager.cc:1434] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:13:09.700367 32310 catalog_manager.cc:5697] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.704753 32310 catalog_manager.cc:5697] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.711171 32687 tablet_bootstrap.cc:492] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:09.715896 32686 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:09.720230 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:09.721022 32411 raft_consensus.cc:3060] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.730549 32686 tablet_bootstrap.cc:654] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.735785 32685 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:09.736495 32685 ts_tablet_manager.cc:1403] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.008s
I20260709 12:13:09.740963 32685 raft_consensus.cc:359] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.741931 32685 raft_consensus.cc:385] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.742304 32685 raft_consensus.cc:740] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.743011 32685 consensus_queue.cc:260] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.760185 32687 tablet_bootstrap.cc:654] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.767432   483 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.768205   483 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.770431   477 raft_consensus.cc:493] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.771102   477 raft_consensus.cc:515] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.770581   368 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.775203   331 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.776010   331 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.766324   409 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.775260   368 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.778550   409 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.780555   368 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:09.781661   409 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:09.783524 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:09.784240 32482 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:09.785318   483 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:09.785733 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.786283 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:09.786492 32636 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:09.786988 32414 raft_consensus.cc:2468] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:09.781845 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:09.790798 32530 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:09.791467 32455 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:09.792182 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.792517   452 raft_consensus.cc:2804] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.792697 32380 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:09.794219 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:09.795056 32414 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:09.795543   409 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.796212   409 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.796787   409 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.799376 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.800233 32483 raft_consensus.cc:2393] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:09.801025   506 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.801481   506 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.801833   506 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.792930 32563 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:09.789152   477 leader_election.cc:290] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:09.805840 32529 leader_election.cc:304] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:09.792972   452 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.806975   452 raft_consensus.cc:3060] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.808806   368 raft_consensus.cc:3060] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.810756 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:09.815632 32457 leader_election.cc:343] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.828305 32311 catalog_manager.cc:5697] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.830142 32685 ts_tablet_manager.cc:1434] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 12:13:09.829519   506 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.831554 32685 tablet_bootstrap.cc:492] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:09.831930 32311 catalog_manager.cc:5697] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.833325   331 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:09.833833 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:09.847931 32311 catalog_manager.cc:5697] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } }
W20260709 12:13:09.849087 32604 leader_election.cc:343] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.834540 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.844588 32684 tablet_bootstrap.cc:654] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:09.850925 32605 leader_election.cc:343] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.851397 32605 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:09.852626 32765 raft_consensus.cc:2749] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.826056   452 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.856377   452 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:09.857950   368 raft_consensus.cc:2749] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:09.859268 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:09.860019 32415 raft_consensus.cc:3060] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.859202 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:09.867434 32457 leader_election.cc:343] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.874729 32686 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:09.875365 32686 ts_tablet_manager.cc:1403] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.166s	user 0.040s	sys 0.056s
I20260709 12:13:09.875672 32411 raft_consensus.cc:2468] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:09.877233 32603 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:09.878564   331 raft_consensus.cc:2804] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.881088 32686 raft_consensus.cc:359] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.881953 32686 raft_consensus.cc:385] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.882247 32686 raft_consensus.cc:740] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.883028 32686 consensus_queue.cc:260] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.879114   331 raft_consensus.cc:697] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:09.891849   331 consensus_queue.cc:237] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.892808 32687 tablet_bootstrap.cc:492] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:09.893517 32687 ts_tablet_manager.cc:1403] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.187s	user 0.022s	sys 0.019s
I20260709 12:13:09.897367 32687 raft_consensus.cc:359] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.898312 32687 raft_consensus.cc:385] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.898669 32687 raft_consensus.cc:740] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.899407 32687 consensus_queue.cc:260] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.903681 32686 ts_tablet_manager.cc:1434] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:13:09.906556   452 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.907110   452 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.909797   452 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:09.911556 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.912626 32686 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:09.912644 32636 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:09.914597 32455 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:09.904699 32687 ts_tablet_manager.cc:1434] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:09.916162 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:09.917210 32687 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:09.917797   483 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:09.918224   483 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.918591   483 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.921660 32415 raft_consensus.cc:2468] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:09.924544 32687 tablet_bootstrap.cc:654] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.931274 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:09.932090 32483 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.932276 32686 tablet_bootstrap.cc:654] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:09.936846 32457 leader_election.cc:343] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:09.938678 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:09.939395 32411 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.939728 32684 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:09.940248 32684 ts_tablet_manager.cc:1403] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.260s	user 0.014s	sys 0.013s
I20260709 12:13:09.941869 32483 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:09.945801 32685 tablet_bootstrap.cc:654] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.943805 32684 raft_consensus.cc:359] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.953794 32684 raft_consensus.cc:385] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:09.954087 32684 raft_consensus.cc:740] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:09.954897 32684 consensus_queue.cc:260] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.944147   409 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.958346 32684 ts_tablet_manager.cc:1434] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:13:09.962829 32530 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:09.963773   368 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.964296   368 raft_consensus.cc:697] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:09.964787   483 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:09.965315 32684 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:09.965135   368 consensus_queue.cc:237] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.973460 32684 tablet_bootstrap.cc:654] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:09.942691   506 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:09.977450   470 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.985560   470 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:09.988643   470 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:09.990546 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:09.992726 32455 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:09.994197   452 raft_consensus.cc:2804] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:09.994720   452 raft_consensus.cc:697] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:09.995563   452 consensus_queue.cc:237] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:09.995831 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:09.996685 32563 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.000845 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:10.002552   409 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.003289 32415 raft_consensus.cc:2393] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:10.005425 32529 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:10.005931 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:10.006669 32636 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.006824   477 raft_consensus.cc:3060] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:09.980104 32411 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:10.006201 32686 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:10.010674 32686 ts_tablet_manager.cc:1403] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.011s
I20260709 12:13:10.015314 32686 raft_consensus.cc:359] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.016722 32686 raft_consensus.cc:385] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.017349 32686 raft_consensus.cc:740] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.018195 32686 consensus_queue.cc:260] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.020721 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:10.021286 32686 ts_tablet_manager.cc:1434] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
W20260709 12:13:10.022351 32457 leader_election.cc:343] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.023801   483 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.025183 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:10.025951 32638 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.041059 32638 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:10.044958 32687 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:10.045657 32687 ts_tablet_manager.cc:1403] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.008s
I20260709 12:13:10.042688 32455 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:10.048235   483 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.048879   483 raft_consensus.cc:697] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:10.064616 32686 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:10.058070 32563 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:10.067437 32765 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.072702   477 raft_consensus.cc:2749] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.053910   483 consensus_queue.cc:237] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.077395 32687 raft_consensus.cc:359] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.078058 32687 raft_consensus.cc:385] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.078238 32687 raft_consensus.cc:740] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.079176 32687 consensus_queue.cc:260] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.082247 32684 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:10.082947 32684 ts_tablet_manager.cc:1403] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.021s
I20260709 12:13:10.077123 32765 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.086355 32382 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:10.087358   409 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.087857   409 raft_consensus.cc:697] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:10.094604 32314 catalog_manager.cc:5697] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.091085 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:10.111773 32603 leader_election.cc:343] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.113588   409 consensus_queue.cc:237] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.116137 32684 raft_consensus.cc:359] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.116847 32684 raft_consensus.cc:385] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.117059 32684 raft_consensus.cc:740] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.117717 32684 consensus_queue.cc:260] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.118309 32687 ts_tablet_manager.cc:1434] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.003s
I20260709 12:13:10.117363   463 consensus_queue.cc:1048] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:10.087960 32765 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:10.141403 32310 catalog_manager.cc:5697] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.151780 32684 ts_tablet_manager.cc:1434] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.003s
I20260709 12:13:10.157449 32687 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:10.161094 32685 tablet_bootstrap.cc:492] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:10.161782 32685 ts_tablet_manager.cc:1403] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.330s	user 0.020s	sys 0.008s
I20260709 12:13:10.162945 32765 consensus_queue.cc:1048] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:13:10.147260 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:10.173724 32686 tablet_bootstrap.cc:654] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.182789 32684 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
W20260709 12:13:10.200481 32605 leader_election.cc:343] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.201184 32605 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:10.202888 32765 raft_consensus.cc:2749] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.181864 32636 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:10.204631 32310 catalog_manager.cc:5697] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:10.226192 32715 raft_consensus.cc:493] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.226933 32715 raft_consensus.cc:515] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.230443 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:10.230674 32311 catalog_manager.cc:5697] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:10.232479 32381 leader_election.cc:343] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.233063 32311 catalog_manager.cc:5697] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.236584 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:10.239279 32382 leader_election.cc:343] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.239616 32685 raft_consensus.cc:359] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.239868 32382 leader_election.cc:304] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:10.240403 32685 raft_consensus.cc:385] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.240725 32685 raft_consensus.cc:740] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.241255   310 raft_consensus.cc:2749] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.241400 32685 consensus_queue.cc:260] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.243877 32684 tablet_bootstrap.cc:654] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.249715 32715 leader_election.cc:290] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:10.252471 32687 tablet_bootstrap.cc:654] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.252592 32686 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:10.253479 32686 ts_tablet_manager.cc:1403] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.199s	user 0.015s	sys 0.008s
I20260709 12:13:10.257722 32685 ts_tablet_manager.cc:1434] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 12:13:10.260582 32685 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:10.263494 32686 raft_consensus.cc:359] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.264238 32686 raft_consensus.cc:385] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.264489 32686 raft_consensus.cc:740] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.265182 32686 consensus_queue.cc:260] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.271207 32686 ts_tablet_manager.cc:1434] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:13:10.273550 32684 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:10.276743 32684 ts_tablet_manager.cc:1403] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.000s
I20260709 12:13:10.274184 32686 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:10.301999 32686 tablet_bootstrap.cc:654] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.284355 32684 raft_consensus.cc:359] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.307106 32684 raft_consensus.cc:385] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.307657 32684 raft_consensus.cc:740] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.308835 32684 consensus_queue.cc:260] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.332916 32685 tablet_bootstrap.cc:654] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.348110 32684 ts_tablet_manager.cc:1434] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.000s
I20260709 12:13:10.351821 32687 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:10.356202   463 consensus_queue.cc:1048] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.358081 32687 ts_tablet_manager.cc:1403] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.201s	user 0.020s	sys 0.027s
I20260709 12:13:10.366367 32685 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:10.367015 32685 ts_tablet_manager.cc:1403] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.000s
I20260709 12:13:10.370015 32685 raft_consensus.cc:359] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.371567 32685 raft_consensus.cc:385] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.371767 32685 raft_consensus.cc:740] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.372300 32685 consensus_queue.cc:260] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.377177   483 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.380491 32684 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:10.377843   483 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.383421   483 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:10.383571 32686 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:10.384222 32686 ts_tablet_manager.cc:1403] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.110s	user 0.005s	sys 0.009s
I20260709 12:13:10.377825 32687 raft_consensus.cc:359] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.386235 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:10.386592 32685 ts_tablet_manager.cc:1434] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:13:10.386960 32411 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:10.387851 32685 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:10.388159 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:10.389127 32634 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:10.390816 32455 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:10.392697   482 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.393177   482 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.393530   482 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.392411 32686 raft_consensus.cc:359] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.397295 32686 raft_consensus.cc:385] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.397675 32686 raft_consensus.cc:740] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.398449 32686 consensus_queue.cc:260] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.408566 32684 tablet_bootstrap.cc:654] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.419046 32686 ts_tablet_manager.cc:1434] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:13:10.425802 32687 raft_consensus.cc:385] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.426643 32687 raft_consensus.cc:740] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.427675 32687 consensus_queue.cc:260] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.432843 32765 consensus_queue.cc:1048] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.435025 32686 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:10.437675   482 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.436157 32685 tablet_bootstrap.cc:654] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.449193 32765 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.454638 32765 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.457458 32687 ts_tablet_manager.cc:1434] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
W20260709 12:13:10.452759 32457 consensus_peers.cc:597] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.460031 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:10.462244   409 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.462509 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:10.462881   409 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:10.464942 32605 leader_election.cc:343] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:10.466414 32603 leader_election.cc:343] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.466882 32603 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:10.467926   463 raft_consensus.cc:2749] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.469583 32715 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.470131 32715 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.457952 32765 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:10.474349 32684 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:10.480680 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:10.481002 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:10.481446 32636 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.481716 32684 ts_tablet_manager.cc:1403] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.000s
I20260709 12:13:10.481756 32638 raft_consensus.cc:2468] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:10.483390 32380 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:10.484370   310 raft_consensus.cc:2804] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.484879   310 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.485224   310 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.487918 32684 raft_consensus.cc:359] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.488843 32684 raft_consensus.cc:385] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.489130 32684 raft_consensus.cc:740] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.475010   405 raft_consensus.cc:493] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.478713 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:10.491765   405 raft_consensus.cc:515] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.495194 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:10.495930 32415 raft_consensus.cc:2468] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:10.497387 32455 leader_election.cc:304] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:10.498323   452 raft_consensus.cc:2804] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.479235   409 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.451908 32686 tablet_bootstrap.cc:654] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.490724 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:10.498700   452 raft_consensus.cc:493] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.499451   452 raft_consensus.cc:3060] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:10.500257 32382 leader_election.cc:343] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.502578 32636 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:10.498550 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:10.506047 32381 leader_election.cc:343] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.506927 32685 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:10.503644   405 leader_election.cc:290] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:10.507454 32685 ts_tablet_manager.cc:1403] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.000s
I20260709 12:13:10.511337   483 consensus_queue.cc:1048] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:10.512481 32685 raft_consensus.cc:359] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.517300 32686 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:10.459908 32687 tablet_bootstrap.cc:492] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:10.518689 32715 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:10.520048 32455 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:10.520509 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:10.522428 32565 raft_consensus.cc:2468] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:10.522424 32686 ts_tablet_manager.cc:1403] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.006s
I20260709 12:13:10.522567   310 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.525004   483 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.525630   483 raft_consensus.cc:697] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:10.525769 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:10.525892 32686 raft_consensus.cc:359] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.526726 32686 raft_consensus.cc:385] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.526554   452 raft_consensus.cc:515] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.526935   483 consensus_queue.cc:237] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
W20260709 12:13:10.527642 32382 leader_election.cc:343] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.527050 32686 raft_consensus.cc:740] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.531710 32686 consensus_queue.cc:260] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.489923 32684 consensus_queue.cc:260] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.535181 32634 raft_consensus.cc:2468] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:10.536482 32686 ts_tablet_manager.cc:1434] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:13:10.538589 32380 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:10.539731   463 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.532444 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:10.540635 32415 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.540906 32686 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:10.541240 32715 raft_consensus.cc:2804] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.542816   477 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:10.540369   463 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.543665 32715 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.547112   482 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:10.550469   452 leader_election.cc:290] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:10.551719 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:10.552395   463 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:10.552889 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:10.553294 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:10.553539 32636 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.521739 32685 raft_consensus.cc:385] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.556241 32684 ts_tablet_manager.cc:1434] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:13:10.559629 32685 raft_consensus.cc:740] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.560916 32685 consensus_queue.cc:260] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.533632   310 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.566797 32685 ts_tablet_manager.cc:1434] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:13:10.582772 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:10.583760 32561 raft_consensus.cc:3060] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:10.586592 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 55466.7us
I20260709 12:13:10.557889 32715 raft_consensus.cc:3060] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.590195   310 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.570739 32604 leader_election.cc:343] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.595574   310 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.596321 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:10.597002 32416 raft_consensus.cc:3060] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.601544 32685 tablet_bootstrap.cc:492] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:10.612103 32684 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
W20260709 12:13:10.635836   551 log.cc:927] Time spent T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:13:10.646484   553 consensus_queue.cc:1048] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.641279 32687 tablet_bootstrap.cc:654] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.618839 32314 catalog_manager.cc:5697] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:10.649394 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 66236.2us
I20260709 12:13:10.655472 32715 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.656814 32414 raft_consensus.cc:2393] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:10.666462   470 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.667131   470 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.669883   470 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.673943 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:10.675701 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:10.675904 32715 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:10.676683 32684 tablet_bootstrap.cc:654] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.677193 32416 raft_consensus.cc:2468] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:10.683703 32636 raft_consensus.cc:2468] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:10.685540 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:10.694687 32686 tablet_bootstrap.cc:654] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.659610 32685 tablet_bootstrap.cc:654] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:10.708254 32530 leader_election.cc:343] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.709486 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:10.700510 32633 raft_consensus.cc:3060] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:10.713330 32382 leader_election.cc:343] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:10.715102 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:13:10.720643 32381 leader_election.cc:343] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.700384 32415 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:10.724435 32380 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:10.727720 32603 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:10.728348 32715 raft_consensus.cc:2804] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.728924 32715 raft_consensus.cc:697] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:10.730525 32455 leader_election.cc:304] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:10.751371   553 raft_consensus.cc:2804] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.750711 32633 raft_consensus.cc:2468] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:10.740989   409 consensus_queue.cc:1048] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:13:10.759924 32561 raft_consensus.cc:2468] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:10.767900   463 raft_consensus.cc:2749] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:10.756045 32715 consensus_queue.cc:237] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.775040 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:10.775812 32636 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:10.764629   553 raft_consensus.cc:697] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:10.765556   310 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.798179 32684 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:10.799551 32684 ts_tablet_manager.cc:1403] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.004s
I20260709 12:13:10.822845 32687 tablet_bootstrap.cc:492] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:10.796056 32529 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:10.823470 32687 ts_tablet_manager.cc:1403] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.364s	user 0.010s	sys 0.019s
I20260709 12:13:10.822672 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:10.829566 32685 tablet_bootstrap.cc:492] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:10.830246 32685 ts_tablet_manager.cc:1403] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.229s	user 0.010s	sys 0.025s
I20260709 12:13:10.831924   555 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:10.832757   555 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.833312   555 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.850993 32380 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:10.852487 32684 raft_consensus.cc:359] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.854013 32684 raft_consensus.cc:385] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.855011 32684 raft_consensus.cc:740] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.857118   557 raft_consensus.cc:2804] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.857677   557 raft_consensus.cc:697] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:10.829445 32634 raft_consensus.cc:2468] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:10.865657 32684 consensus_queue.cc:260] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:10.845639 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 53248.9us
I20260709 12:13:10.875085 32686 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:10.873544 32685 raft_consensus.cc:359] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.875555 32685 raft_consensus.cc:385] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.875715 32686 ts_tablet_manager.cc:1403] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.335s	user 0.016s	sys 0.004s
I20260709 12:13:10.875890 32685 raft_consensus.cc:740] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.880775 32685 consensus_queue.cc:260] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.879168 32686 raft_consensus.cc:359] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.883924 32686 raft_consensus.cc:385] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.884150 32686 raft_consensus.cc:740] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.886035 32685 ts_tablet_manager.cc:1434] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:13:10.892504 32715 consensus_queue.cc:1048] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.894541 32684 ts_tablet_manager.cc:1434] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.004s
I20260709 12:13:10.895823 32684 tablet_bootstrap.cc:492] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:10.825126   553 consensus_queue.cc:237] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.907689   555 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.921118 32685 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:10.922664 32686 consensus_queue.cc:260] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:10.924924 32686 ts_tablet_manager.cc:1434] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.002s
I20260709 12:13:10.926080 32686 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:10.931944   470 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:10.903899   557 consensus_queue.cc:237] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:10.935441 32687 raft_consensus.cc:359] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.941807 32687 raft_consensus.cc:385] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.942194 32687 raft_consensus.cc:740] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
W20260709 12:13:10.912380 32457 consensus_peers.cc:597] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.942930 32687 consensus_queue.cc:260] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:10.950567 32687 ts_tablet_manager.cc:1434] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.000s
I20260709 12:13:10.910208   555 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:10.951998 32685 tablet_bootstrap.cc:654] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.952169 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:10.952965 32638 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.962502 32687 tablet_bootstrap.cc:492] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:10.969069 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:10.979439 32685 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:10.980304 32685 ts_tablet_manager.cc:1403] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.001s
W20260709 12:13:10.983956 32530 leader_election.cc:343] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:10.984169 32685 raft_consensus.cc:359] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:10.984958 32685 raft_consensus.cc:385] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.985258 32685 raft_consensus.cc:740] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.986939 32561 raft_consensus.cc:3060] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.991462 32687 tablet_bootstrap.cc:654] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.990937 32310 catalog_manager.cc:5697] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.996301 32684 tablet_bootstrap.cc:654] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.998837 32685 consensus_queue.cc:260] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.013170 32685 ts_tablet_manager.cc:1434] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 12:13:11.022650 32685 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:11.029809 32638 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:11.032130 32380 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:11.037191 32310 catalog_manager.cc:5697] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.041680   555 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.043422   555 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.045637   555 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.046411   566 raft_consensus.cc:2804] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.046900   566 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.047230   566 raft_consensus.cc:3060] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.048995 32310 catalog_manager.cc:5697] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.063232 32529 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:11.064265   555 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.072472 32686 tablet_bootstrap.cc:654] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:11.052143 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 98166.3us
I20260709 12:13:11.075604 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:11.070967 32685 tablet_bootstrap.cc:654] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.087747   555 raft_consensus.cc:697] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:11.088826   555 consensus_queue.cc:237] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.087781 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:11.098701 32562 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.099005 32530 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:11.104190   575 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.104898   575 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.107270   575 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:11.115221 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:11.118570 32603 leader_election.cc:343] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.124346 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:11.142923 32687 tablet_bootstrap.cc:492] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
W20260709 12:13:11.142161 32605 leader_election.cc:343] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.143436   482 consensus_queue.cc:1048] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.143847 32687 ts_tablet_manager.cc:1403] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.189s	user 0.018s	sys 0.005s
I20260709 12:13:11.143970 32605 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:11.145298   575 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.147415 32687 raft_consensus.cc:359] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.148729 32687 raft_consensus.cc:385] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.149012 32687 raft_consensus.cc:740] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.152324 32687 consensus_queue.cc:260] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.161441 32687 ts_tablet_manager.cc:1434] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:13:11.165269   470 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:11.173198   567 raft_consensus.cc:493] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.174130   567 raft_consensus.cc:515] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:11.165912   470 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:11.176628   567 leader_election.cc:290] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:11.178121   483 consensus_queue.cc:1048] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.182138 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:11.188181 32687 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:11.181352   470 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:11.204210 32686 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:11.204875 32686 ts_tablet_manager.cc:1403] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.015s
I20260709 12:13:11.198931 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:11.209980 32684 tablet_bootstrap.cc:492] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:11.211752 32684 ts_tablet_manager.cc:1403] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.000s
I20260709 12:13:11.214882 32684 raft_consensus.cc:359] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.216821 32684 raft_consensus.cc:385] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.217133 32684 raft_consensus.cc:740] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
W20260709 12:13:11.218037 32381 leader_election.cc:343] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.217926 32684 consensus_queue.cc:260] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.218401 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:11.223129 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:11.225325   556 raft_consensus.cc:2749] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.191591   566 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.236212 32530 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:11.236898 32382 leader_election.cc:343] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.237658   556 raft_consensus.cc:2749] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:11.237627 32382 leader_election.cc:304] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:11.247505   567 raft_consensus.cc:2749] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.241173 32684 ts_tablet_manager.cc:1434] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:13:11.256246 32685 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:11.257171 32685 ts_tablet_manager.cc:1403] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.237s	user 0.025s	sys 0.020s
W20260709 12:13:11.260257   583 log.cc:927] Time spent T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:11.268750 32310 catalog_manager.cc:5697] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.283104 32684 tablet_bootstrap.cc:492] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:11.289369   557 consensus_queue.cc:1048] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.297453 32687 tablet_bootstrap.cc:654] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.299988 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:11.302421 32561 raft_consensus.cc:3060] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.305894 32685 raft_consensus.cc:359] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.306761 32685 raft_consensus.cc:385] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.307027 32685 raft_consensus.cc:740] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.307710 32685 consensus_queue.cc:260] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.308112   566 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.309983 32685 ts_tablet_manager.cc:1434] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 12:13:11.315408 32685 tablet_bootstrap.cc:492] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:11.319129 32686 raft_consensus.cc:359] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:11.320127 32686 raft_consensus.cc:385] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.320500 32686 raft_consensus.cc:740] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.323518 32686 consensus_queue.cc:260] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:11.331318 32562 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.334321 32684 tablet_bootstrap.cc:654] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.336571 32561 raft_consensus.cc:2468] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:11.338760 32686 ts_tablet_manager.cc:1434] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.134s	user 0.004s	sys 0.005s
I20260709 12:13:11.343317 32382 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:11.344280   566 raft_consensus.cc:2804] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.359750   452 consensus_queue.cc:1048] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.372606   452 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.373430   452 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.377034   566 raft_consensus.cc:697] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:11.377044 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:11.377978 32633 raft_consensus.cc:3060] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.376605   452 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.388775 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:11.378300   566 consensus_queue.cc:237] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.390108 32686 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:11.388783 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:11.397294 32636 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:11.409413 32455 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:11.415382   452 raft_consensus.cc:2804] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.415849   452 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.416173   452 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.419696 32457 leader_election.cc:343] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.423553 32687 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:11.424201 32687 ts_tablet_manager.cc:1403] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.258s	user 0.016s	sys 0.000s
I20260709 12:13:11.427597 32687 raft_consensus.cc:359] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:11.428371 32687 raft_consensus.cc:385] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.428694 32687 raft_consensus.cc:740] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.432283 32687 consensus_queue.cc:260] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:11.443023 32686 tablet_bootstrap.cc:654] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.456693   310 consensus_queue.cc:1048] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:11.459398 32685 tablet_bootstrap.cc:654] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.469230 32687 ts_tablet_manager.cc:1434] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:13:11.482667   553 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.483294   553 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:11.486899   553 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:11.487972 32633 raft_consensus.cc:2468] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:11.489427 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:11.493160 32687 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:11.493343 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:11.495036 32455 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:11.495888   557 consensus_queue.cc:1048] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.496172   553 raft_consensus.cc:2749] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.513118   557 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.513820   557 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:11.531222 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:11.533383 32380 leader_election.cc:343] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.552933 32684 tablet_bootstrap.cc:492] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:11.553556 32684 ts_tablet_manager.cc:1403] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.273s	user 0.019s	sys 0.004s
I20260709 12:13:11.543298   553 consensus_queue.cc:1048] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:13:11.562595 32483 raft_consensus.cc:3060] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.616932 32686 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:11.616758 32313 catalog_manager.cc:5697] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.617734 32686 ts_tablet_manager.cc:1403] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.238s	user 0.033s	sys 0.029s
I20260709 12:13:11.627293 32482 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.635102   594 log.cc:927] Time spent T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:13:11.637898 32686 raft_consensus.cc:359] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.639123 32686 raft_consensus.cc:385] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.641811 32687 tablet_bootstrap.cc:654] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.639477 32686 raft_consensus.cc:740] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.642987 32686 consensus_queue.cc:260] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.645550 32684 raft_consensus.cc:359] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.646514 32684 raft_consensus.cc:385] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.646845 32684 raft_consensus.cc:740] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.649129 32684 consensus_queue.cc:260] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.653390 32684 ts_tablet_manager.cc:1434] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.099s	user 0.012s	sys 0.002s
I20260709 12:13:11.656359 32686 ts_tablet_manager.cc:1434] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:13:11.655277 32684 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
W20260709 12:13:11.662021 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 108606us
I20260709 12:13:11.655210 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:11.650885   557 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:11.668094 32686 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:11.660228   555 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:13:11.674083 32685 tablet_bootstrap.cc:492] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:11.681660 32685 ts_tablet_manager.cc:1403] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.371s	user 0.015s	sys 0.013s
W20260709 12:13:11.688081 32381 leader_election.cc:343] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.688789 32381 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:11.691583 32684 tablet_bootstrap.cc:654] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.668737   483 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.692821   452 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.711100   452 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.698746   566 raft_consensus.cc:2749] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.724606 32685 raft_consensus.cc:359] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.725436 32685 raft_consensus.cc:385] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.725735 32685 raft_consensus.cc:740] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.734236 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:11.735001 32636 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.700937   483 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.739049   483 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.726785 32685 consensus_queue.cc:260] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.758352 32685 ts_tablet_manager.cc:1434] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.000s
I20260709 12:13:11.759711 32685 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:11.746346   566 consensus_queue.cc:1048] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:13:11.769160 32686 tablet_bootstrap.cc:654] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.820546 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:11.822660   557 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.823297   557 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.825609   557 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.826984 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:11.827791 32632 raft_consensus.cc:2468] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:11.829669 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:11.830459 32565 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.830372 32380 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:11.831677   566 raft_consensus.cc:2804] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.832062   566 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.832424   566 raft_consensus.cc:3060] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.832628 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:11.851716 32382 leader_election.cc:343] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.857805 32636 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:11.859946 32687 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:11.861111 32687 ts_tablet_manager.cc:1403] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.368s	user 0.022s	sys 0.006s
W20260709 12:13:11.849102 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 112156us
W20260709 12:13:11.870532 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:11.886652 32455 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:11.887487 32685 tablet_bootstrap.cc:654] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.888777 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:11.889518 32632 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:11.893216   555 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.899226 32455 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:11.908089 32687 raft_consensus.cc:359] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:11.909181 32687 raft_consensus.cc:385] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.909523 32687 raft_consensus.cc:740] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.905537   553 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:11.910750   553 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:11.911252   553 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:11.904498   452 raft_consensus.cc:2804] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.916095 32687 consensus_queue.cc:260] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:11.919037 32686 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:11.920010 32686 ts_tablet_manager.cc:1403] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.257s	user 0.013s	sys 0.009s
I20260709 12:13:11.933107   452 raft_consensus.cc:697] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:11.934688   452 consensus_queue.cc:237] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.938289 32565 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:11.939323   566 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:11.955477   566 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:11.942338 32687 ts_tablet_manager.cc:1434] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.002s
I20260709 12:13:11.942073   310 consensus_queue.cc:1048] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.957015 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:11.961226 32687 tablet_bootstrap.cc:492] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
W20260709 12:13:11.965204 32382 leader_election.cc:343] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.968652 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:11.969359 32633 raft_consensus.cc:3060] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.989689 32684 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:11.993575 32684 ts_tablet_manager.cc:1403] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.339s	user 0.017s	sys 0.007s
I20260709 12:13:11.996760   553 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:11.997998   310 consensus_queue.cc:1048] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.005712 32684 raft_consensus.cc:359] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.006538 32684 raft_consensus.cc:385] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.006806 32684 raft_consensus.cc:740] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.012239 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:12.014654 32687 tablet_bootstrap.cc:654] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.018738   575 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.015522   553 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:12.018987 32685 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:12.002349 32633 raft_consensus.cc:2468] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:12.019196 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:12.019353   575 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.019708 32685 ts_tablet_manager.cc:1403] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.260s	user 0.063s	sys 0.048s
I20260709 12:13:12.023226 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:12.023415 32685 raft_consensus.cc:359] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.024150 32685 raft_consensus.cc:385] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.024489 32685 raft_consensus.cc:740] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
W20260709 12:13:12.025091 32605 leader_election.cc:343] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.025404 32685 consensus_queue.cc:260] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.027597 32685 ts_tablet_manager.cc:1434] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:13:12.028704 32685 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:12.028975   601 raft_consensus.cc:493] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.029482   601 raft_consensus.cc:515] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.031931 32380 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:12.033636   310 raft_consensus.cc:2804] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.034412   310 raft_consensus.cc:697] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:12.035842 32685 tablet_bootstrap.cc:654] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.035600   310 consensus_queue.cc:237] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.039078 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:12.040606   601 leader_election.cc:290] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:12.041018 32604 leader_election.cc:343] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.041447 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:12.040753 32687 tablet_bootstrap.cc:492] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:12.042157 32560 raft_consensus.cc:2468] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.042915 32687 ts_tablet_manager.cc:1403] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.013s
I20260709 12:13:12.043530 32457 leader_election.cc:304] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:12.046757   602 raft_consensus.cc:2804] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.046657 32687 raft_consensus.cc:359] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.041849 32604 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:12.047662 32687 raft_consensus.cc:385] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.048023 32687 raft_consensus.cc:740] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.048199   575 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:12.048923 32687 consensus_queue.cc:260] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.048297   573 raft_consensus.cc:2749] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.998088 32686 raft_consensus.cc:359] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.051134 32686 raft_consensus.cc:385] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.051719 32686 raft_consensus.cc:740] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.050838 32687 ts_tablet_manager.cc:1434] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:12.055246 32687 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:12.047269   602 raft_consensus.cc:493] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.063272   602 raft_consensus.cc:3060] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.065109 32687 tablet_bootstrap.cc:654] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.047260 32684 consensus_queue.cc:260] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.069453 32684 ts_tablet_manager.cc:1434] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.076s	user 0.003s	sys 0.003s
I20260709 12:13:12.052714 32686 consensus_queue.cc:260] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.079295 32313 catalog_manager.cc:5697] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:12.085207 32684 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:12.101595 32685 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:12.110976 32685 ts_tablet_manager.cc:1403] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.018s
I20260709 12:13:12.114195 32685 raft_consensus.cc:359] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.115100 32685 raft_consensus.cc:385] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.115391 32685 raft_consensus.cc:740] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.116410 32685 consensus_queue.cc:260] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.119323 32685 ts_tablet_manager.cc:1434] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:12.098888 32686 ts_tablet_manager.cc:1434] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.178s	user 0.006s	sys 0.003s
I20260709 12:13:12.130473 32686 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:12.133746 32685 tablet_bootstrap.cc:492] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:12.136196   310 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.136991   310 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.141256 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:12.143213 32381 leader_election.cc:343] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.048233 32455 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:12.146064   452 raft_consensus.cc:2749] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:12.146387   310 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:12.147095 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 98952.9us
I20260709 12:13:12.149111 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.149791 32416 raft_consensus.cc:2468] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.153883 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:12.156208 32382 leader_election.cc:343] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.156697 32382 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:12.158773 32715 raft_consensus.cc:2749] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.163970 32687 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:12.164548 32687 ts_tablet_manager.cc:1403] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.111s	user 0.029s	sys 0.045s
I20260709 12:13:12.162060 32686 tablet_bootstrap.cc:654] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.182032   602 raft_consensus.cc:515] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.182950 32687 raft_consensus.cc:359] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.183799 32687 raft_consensus.cc:385] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.184092 32687 raft_consensus.cc:740] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.184428   602 leader_election.cc:290] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:12.184836 32687 consensus_queue.cc:260] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.187407 32687 ts_tablet_manager.cc:1434] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.002s
I20260709 12:13:12.190510 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:12.191231 32416 raft_consensus.cc:3060] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.198287 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:12.199397 32565 raft_consensus.cc:3060] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.212436 32565 raft_consensus.cc:2468] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:12.215431 32457 leader_election.cc:304] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:12.215997 32416 raft_consensus.cc:2468] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:12.217072   452 raft_consensus.cc:2804] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.217741   452 raft_consensus.cc:697] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:12.216444 32311 catalog_manager.cc:5697] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.218928 32685 tablet_bootstrap.cc:654] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.219719 32687 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:12.220813   452 consensus_queue.cc:237] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.240069 32687 tablet_bootstrap.cc:654] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.233978 32684 tablet_bootstrap.cc:654] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.250986 32686 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:12.251751 32686 ts_tablet_manager.cc:1403] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.002s
I20260709 12:13:12.254231 32685 tablet_bootstrap.cc:492] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:12.254875 32685 ts_tablet_manager.cc:1403] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.000s
I20260709 12:13:12.256168 32686 raft_consensus.cc:359] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.259382   575 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.260144 32686 raft_consensus.cc:385] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.259969   575 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.259665 32685 raft_consensus.cc:359] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.260527 32686 raft_consensus.cc:740] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.260834 32685 raft_consensus.cc:385] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.261147 32685 raft_consensus.cc:740] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.261809 32685 consensus_queue.cc:260] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.263703   452 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.264086   575 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:12.264513 32685 ts_tablet_manager.cc:1434] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:12.264226   452 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.265709 32685 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:12.266395 32686 consensus_queue.cc:260] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.266817 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.267488 32416 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:12.269387 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:12.270082 32482 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:12.272035 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:12.272818 32687 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:12.273355 32687 ts_tablet_manager.cc:1403] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.004s
I20260709 12:13:12.275028 32685 tablet_bootstrap.cc:654] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.276192 32604 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:12.276499 32687 raft_consensus.cc:359] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.277277 32687 raft_consensus.cc:385] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.277530 32687 raft_consensus.cc:740] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.272684 32632 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.279946 32455 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:12.280830   602 raft_consensus.cc:2804] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.280164 32311 catalog_manager.cc:5697] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.281239   602 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.281576   602 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.283123 32686 ts_tablet_manager.cc:1434] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:13:12.284211 32686 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:12.288341   452 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:12.291535 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.292279 32411 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.293691 32482 raft_consensus.cc:1240] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:12.294535 32684 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:12.294661   597 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.295089 32684 ts_tablet_manager.cc:1403] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.210s	user 0.011s	sys 0.008s
I20260709 12:13:12.295189   597 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.297605   597 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:12.298195 32684 raft_consensus.cc:359] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.298949 32684 raft_consensus.cc:385] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.299245 32684 raft_consensus.cc:740] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.300398   575 raft_consensus.cc:2804] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.300819   575 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.301105   556 consensus_queue.cc:1059] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:12.303572   556 raft_consensus.cc:3055] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:12.304697 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:12.305634 32562 raft_consensus.cc:2468] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.306991   556 raft_consensus.cc:740] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:12.310019 32457 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:12.309825   556 consensus_queue.cc:260] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.310966   452 raft_consensus.cc:2804] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.311435   452 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.311831   452 raft_consensus.cc:3060] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.315691 32686 tablet_bootstrap.cc:654] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.300096 32684 consensus_queue.cc:260] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.323642 32684 ts_tablet_manager.cc:1434] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:13:12.324838 32684 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:12.328425 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:12.329677 32632 raft_consensus.cc:2468] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.301143   575 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.339041   602 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.348187 32686 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:12.351503   556 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:12.357967   310 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.368265 32686 ts_tablet_manager.cc:1403] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.003s
I20260709 12:13:12.368234   310 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.369366   602 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:12.371183   310 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:12.371493 32686 raft_consensus.cc:359] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.372318 32686 raft_consensus.cc:385] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.372601 32686 raft_consensus.cc:740] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.372979 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:12.375567 32382 leader_election.cc:343] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.362028 32684 tablet_bootstrap.cc:654] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.373413 32686 consensus_queue.cc:260] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.373864 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:12.379529 32380 leader_election.cc:343] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.379985 32380 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:12.380714 32686 ts_tablet_manager.cc:1434] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:12.381356 32715 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.382203 32686 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:12.394044   452 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.371659   575 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.397501 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:12.398291 32411 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.398874 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:12.399384 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:12.400192 32636 raft_consensus.cc:2393] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:12.407428   452 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:12.400928   575 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:12.408818 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:12.409596 32565 raft_consensus.cc:3060] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.415818   555 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.416411   555 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.420362 32685 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:12.420037   452 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.421200   555 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:12.422150 32685 ts_tablet_manager.cc:1403] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.157s	user 0.033s	sys 0.084s
I20260709 12:13:12.423170 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.425431 32685 raft_consensus.cc:359] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.426471 32685 raft_consensus.cc:385] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.426797 32685 raft_consensus.cc:740] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.427537 32685 consensus_queue.cc:260] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.429450 32685 ts_tablet_manager.cc:1434] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:12.432466 32685 tablet_bootstrap.cc:492] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:12.433377 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:12.434391 32482 raft_consensus.cc:2393] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:12.435601 32604 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:12.292407 32687 consensus_queue.cc:260] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.438300 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:12.439292 32638 raft_consensus.cc:2393] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:12.444916 32529 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:12.438125 32565 raft_consensus.cc:2468] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:12.447218 32457 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:12.452195 32687 ts_tablet_manager.cc:1434] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.179s	user 0.008s	sys 0.002s
I20260709 12:13:12.452581   601 raft_consensus.cc:2804] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.453284 32715 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.452675 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:12.450014   555 raft_consensus.cc:3060] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.459879   601 raft_consensus.cc:697] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:12.460871   601 consensus_queue.cc:237] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.455189 32715 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.446485   575 raft_consensus.cc:2749] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.463249 32638 raft_consensus.cc:3060] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.463933 32715 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:12.464942   555 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.464829 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:12.465703 32632 raft_consensus.cc:2468] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:12.466982 32380 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:12.454133 32686 tablet_bootstrap.cc:654] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.472424 32685 tablet_bootstrap.cc:654] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.474047 32715 raft_consensus.cc:2804] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.474572 32715 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.474933 32715 raft_consensus.cc:3060] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.477190 32687 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:12.470698 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:12.479319 32381 leader_election.cc:343] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.488464 32684 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:12.489212 32684 ts_tablet_manager.cc:1403] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.165s	user 0.008s	sys 0.006s
I20260709 12:13:12.491875 32715 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.494992 32715 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:12.497565 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:12.499639 32381 leader_election.cc:343] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.502504 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:12.527523 32632 raft_consensus.cc:3060] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.530094 32684 raft_consensus.cc:359] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.530972 32684 raft_consensus.cc:385] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.531263 32684 raft_consensus.cc:740] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.531991 32684 consensus_queue.cc:260] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.537691 32411 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:12.549697 32684 ts_tablet_manager.cc:1434] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.003s
I20260709 12:13:12.573091 32684 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:12.579944   452 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.580674   452 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:12.581655 32632 raft_consensus.cc:2468] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:12.585632   452 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:12.571287   603 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.621587   603 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.586063 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:12.593072 32684 tablet_bootstrap.cc:654] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.598649   310 consensus_queue.cc:1048] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.603221 32313 catalog_manager.cc:5697] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:12.625566 32457 leader_election.cc:343] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:12.624701 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 81989.2us
I20260709 12:13:12.634433 32455 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:12.626875 32638 raft_consensus.cc:2468] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:12.638681   603 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:12.639467   452 raft_consensus.cc:2804] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.640025   452 raft_consensus.cc:697] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:12.641206 32687 tablet_bootstrap.cc:654] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.640935   452 consensus_queue.cc:237] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.631695 32380 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:12.652979 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.653988 32416 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:12.654500 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.655236 32415 raft_consensus.cc:2468] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:12.635465   602 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:13:12.649747 32685 tablet_bootstrap.cc:492] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:12.657358 32685 ts_tablet_manager.cc:1403] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.227s	user 0.041s	sys 0.046s
I20260709 12:13:12.657552   566 raft_consensus.cc:2804] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:12.658166   566 raft_consensus.cc:697] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:12.659081   566 consensus_queue.cc:237] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.669783 32603 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:12.682766 32685 raft_consensus.cc:359] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.684363 32685 raft_consensus.cc:385] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.684720 32685 raft_consensus.cc:740] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.687994 32685 consensus_queue.cc:260] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:12.681048   573 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.691129   573 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.691511   573 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.694545   629 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.695255   629 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.700282 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:12.701112 32565 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:12.719664 32685 ts_tablet_manager.cc:1434] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:13:12.729900   629 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:12.733873 32686 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:12.734551 32686 ts_tablet_manager.cc:1403] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.353s	user 0.027s	sys 0.013s
I20260709 12:13:12.734992 32415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:12.738869 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:12.753388 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 119038us
I20260709 12:13:12.763669 32685 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:12.764112 32455 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:12.766536 32686 raft_consensus.cc:359] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.768534 32686 raft_consensus.cc:385] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:12.768942 32686 raft_consensus.cc:740] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:12.770524 32686 consensus_queue.cc:260] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.751421 32415 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:12.750727   601 consensus_queue.cc:1048] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:13:12.786372 32686 ts_tablet_manager.cc:1434] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:13:12.789824 32310 catalog_manager.cc:5697] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.792974   602 raft_consensus.cc:2804] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.817930   602 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.818538   602 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.803972   637 consensus_queue.cc:1048] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.837163 32686 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:12.865590   637 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.873090   637 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:12.878515 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:12.880636 32381 leader_election.cc:343] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:12.883579   573 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.885174 32633 raft_consensus.cc:2393] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:12.892544 32529 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:12.895016   556 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:12.895511   556 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.895957   556 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.905345   556 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:12.908790   556 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:12.909515 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:12.910606 32633 raft_consensus.cc:2393] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:12.919185 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:12.920215 32411 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:12.925396 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 115610us
I20260709 12:13:12.950094 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:12.950102 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:12.952529 32560 raft_consensus.cc:2393] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:12.954979 32603 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:12.966708 32685 tablet_bootstrap.cc:700] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: Time spent opening tablet: real 0.181s	user 0.002s	sys 0.002s
I20260709 12:13:12.970003 32685 tablet_bootstrap.cc:654] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:12.967657   637 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:12.968101   575 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.992226 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:12.992671 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 228668us
I20260709 12:13:12.999089 32686 tablet_bootstrap.cc:654] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.002985 32684 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:13.003631 32684 ts_tablet_manager.cc:1403] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.431s	user 0.030s	sys 0.012s
I20260709 12:13:12.978542   573 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:13.009428 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:13.025523 32687 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:13.026166 32687 ts_tablet_manager.cc:1403] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.551s	user 0.022s	sys 0.047s
I20260709 12:13:13.039721   602 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.018316   635 consensus_queue.cc:1048] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:13:13.049853 32687 raft_consensus.cc:359] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.072180 32684 raft_consensus.cc:359] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.073710 32687 raft_consensus.cc:385] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.074174 32687 raft_consensus.cc:740] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.074915 32684 raft_consensus.cc:385] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.075346 32684 raft_consensus.cc:740] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.027176   601 consensus_queue.cc:1048] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:13:13.078850 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:13.084935 32457 leader_election.cc:343] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:13.047907 32380 leader_election.cc:343] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.088215 32380 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:13.089736   567 raft_consensus.cc:2749] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.099606 32684 consensus_queue.cc:260] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.042229   602 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:13.120525 32687 consensus_queue.cc:260] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.128126 32684 ts_tablet_manager.cc:1434] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 12:13:13.081391   555 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.141366   555 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.158138 32687 ts_tablet_manager.cc:1434] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.132s	user 0.013s	sys 0.000s
I20260709 12:13:13.194939 32687 tablet_bootstrap.cc:492] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:13.200826 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:13.201911 32414 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.204885 32685 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:13.205655 32685 ts_tablet_manager.cc:1403] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.447s	user 0.013s	sys 0.008s
W20260709 12:13:13.192972 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 95782.7us
I20260709 12:13:13.273604 32310 catalog_manager.cc:5697] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.301712 32686 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:13.302390 32686 ts_tablet_manager.cc:1403] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.466s	user 0.027s	sys 0.020s
I20260709 12:13:13.304011 32684 tablet_bootstrap.cc:492] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:13.305941 32482 raft_consensus.cc:3060] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.258356   555 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:13.326669 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 53900.6us
I20260709 12:13:13.342965 32686 raft_consensus.cc:359] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.343873 32686 raft_consensus.cc:385] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.344172 32686 raft_consensus.cc:740] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.344857 32686 consensus_queue.cc:260] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.354880 32715 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.355554 32715 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.368448 32411 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:13.374534 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:13.385797 32715 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:13.393129   310 consensus_queue.cc:1048] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:13.346164 32414 raft_consensus.cc:2468] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:13.391438 32685 raft_consensus.cc:359] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.409725 32685 raft_consensus.cc:385] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.414824 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:13.421339 32686 ts_tablet_manager.cc:1434] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.119s	user 0.011s	sys 0.003s
I20260709 12:13:13.410176 32685 raft_consensus.cc:740] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.422870 32685 consensus_queue.cc:260] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.401379   575 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:13.404516   665 consensus_queue.cc:1048] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:13:13.440439 32686 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:13.423568   602 consensus_queue.cc:1048] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
W20260709 12:13:13.453574 32530 leader_election.cc:343] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.464668 32685 ts_tablet_manager.cc:1434] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.259s	user 0.011s	sys 0.000s
W20260709 12:13:13.466107 32382 leader_election.cc:343] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.466497 32684 tablet_bootstrap.cc:654] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.464396 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:13.470844 32529 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:13.489010 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:13.446550   626 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.491806 32687 tablet_bootstrap.cc:654] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.491094   659 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.500520   659 raft_consensus.cc:697] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:13.505496   626 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.508194   626 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:13.434938   575 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.511019   575 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:13.519560 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:13.520614 32564 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:13.522464 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:13.501628   659 consensus_queue.cc:237] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:13.523241 32413 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:13.527559 32603 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:13.531723 32605 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
W20260709 12:13:13.539734 32529 leader_election.cc:343] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.540680 32529 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:13.542651 32455 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:13.543939   661 raft_consensus.cc:2749] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.533532   575 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.560204   575 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.560658   575 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.547245   635 raft_consensus.cc:2804] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.538378   626 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:13.555910 32381 leader_election.cc:343] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.591764 32381 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:13.556768 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:13.559659   634 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.567921 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:13.603760 32381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 47898.5us
I20260709 12:13:13.553622 32686 tablet_bootstrap.cc:654] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.574007 32685 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:13.593009   635 raft_consensus.cc:697] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:13.627172   635 consensus_queue.cc:237] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.565686   567 consensus_queue.cc:1048] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
I20260709 12:13:13.608055   634 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.591423   626 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:13.644038 32482 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 2: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:13.617808   566 raft_consensus.cc:2749] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:13.654491 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 51618.5us
I20260709 12:13:13.636793   634 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:13.662127 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 56316us
W20260709 12:13:13.662815 32604 leader_election.cc:343] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.665074 32684 tablet_bootstrap.cc:492] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:13.665679 32684 ts_tablet_manager.cc:1403] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.362s	user 0.014s	sys 0.007s
I20260709 12:13:13.647727   626 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.683130   575 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.688771 32412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:13.690694 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:13.694628   666 consensus_queue.cc:1048] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.699258 32455 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:13.712271 32310 catalog_manager.cc:5697] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.720372 32687 tablet_bootstrap.cc:492] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:13.726186 32687 ts_tablet_manager.cc:1403] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.532s	user 0.031s	sys 0.016s
I20260709 12:13:13.754137 32685 tablet_bootstrap.cc:654] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.758755   650 raft_consensus.cc:2749] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:13.762717   659 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.763347   659 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.789213 32684 raft_consensus.cc:359] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.789984 32684 raft_consensus.cc:385] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.790175 32684 raft_consensus.cc:740] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.794247 32684 consensus_queue.cc:260] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.796355 32684 ts_tablet_manager.cc:1434] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.130s	user 0.010s	sys 0.000s
I20260709 12:13:13.800882 32684 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:13.805248   659 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:13.806309 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:13.816460 32684 tablet_bootstrap.cc:654] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.786393   626 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.828538   626 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:13.832088 32686 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:13.832729 32686 ts_tablet_manager.cc:1403] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.396s	user 0.017s	sys 0.014s
I20260709 12:13:13.832849 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:13.834072 32413 raft_consensus.cc:2393] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:13.853446 32529 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:13.855007   667 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.856187 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:13.857511   575 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:13.858536 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:13.859335 32491 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 2: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:13.871678 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:13.872018 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:13.872589 32414 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.882298 32559 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:13.887421 32605 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:13.876722 32310 catalog_manager.cc:5697] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.893234   641 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:13.893867   641 raft_consensus.cc:697] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:13.894821   641 consensus_queue.cc:237] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.902536 32684 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
W20260709 12:13:13.902719 32604 leader_election.cc:343] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:13.903271 32684 ts_tablet_manager.cc:1403] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.019s
I20260709 12:13:13.905076 32414 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:13.889848 32687 raft_consensus.cc:359] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.906067 32687 raft_consensus.cc:385] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.906405 32687 raft_consensus.cc:740] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.906656 32684 raft_consensus.cc:359] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:13.907444 32684 raft_consensus.cc:385] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.907068 32687 consensus_queue.cc:260] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.907770 32684 raft_consensus.cc:740] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.908550 32684 consensus_queue.cc:260] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:13.909498 32687 ts_tablet_manager.cc:1434] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.183s	user 0.002s	sys 0.003s
I20260709 12:13:13.910598 32603 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:13.915827 32686 raft_consensus.cc:359] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:13.916702 32686 raft_consensus.cc:385] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.917028 32686 raft_consensus.cc:740] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.917104   654 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.917970   654 raft_consensus.cc:697] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:13.919026   654 consensus_queue.cc:237] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:13.921329 32684 ts_tablet_manager.cc:1434] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:13:13.922592 32684 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:13.929888 32684 tablet_bootstrap.cc:654] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.930215   667 raft_consensus.cc:2749] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:13.932121 32687 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:13.936195 32686 consensus_queue.cc:260] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:13.952840 32686 ts_tablet_manager.cc:1434] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.002s
I20260709 12:13:13.954281 32686 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:13.959649 32685 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:13.960264 32685 ts_tablet_manager.cc:1403] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.387s	user 0.023s	sys 0.002s
I20260709 12:13:13.963233 32685 raft_consensus.cc:359] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.964852 32685 raft_consensus.cc:385] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.965149 32685 raft_consensus.cc:740] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.965814 32685 consensus_queue.cc:260] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:13.968014 32685 ts_tablet_manager.cc:1434] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:13.969115 32685 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:13.971993   642 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.972587   642 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.973523   667 consensus_queue.cc:1048] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:13.974882   642 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:13.978310 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:13.979135 32637 raft_consensus.cc:2468] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:13.981241 32685 tablet_bootstrap.cc:654] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.983911 32455 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:13.985142   642 raft_consensus.cc:2804] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:13.985677   642 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.986102   642 raft_consensus.cc:3060] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.991842 32687 tablet_bootstrap.cc:654] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.995784 32685 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:13.996397 32685 ts_tablet_manager.cc:1403] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.011s
I20260709 12:13:13.997881   642 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:13.999858 32685 raft_consensus.cc:359] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.000679 32685 raft_consensus.cc:385] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.000918 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:14.001678 32564 raft_consensus.cc:3060] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.003159   642 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:14.005604 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:14.006194 32637 raft_consensus.cc:3060] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.006636 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:14.011893 32564 raft_consensus.cc:2468] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:14.016157   654 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.016764   654 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.019014   654 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:14.020879 32637 raft_consensus.cc:2468] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:14.000944 32685 raft_consensus.cc:740] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.027805 32686 tablet_bootstrap.cc:654] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.032016 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:14.032912 32457 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:14.040035 32685 consensus_queue.cc:260] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.043421 32414 raft_consensus.cc:2468] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:14.044384 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:14.045135 32559 raft_consensus.cc:2468] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:14.047364 32603 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:14.048560   601 raft_consensus.cc:2804] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.049079   601 raft_consensus.cc:697] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:14.049943   601 consensus_queue.cc:237] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.051904 32685 ts_tablet_manager.cc:1434] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 12:13:14.053746   654 raft_consensus.cc:2804] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.060598   654 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.061041   654 raft_consensus.cc:3060] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.063442 32684 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:14.064810 32684 ts_tablet_manager.cc:1403] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.038s
I20260709 12:13:14.064157 32685 tablet_bootstrap.cc:492] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:14.067492   667 consensus_queue.cc:1048] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:14.080026   654 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.094949 32311 catalog_manager.cc:5697] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 1 to 2, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.101418 32684 raft_consensus.cc:359] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.103894 32684 raft_consensus.cc:385] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.104288 32684 raft_consensus.cc:740] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.105137 32684 consensus_queue.cc:260] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.106824 32684 ts_tablet_manager.cc:1434] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 12:13:14.108258 32684 tablet_bootstrap.cc:492] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:14.117602 32684 tablet_bootstrap.cc:654] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.123216 32311 catalog_manager.cc:5697] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.148810 32686 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:14.149508 32686 ts_tablet_manager.cc:1403] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.196s	user 0.014s	sys 0.016s
I20260709 12:13:14.159173 32685 tablet_bootstrap.cc:654] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.163555 32687 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:14.164152 32687 ts_tablet_manager.cc:1403] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.232s	user 0.022s	sys 0.000s
I20260709 12:13:14.165355 32313 catalog_manager.cc:5697] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.178328   654 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:14.178889 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:14.179613 32559 raft_consensus.cc:3060] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.181649 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:14.182281 32414 raft_consensus.cc:3060] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.207104 32687 raft_consensus.cc:359] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.207991 32687 raft_consensus.cc:385] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.208282 32687 raft_consensus.cc:740] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.209152 32687 consensus_queue.cc:260] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.215390 32687 ts_tablet_manager.cc:1434] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:13:14.216588 32687 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:14.220609 32414 raft_consensus.cc:2468] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:14.221992 32603 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:14.226434   641 raft_consensus.cc:2804] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.227002   641 raft_consensus.cc:697] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:14.228803 32686 raft_consensus.cc:359] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.229934 32686 raft_consensus.cc:385] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.230226 32686 raft_consensus.cc:740] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.232913   601 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.233506   601 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.232187   650 consensus_queue.cc:1048] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:13:14.244464 32684 tablet_bootstrap.cc:492] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:14.245146 32684 ts_tablet_manager.cc:1403] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.137s	user 0.023s	sys 0.038s
I20260709 12:13:14.245388   667 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.245995   667 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.248441   667 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:14.249877 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:14.249956 32684 raft_consensus.cc:359] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.250964 32483 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:14.251186 32684 raft_consensus.cc:385] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.251608 32684 raft_consensus.cc:740] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.252075 32530 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:14.231112 32686 consensus_queue.cc:260] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.252398 32684 consensus_queue.cc:260] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:14.266739 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:14.270395 32686 ts_tablet_manager.cc:1434] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.121s	user 0.011s	sys 0.000s
I20260709 12:13:14.250095 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:14.278669 32411 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:14.274155   651 consensus_queue.cc:1048] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:14.255762   667 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.292280   667 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.292711   667 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.295332 32687 tablet_bootstrap.cc:654] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.311064   626 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.311820   626 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.228235   641 consensus_queue.cc:237] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.315344 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:14.317322   626 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:14.317625 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:14.319199 32686 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:14.319325 32605 leader_election.cc:343] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:14.324681 32604 leader_election.cc:343] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.330402 32604 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:14.339491 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:14.340721 32565 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:14.334299   626 raft_consensus.cc:2749] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.358667 32684 ts_tablet_manager.cc:1434] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.113s	user 0.011s	sys 0.000s
I20260709 12:13:14.362308 32684 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Bootstrap starting.
I20260709 12:13:14.353780 32457 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:14.364655 32485 raft_consensus.cc:1275] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.332022 32559 raft_consensus.cc:2468] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:14.373373   452 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:14.403549   452 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.405728   452 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:14.414374   644 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:14.428001 32562 raft_consensus.cc:1275] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.429021   641 consensus_queue.cc:1048] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:14.437390   601 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:14.442978   667 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.447095 32311 catalog_manager.cc:5697] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.438244 32684 tablet_bootstrap.cc:654] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.460958   452 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:14.456678 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 88439.9us
I20260709 12:13:14.460098 32686 tablet_bootstrap.cc:654] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.469906   452 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:14.496194 32687 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:14.496961 32687 ts_tablet_manager.cc:1403] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.281s	user 0.012s	sys 0.010s
I20260709 12:13:14.496269 32685 tablet_bootstrap.cc:492] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:14.503592 32685 ts_tablet_manager.cc:1403] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.440s	user 0.026s	sys 0.054s
I20260709 12:13:14.483480 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:14.507313 32685 raft_consensus.cc:359] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.508184 32685 raft_consensus.cc:385] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.508489 32685 raft_consensus.cc:740] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.510131   667 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:14.513167 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:14.513878 32483 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.519510 32687 raft_consensus.cc:359] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.520594 32687 raft_consensus.cc:385] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.520941 32687 raft_consensus.cc:740] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.523310 32685 consensus_queue.cc:260] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.524015 32687 consensus_queue.cc:260] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.546826   654 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:14.548491 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:14.549218 32564 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:14.549470 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:14.546965 32487 raft_consensus.cc:1240] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:14.564683 32687 ts_tablet_manager.cc:1434] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:13:14.566447 32687 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:14.562183 32685 ts_tablet_manager.cc:1434] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 12:13:14.571588 32685 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
I20260709 12:13:14.537693 32411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:14.577101 32411 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.580394 32685 tablet_bootstrap.cc:654] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.590884 32687 tablet_bootstrap.cc:654] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.603991 32564 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:14.632249   643 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.645381   643 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.648329   643 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:14.651382 32687 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:14.652074 32687 ts_tablet_manager.cc:1403] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.002s
I20260709 12:13:14.617923   644 consensus_queue.cc:1059] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:13:14.654745 32482 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.655380 32687 raft_consensus.cc:359] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.656066 32687 raft_consensus.cc:385] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.656334 32687 raft_consensus.cc:740] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.657003 32687 consensus_queue.cc:260] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.618021   708 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.659358 32687 ts_tablet_manager.cc:1434] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:14.659230   708 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:14.659855 32562 raft_consensus.cc:1240] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:14.660719 32687 tablet_bootstrap.cc:492] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:14.661768   708 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:14.687064 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:14.687960 32414 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
W20260709 12:13:14.688460 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 126895us
I20260709 12:13:14.702020 32457 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:14.723961 32603 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:14.707600   641 raft_consensus.cc:3055] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:14.727080 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:14.759904   641 raft_consensus.cc:740] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:14.782100 32684 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: No bootstrap required, opened a new log
I20260709 12:13:14.782752 32684 ts_tablet_manager.cc:1403] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent bootstrapping tablet: real 0.421s	user 0.020s	sys 0.024s
W20260709 12:13:14.794559 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 70716.4us
I20260709 12:13:14.772413 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:14.773491 32635 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 0.
I20260709 12:13:14.786581   635 raft_consensus.cc:493] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.810370 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 93549.4us
W20260709 12:13:14.843554 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 141681us
I20260709 12:13:14.812083   575 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.812332   714 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:14.873003   650 consensus_queue.cc:1048] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:14.853688 32411 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:14.885841 32684 raft_consensus.cc:359] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.891561 32684 raft_consensus.cc:385] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.892182 32684 raft_consensus.cc:740] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.894088 32687 tablet_bootstrap.cc:654] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.893493 32684 consensus_queue.cc:260] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:14.900125 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:14.829876   635 raft_consensus.cc:515] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.921195 32684 ts_tablet_manager.cc:1434] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.001s
W20260709 12:13:14.925017 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 68660.9us
I20260709 12:13:14.896790   714 raft_consensus.cc:697] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:14.927232 32686 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:14.927985 32686 ts_tablet_manager.cc:1403] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.609s	user 0.052s	sys 0.096s
I20260709 12:13:14.852206   641 consensus_queue.cc:260] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.938431   714 consensus_queue.cc:237] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.951107 32685 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:14.951747   641 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:14.951719   635 leader_election.cc:290] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:14.953032 32686 raft_consensus.cc:359] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.953939 32686 raft_consensus.cc:385] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.954216 32686 raft_consensus.cc:740] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.954414 32687 tablet_bootstrap.cc:492] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:14.954975 32687 ts_tablet_manager.cc:1403] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.294s	user 0.023s	sys 0.008s
I20260709 12:13:14.951869 32685 ts_tablet_manager.cc:1403] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.381s	user 0.041s	sys 0.051s
I20260709 12:13:14.958169 32687 raft_consensus.cc:359] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.959167 32687 raft_consensus.cc:385] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.955049 32686 consensus_queue.cc:260] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:14.959568 32687 raft_consensus.cc:740] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.960427 32687 consensus_queue.cc:260] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:14.961941 32686 ts_tablet_manager.cc:1434] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.007s
I20260709 12:13:15.076917 32686 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:15.017164 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 163291us
W20260709 12:13:15.024544 32483 consensus_meta.cc:287] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 12:13:15.078855 32483 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
W20260709 12:13:15.055064 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 209608us
I20260709 12:13:14.962644 32687 ts_tablet_manager.cc:1434] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:13:15.083429 32685 raft_consensus.cc:359] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:15.085789   731 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.086853   731 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:15.091034   731 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:15.101092 32687 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c: Bootstrap starting.
I20260709 12:13:15.107388 32530 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:15.109524   667 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.117444 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:15.118765 32482 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:15.112855   667 raft_consensus.cc:697] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:15.128844   667 consensus_queue.cc:237] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:15.139590 32381 leader_election.cc:343] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.151897 32380 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:15.154397   575 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.156813   575 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.085063   704 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.155270   707 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.166239   704 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:15.167102   707 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.167608   707 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:15.184638 32605 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.198786 32381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 57407.2us
I20260709 12:13:15.085078 32685 raft_consensus.cc:385] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.207376 32530 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:15.202694 32685 raft_consensus.cc:740] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.236492 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:15.252710   657 raft_consensus.cc:2804] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.253387   657 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.253784   657 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.265940   704 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:15.270182 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:15.275528 32637 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 0.
I20260709 12:13:15.276806 32686 tablet_bootstrap.cc:654] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.285995 32687 tablet_bootstrap.cc:654] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:15.302819   657 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:15.306306 32604 leader_election.cc:343] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:15.308065 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 114071us
I20260709 12:13:15.311668   714 consensus_queue.cc:1048] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.326670   643 consensus_queue.cc:1048] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:15.333051 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 106260us
I20260709 12:13:15.340026   657 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:15.346927   575 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:15.350052 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:15.358492   643 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.359578   643 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:15.365859 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:15.366653 32631 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.367169 32416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:15.367909 32416 raft_consensus.cc:2468] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:15.377601 32631 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:15.378322 32311 catalog_manager.cc:5697] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 2 to 3, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 3 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.382632 32529 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:15.382772 32685 consensus_queue.cc:260] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:15.383886   705 raft_consensus.cc:2804] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.384275 32562 raft_consensus.cc:2468] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 0.
I20260709 12:13:15.384550   705 raft_consensus.cc:697] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:15.386075   705 consensus_queue.cc:237] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:15.391633 32457 leader_election.cc:304] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:15.389147 32685 ts_tablet_manager.cc:1434] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.433s	user 0.009s	sys 0.004s
I20260709 12:13:15.420433   724 raft_consensus.cc:2804] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.421205   724 raft_consensus.cc:493] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.421643   724 raft_consensus.cc:3060] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.456730 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:15.468881 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:15.469821 32487 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.482064 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:15.430897   575 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:15.395928   643 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:15.509660 32487 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:15.515079   575 consensus_queue.cc:1048] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:13:15.575850 32685 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5: Bootstrap starting.
W20260709 12:13:15.612696 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 139613us
W20260709 12:13:15.607276 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 152518us
I20260709 12:13:15.620152 32562 raft_consensus.cc:1275] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:15.631644 32605 leader_election.cc:343] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.644176 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:15.644893 32686 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: No bootstrap required, opened a new log
I20260709 12:13:15.645529 32686 ts_tablet_manager.cc:1403] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.570s	user 0.010s	sys 0.019s
W20260709 12:13:15.648329 32604 leader_election.cc:343] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:15.667723 32635 raft_consensus.cc:1275] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:15.668295 32635 pending_rounds.cc:85] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Aborting all ops after (but not including) 1
I20260709 12:13:15.668625 32635 pending_rounds.cc:107] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:15.668915 32635 raft_consensus.cc:2889] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:15.669289 32686 raft_consensus.cc:359] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:15.670106 32686 raft_consensus.cc:385] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.670387 32686 raft_consensus.cc:740] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.671106 32686 consensus_queue.cc:260] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:15.690546   740 log.cc:927] Time spent T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:13:15.698680 32687 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c: No bootstrap required, opened a new log
I20260709 12:13:15.699316 32687 ts_tablet_manager.cc:1403] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c: Time spent bootstrapping tablet: real 0.602s	user 0.022s	sys 0.012s
I20260709 12:13:15.705080   635 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:13:15.709340 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 57212.6us
I20260709 12:13:15.669445   734 consensus_queue.cc:1048] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.052s
I20260709 12:13:15.724447   731 consensus_queue.cc:1048] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:15.725947   735 log.cc:927] Time spent T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.107s	user 0.001s	sys 0.003s
I20260709 12:13:15.732741 32414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:15.740768 32414 raft_consensus.cc:2468] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 0.
I20260709 12:13:15.734215 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
W20260709 12:13:15.764004   707 consensus_meta.cc:287] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Time spent flushing consensus metadata: real 0.595s	user 0.016s	sys 0.000s
I20260709 12:13:15.764604   707 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:15.792377 32687 raft_consensus.cc:359] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:15.796976 32687 raft_consensus.cc:385] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:15.797431 32687 raft_consensus.cc:740] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Initialized, Role: FOLLOWER
I20260709 12:13:15.803515 32413 raft_consensus.cc:2393] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 1: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:15.807116   707 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:15.813114   742 log.cc:927] Time spent T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:13:15.829034 32455 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:15.802920   727 consensus_queue.cc:1048] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:13:15.815727 32686 ts_tablet_manager.cc:1434] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.170s	user 0.008s	sys 0.005s
I20260709 12:13:15.844511 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:15.845803 32635 raft_consensus.cc:2393] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:15.846644 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:15.836261   635 raft_consensus.cc:2749] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:15.854795 32603 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:15.856727   575 raft_consensus.cc:2804] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.857276   575 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.857714   575 raft_consensus.cc:3060] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.840380 32687 consensus_queue.cc:260] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:15.879770 32491 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.891144   750 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:15.786798   751 consensus_queue.cc:1048] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.106s
I20260709 12:13:15.926972 32603 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:15.947826 32491 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:15.924533   724 raft_consensus.cc:515] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:15.955775   745 raft_consensus.cc:2749] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:15.956820 32310 catalog_manager.cc:5697] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.000026 32685 tablet_bootstrap.cc:654] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.011315   724 leader_election.cc:290] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:16.013762 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:16.014635 32564 raft_consensus.cc:3060] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:16.040735   756 log.cc:927] Time spent T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:13:16.061007   575 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:16.135638 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:16.137514 32605 leader_election.cc:343] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:16.156656   575 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:16.159340 32564 raft_consensus.cc:2468] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:16.160419 32412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:16.161092 32412 raft_consensus.cc:3060] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.164798 32457 leader_election.cc:304] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:16.169781   768 consensus_queue.cc:1048] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:16.170589 32687 ts_tablet_manager.cc:1434] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c: Time spent starting tablet: real 0.471s	user 0.004s	sys 0.013s
I20260709 12:13:16.176244   650 raft_consensus.cc:2804] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.176859   650 raft_consensus.cc:697] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:16.177788   650 consensus_queue.cc:237] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:16.179958 32685 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5: No bootstrap required, opened a new log
I20260709 12:13:16.180171 32412 raft_consensus.cc:2468] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:16.180585 32685 ts_tablet_manager.cc:1403] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5: Time spent bootstrapping tablet: real 0.622s	user 0.030s	sys 0.028s
I20260709 12:13:16.183202 32603 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:16.201229   641 raft_consensus.cc:2804] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.201977   641 raft_consensus.cc:697] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:16.203229   641 consensus_queue.cc:237] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:16.227378 32685 raft_consensus.cc:359] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:16.228295 32685 raft_consensus.cc:385] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.228179 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:16.228785 32685 raft_consensus.cc:740] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.240844 32685 consensus_queue.cc:260] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:16.243517 32685 ts_tablet_manager.cc:1434] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.002s
I20260709 12:13:16.233862 32381 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:16.247090 32413 raft_consensus.cc:3060] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.254940   730 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:16.256392   730 raft_consensus.cc:697] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:16.257723   730 consensus_queue.cc:237] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:16.301367 32413 raft_consensus.cc:2468] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:16.421254 32311 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34456 (request call id 75) took 1185 ms. Trace:
I20260709 12:13:16.421873 32311 rpcz_store.cc:276] 0709 12:13:15.221641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.225186 (+  3545us) service_pool.cc:224] Handling call
0709 12:13:16.406359 (+1181173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:15.759681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:15.760379 (+   698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:15.760430 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:13:15.760460 (+    30us) tablet.cc:662] Decoding operations
0709 12:13:15.760925 (+   465us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:15.761083 (+   158us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:15.761116 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:15.761411 (+   295us) tablet.cc:701] Row locks acquired
0709 12:13:15.761442 (+    31us) write_op.cc:260] PREPARE: finished
0709 12:13:15.761634 (+   192us) write_op.cc:270] Start()
0709 12:13:15.761797 (+   163us) write_op.cc:276] Timestamp: P: 1783599195761572 usec, L: 0
0709 12:13:15.761829 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:13:15.809898 (+ 48069us) log.cc:844] Serialized 543 byte log entry
0709 12:13:16.162015 (+352117us) op_driver.cc:464] REPLICATION: finished
0709 12:13:16.342394 (+180379us) write_op.cc:301] APPLY: starting
0709 12:13:16.342486 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:16.342612 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:16.342769 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:16.343134 (+   365us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:16.344370 (+  1236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:16.348028 (+  3658us) write_op.cc:312] APPLY: finished
0709 12:13:16.392919 (+ 44891us) log.cc:844] Serialized 22 byte log entry
0709 12:13:16.393220 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:16.393338 (+   118us) write_op.cc:454] Released schema lock
0709 12:13:16.393436 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:16.394064 (+   628us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:16.394099 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":180051,"apply.run_cpu_time_us":2919,"apply.run_wall_time_us":51575,"num_ops":1,"prepare.queue_time_us":194416,"prepare.run_cpu_time_us":70757,"prepare.run_wall_time_us":204738,"raft.queue_time_us":341193,"raft.run_cpu_time_us":112718,"raft.run_wall_time_us":158293,"replication_time_us":399993,"thread_start_us":466484,"threads_started":4,"wal-append.queue_time_us":143538}]]}
I20260709 12:13:16.490849 32310 catalog_manager.cc:5697] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } }
I20260709 12:13:16.493259 32310 catalog_manager.cc:5697] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 0 to 1, leader changed from <none> to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 1 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.518688 32313 catalog_manager.cc:5697] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:16.527153 32361 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:16.543903 32311 catalog_manager.cc:5697] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 1 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.608886   749 consensus_queue.cc:1048] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:16.629232   657 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.629797   657 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:16.631875   702 consensus_queue.cc:1048] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:16.634791 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:16.649534 32413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:16.650625 32413 raft_consensus.cc:2393] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 1: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:16.652173 32529 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:16.647451   657 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:16.653738   768 raft_consensus.cc:3060] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:16.697548   768 raft_consensus.cc:2749] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:16.724818   567 consensus_queue.cc:1048] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:16.907560 32381 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 45959.8us
W20260709 12:13:16.939307 32382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 48065.9us
I20260709 12:13:16.933517   707 consensus_queue.cc:1048] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 12:13:16.969060 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 56159.8us
I20260709 12:13:17.002923   575 consensus_queue.cc:1048] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.004405   575 consensus_queue.cc:1048] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.120221 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
W20260709 12:13:17.145273 32529 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:17.234385 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 89154us
W20260709 12:13:17.284387 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 76268.5us
W20260709 12:13:17.296226 32603 consensus_peers.cc:597] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.309443 32603 consensus_peers.cc:597] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.310333 32529 consensus_peers.cc:597] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.334347 32529 consensus_peers.cc:597] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.341044 32529 consensus_peers.cc:597] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.339977 32603 consensus_peers.cc:597] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.411028 32529 consensus_peers.cc:597] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.431437 32529 consensus_peers.cc:597] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.460887 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:17.462245 24442 tablet_replica.cc:333] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.463232 24442 raft_consensus.cc:2243] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.463819 24442 raft_consensus.cc:2272] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.465057 32455 consensus_peers.cc:597] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.471710 32455 consensus_peers.cc:597] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.475299 32455 consensus_peers.cc:597] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.477687 32455 consensus_peers.cc:597] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.477124 24442 tablet_replica.cc:333] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.479735 24442 raft_consensus.cc:2243] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.480336 24442 raft_consensus.cc:2272] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.483081 32529 consensus_peers.cc:597] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.486967 24442 tablet_replica.cc:333] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.488107 24442 raft_consensus.cc:2243] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.488736 24442 raft_consensus.cc:2272] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.493251 24442 tablet_replica.cc:333] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.494313 24442 raft_consensus.cc:2243] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.495451 24442 raft_consensus.cc:2272] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.498688 24442 tablet_replica.cc:333] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.499675 24442 raft_consensus.cc:2243] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.500236 24442 raft_consensus.cc:2272] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.503454 24442 tablet_replica.cc:333] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.504551 24442 raft_consensus.cc:2243] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.506349 24442 raft_consensus.cc:2272] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.510162 24442 tablet_replica.cc:333] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
W20260709 12:13:17.510547 32603 consensus_peers.cc:597] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.511245 32603 consensus_peers.cc:597] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.513787 24442 raft_consensus.cc:2243] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.517066 24442 raft_consensus.cc:2272] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.521421 24442 tablet_replica.cc:333] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.522503 24442 raft_consensus.cc:2243] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.523790 24442 raft_consensus.cc:2272] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.523977 32603 consensus_peers.cc:597] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.525364 32455 consensus_peers.cc:597] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.526114 32455 consensus_peers.cc:597] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.526729 24442 tablet_replica.cc:333] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
W20260709 12:13:17.526782 32455 consensus_peers.cc:597] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.527539 32455 consensus_peers.cc:597] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.527711 24442 raft_consensus.cc:2243] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.528816 24442 raft_consensus.cc:2272] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.531793 24442 tablet_replica.cc:333] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
W20260709 12:13:17.531929 32455 consensus_peers.cc:597] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.532797 24442 raft_consensus.cc:2243] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:17.532964 32455 consensus_peers.cc:597] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:17.533641 32455 consensus_peers.cc:597] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.534247 24442 raft_consensus.cc:2272] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.534250 32455 consensus_peers.cc:597] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.538058 24442 tablet_replica.cc:333] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.539134 24442 raft_consensus.cc:2243] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.539740 24442 raft_consensus.cc:2272] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.540700 32455 consensus_peers.cc:597] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.544405 24442 tablet_replica.cc:333] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.545380 24442 raft_consensus.cc:2243] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.546000 24442 raft_consensus.cc:2272] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.548513 24442 tablet_replica.cc:333] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.549235 24442 raft_consensus.cc:2243] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.550823 24442 raft_consensus.cc:2272] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.558022 24442 tablet_replica.cc:333] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.560770 24442 raft_consensus.cc:2243] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.561422 24442 raft_consensus.cc:2272] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.566285 24442 tablet_replica.cc:333] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.568981 24442 raft_consensus.cc:2243] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.572548 24442 raft_consensus.cc:2272] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.575342 32455 consensus_peers.cc:597] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.577055 24442 tablet_replica.cc:333] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.577800 24442 raft_consensus.cc:2243] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.578341 24442 raft_consensus.cc:2272] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.581386 24442 tablet_replica.cc:333] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.585495 24442 raft_consensus.cc:2243] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:17.586426 32603 consensus_peers.cc:597] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.586777 24442 raft_consensus.cc:2272] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.589689 24442 tablet_replica.cc:333] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.590487 24442 raft_consensus.cc:2243] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.590999 24442 raft_consensus.cc:2272] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.594466 24442 tablet_replica.cc:333] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.595335 24442 raft_consensus.cc:2243] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.596493 24442 raft_consensus.cc:2272] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.599771 24442 tablet_replica.cc:333] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.600739 24442 raft_consensus.cc:2243] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.601202 24442 pending_rounds.cc:70] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Trying to abort 1 pending ops.
I20260709 12:13:17.601425 24442 pending_rounds.cc:77] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622307908214784 op_type: NO_OP noop_request { }
I20260709 12:13:17.601797 24442 raft_consensus.cc:2889] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:17.602164 24442 raft_consensus.cc:2272] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.605779 24442 tablet_replica.cc:333] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.606705 24442 raft_consensus.cc:2243] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.607319 24442 raft_consensus.cc:2272] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.610358 24442 tablet_replica.cc:333] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.611109 24442 raft_consensus.cc:2243] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.611723 24442 raft_consensus.cc:2272] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.614684 24442 tablet_replica.cc:333] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.615680 24442 raft_consensus.cc:2243] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.616217 24442 raft_consensus.cc:2272] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.619480 24442 tablet_replica.cc:333] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.620374 24442 raft_consensus.cc:2243] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.621582 24442 raft_consensus.cc:2272] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.624963 24442 tablet_replica.cc:333] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.625785 24442 raft_consensus.cc:2243] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.627024 24442 raft_consensus.cc:2272] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.629735 24442 tablet_replica.cc:333] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.630587 24442 raft_consensus.cc:2243] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.631700 24442 raft_consensus.cc:2272] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.631994 32529 consensus_peers.cc:597] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.634769 24442 tablet_replica.cc:333] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.635785 24442 raft_consensus.cc:2243] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.636971 24442 raft_consensus.cc:2272] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.640067 24442 tablet_replica.cc:333] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.640872 24442 raft_consensus.cc:2243] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.641461 24442 raft_consensus.cc:2272] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.644495 24442 tablet_replica.cc:333] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.645460 24442 raft_consensus.cc:2243] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.646100 24442 raft_consensus.cc:2272] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.648977 24442 tablet_replica.cc:333] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.649665 24442 raft_consensus.cc:2243] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.650163 24442 raft_consensus.cc:2272] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.653232 24442 tablet_replica.cc:333] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.654098 24442 raft_consensus.cc:2243] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.654675 24442 raft_consensus.cc:2272] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.658731 24442 tablet_replica.cc:333] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.659653 24442 raft_consensus.cc:2243] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.660181 24442 raft_consensus.cc:2272] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.662484 24442 tablet_replica.cc:333] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.663048 24442 raft_consensus.cc:2243] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.663458 24442 raft_consensus.cc:2272] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.666131 24442 tablet_replica.cc:333] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.666779 24442 raft_consensus.cc:2243] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.667300 24442 raft_consensus.cc:2272] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:17.667955 32529 consensus_peers.cc:597] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:17.672366 24442 tablet_replica.cc:333] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.673318 24442 raft_consensus.cc:2243] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.673862 24442 raft_consensus.cc:2272] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.676942 24442 tablet_replica.cc:333] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.677830 24442 raft_consensus.cc:2243] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.678400 24442 raft_consensus.cc:2272] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.681260 24442 tablet_replica.cc:333] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.682029 24442 raft_consensus.cc:2243] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.683514 24442 raft_consensus.cc:2272] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.686458 24442 tablet_replica.cc:333] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.687223 24442 raft_consensus.cc:2243] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.688360 24442 raft_consensus.cc:2272] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.695766 24442 tablet_replica.cc:333] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.697108 24442 raft_consensus.cc:2243] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.697806 24442 raft_consensus.cc:2272] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.701980 24442 tablet_replica.cc:333] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.702907 24442 raft_consensus.cc:2243] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.703586 24442 raft_consensus.cc:2272] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.707003 24442 tablet_replica.cc:333] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.707868 24442 raft_consensus.cc:2243] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.709201 24442 raft_consensus.cc:2272] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.713007 24442 tablet_replica.cc:333] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.713816 24442 raft_consensus.cc:2243] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.714402 24442 raft_consensus.cc:2272] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.717643 24442 tablet_replica.cc:333] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.718487 24442 raft_consensus.cc:2243] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.719130 24442 raft_consensus.cc:2272] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.722513 24442 tablet_replica.cc:333] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.723335 24442 raft_consensus.cc:2243] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:17.723915 24442 raft_consensus.cc:2272] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.727089 24442 tablet_replica.cc:333] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: stopping tablet replica
I20260709 12:13:17.727874 24442 raft_consensus.cc:2243] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:17.729254 24442 raft_consensus.cc:2272] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:17.851054 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
I20260709 12:13:17.993399 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:18.002538   807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:18.008842   806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:18.024811 24442 server_base.cc:1061] running on GCE node
W20260709 12:13:18.055779   809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:18.058471 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:18.058862 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:18.059160 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599198059136 us; error 0 us; skew 500 ppm
I20260709 12:13:18.065321 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:18.090333 24442 webserver.cc:533] Webserver started at http://127.23.222.129:33781/ using document root <none> and password file <none>
I20260709 12:13:18.091333 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:18.091681 24442 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:18.101689 24442 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:13:18.110483   814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:18.112573 24442 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:13:18.113094 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "51f23763442f4ea3a702c32e00616cb0"
format_stamp: "Formatted at 2026-07-09 12:13:01 on dist-test-slave-90bm"
I20260709 12:13:18.113732 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:18.139477 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:18.142606 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:18.151224 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:18.167093   821 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:13:18.488112 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:13:18.488489 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.327s	user 0.011s	sys 0.005s
I20260709 12:13:18.488832 24442 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:13:18.494323   821 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:18.524192   641 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.524884   641 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.527545   641 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:18.530540 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:18.533931   821 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:18.535178   821 tablet_bootstrap.cc:492] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:18.536011   821 ts_tablet_manager.cc:1403] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.023s
I20260709 12:13:18.539062   821 raft_consensus.cc:359] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.539860   821 raft_consensus.cc:740] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.540670   821 consensus_queue.cc:260] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.551033   821 ts_tablet_manager.cc:1434] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:13:18.552074   821 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:18.554147 32603 leader_election.cc:336] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.554880 32603 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:18.570421   641 raft_consensus.cc:2749] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.574647   821 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:18.575793   821 tablet_bootstrap.cc:492] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:18.576628   821 ts_tablet_manager.cc:1403] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 12:13:18.580687   821 raft_consensus.cc:359] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.581432   821 raft_consensus.cc:740] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.582161   821 consensus_queue.cc:260] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.584375   821 ts_tablet_manager.cc:1434] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:18.585232   821 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:18.626128   745 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.627059   745 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.635428   745 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:18.635643 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:18.642606   727 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.643272   727 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.647298 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:18.654292   785 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.654992   785 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.657722   785 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.658631   727 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:18.659288 32603 leader_election.cc:336] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.670717 32603 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:18.665378 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 52644.3us
I20260709 12:13:18.679062   745 raft_consensus.cc:2749] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:18.663414 32529 leader_election.cc:336] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.685272 32529 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:18.686141   727 raft_consensus.cc:2749] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.691169 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.692961   821 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:18.694093   821 tablet_bootstrap.cc:492] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:18.694828   821 ts_tablet_manager.cc:1403] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.110s	user 0.037s	sys 0.062s
I20260709 12:13:18.699254   821 raft_consensus.cc:359] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.700003   821 raft_consensus.cc:740] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.701005   821 consensus_queue.cc:260] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.703397   821 ts_tablet_manager.cc:1434] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:13:18.704263   821 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:18.707379   745 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.708081   745 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.712474 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:18.714695   745 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:18.714968   727 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.715737   704 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.715592   727 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.716423   704 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.718940   704 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:18.715695 32529 leader_election.cc:336] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.720839   727 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.721146 32529 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.726575   785 raft_consensus.cc:2749] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.728948   821 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:18.729178   793 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.730098   821 tablet_bootstrap.cc:492] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:18.730551   788 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.730964 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.730993   821 ts_tablet_manager.cc:1403] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 12:13:18.729772   793 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:18.733038 32529 leader_election.cc:336] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.734764   821 raft_consensus.cc:359] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.735548   821 raft_consensus.cc:740] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.736431   821 consensus_queue.cc:260] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.735563   793 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:18.735276 32603 leader_election.cc:336] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.738657   821 ts_tablet_manager.cc:1434] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:18.731102   788 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.739634   821 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:18.738863 32603 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:18.740929   788 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.740957   745 raft_consensus.cc:2749] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.744886 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:18.745771 32557 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:18.747062 32529 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.748266   727 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:18.748939 32457 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:18.749971   788 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:18.750464   788 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.750907   788 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.760073 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.764605 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.765403 32637 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
W20260709 12:13:18.766733 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 43841.5us
I20260709 12:13:18.771481   824 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.772188   824 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.777506   824 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.782884   821 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:18.784078   821 tablet_bootstrap.cc:492] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:18.784832   821 ts_tablet_manager.cc:1403] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.011s
I20260709 12:13:18.787699   821 raft_consensus.cc:359] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.788566   821 raft_consensus.cc:740] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.789579   821 consensus_queue.cc:260] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.791822   821 ts_tablet_manager.cc:1434] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:18.792676   821 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:18.797010   727 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.797647   727 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.799908   727 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.804018 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.807838 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.806682 32455 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:18.812378   793 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:18.812860   793 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.813263   793 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.814829   788 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.820869   788 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:18.822499   641 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.823161   641 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.825282   785 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.825780   641 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:18.827931 32529 leader_election.cc:336] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.828435 32529 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:18.824301 32455 leader_election.cc:336] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.829557   727 raft_consensus.cc:2749] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.829711 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:18.830646 32557 raft_consensus.cc:2468] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:18.832653   793 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.829775 32455 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.835191   793 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.834368 32605 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:18.825850   785 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.835816   793 raft_consensus.cc:2749] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:18.835662 32455 leader_election.cc:336] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:18.837435 32455 leader_election.cc:336] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.837734 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:18.838114   824 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.838524 32557 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.839047   788 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.838770   824 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:18.841048 32603 leader_election.cc:336] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.837822   785 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.842682   824 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.843180   828 raft_consensus.cc:2804] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:18.843647   828 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.839600   788 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.844033   828 raft_consensus.cc:3060] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.854604 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.855294 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.855489 32557 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:18.856204 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
W20260709 12:13:18.856298 32455 leader_election.cc:336] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.856938 32637 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.856961 32455 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.857867   704 raft_consensus.cc:2749] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.859175 32457 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:18.859943   704 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.860498   704 raft_consensus.cc:697] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:18.861536   704 consensus_queue.cc:237] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:18.865468 32529 leader_election.cc:336] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.866050 32529 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.866823   785 raft_consensus.cc:2749] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.873193   788 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.877066 32637 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
W20260709 12:13:18.878043 32455 leader_election.cc:336] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:18.879066 32455 leader_election.cc:336] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:18.879721 32455 leader_election.cc:336] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.876503   828 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.883065   821 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:18.884305   821 tablet_bootstrap.cc:492] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:18.885090   821 ts_tablet_manager.cc:1403] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.000s
I20260709 12:13:18.886325 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:18.887025 32560 raft_consensus.cc:3060] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:18.895027 32603 leader_election.cc:336] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.895686 32560 raft_consensus.cc:2468] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:18.895946 32455 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.896968   704 raft_consensus.cc:2749] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:18.897533 32605 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.898481   641 raft_consensus.cc:2804] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.898999   641 raft_consensus.cc:697] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:18.900216   641 consensus_queue.cc:237] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.895962   828 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.907042 32310 catalog_manager.cc:5697] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 2 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.909518 32455 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.910661   788 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.911271   788 raft_consensus.cc:697] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:18.912163   788 consensus_queue.cc:237] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.915576 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.916318 32637 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:18.912554   821 raft_consensus.cc:359] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.924935   745 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.925595   821 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.925657   745 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.929183   828 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
W20260709 12:13:18.927129 32455 leader_election.cc:336] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.937392   745 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:18.938138   745 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.938683   745 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.939903 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:18.940799   745 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:18.941349 32486 raft_consensus.cc:2468] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:18.942106 32455 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:18.943022   704 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:18.943384   704 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.943708 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:18.943732   704 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.947676   785 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.948345   785 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.929764   828 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.951624   788 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.947726 32604 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:18.952260   788 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
W20260709 12:13:18.955041 32603 leader_election.cc:336] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:18.956105   785 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:18.955801   704 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:18.956735 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:18.957758 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:18.961055   821 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:18.971062   837 raft_consensus.cc:2804] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:18.971668   837 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.972366   837 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.980041   821 ts_tablet_manager.cc:1434] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.001s
I20260709 12:13:18.978513 32486 raft_consensus.cc:2468] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:18.984203   830 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.982909 32639 raft_consensus.cc:2468] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:18.984753   830 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:18.985085 32530 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:18.989428 32455 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:19.003720   828 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:18.963903   745 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.986002   833 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:18.988808   788 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.027928 32311 catalog_manager.cc:5697] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.038636   821 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:19.015755   843 raft_consensus.cc:2804] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.046648 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:19.059391 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 74349.1us
I20260709 12:13:19.055284   641 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.062119   846 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.031574   745 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.054755   843 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
W20260709 12:13:19.067485 32603 leader_election.cc:336] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.069162 32603 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.064612   727 raft_consensus.cc:2804] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:19.061329   830 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.033466   833 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:19.064800 32639 raft_consensus.cc:2468] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:19.070523   843 raft_consensus.cc:3060] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.073160   839 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.062701   846 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.076854   745 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.073416   727 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.065312 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:19.063107   641 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:19.096026 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 106730us
I20260709 12:13:19.083565   727 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:19.095983 32486 raft_consensus.cc:2468] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:19.087041   840 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.090893 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.087692   745 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.084012   839 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.104198   704 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.107810   828 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.130839 32529 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:19.123482   840 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.139326   850 raft_consensus.cc:2804] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.139875   850 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.140264   850 raft_consensus.cc:3060] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.134419   745 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.144074   846 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.144942   852 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.147491   641 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.148607   641 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.149107   641 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.154646   745 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.144198   839 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.154112   833 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:19.108168   837 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.161854   837 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:19.162428   852 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.172639 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.163484   840 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:19.165156 32603 leader_election.cc:336] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.174742   852 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.165539 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:19.175403 32637 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.175446   641 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.134876 32560 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:19.171070 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.171880 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.177220 32559 raft_consensus.cc:2468] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:19.172194   850 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.179086 32558 raft_consensus.cc:2393] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 2: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:19.187956 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.188053 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.189097 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:19.189296 32637 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:19.190737 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:19.191627 32637 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
W20260709 12:13:19.192761 32529 leader_election.cc:336] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.191051 32603 leader_election.cc:336] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.193440 32529 leader_election.cc:336] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.194856 32559 raft_consensus.cc:2468] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:19.195370   785 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.195901   785 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.197921   841 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
W20260709 12:13:19.198395 32603 leader_election.cc:336] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.198482   841 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.200049   727 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:19.200677   841 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.200897   785 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.201223 32560 raft_consensus.cc:2393] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 3: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:19.189121   850 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.193811   843 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.205269   843 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.207198   727 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:19.209699 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:19.213294 32603 leader_election.cc:336] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.223701 32491 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:19.224262 32603 leader_election.cc:336] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.224786 32603 leader_election.cc:336] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.225214 32603 leader_election.cc:336] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.227275 32603 leader_election.cc:336] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.228060 32603 leader_election.cc:336] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.229355 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:19.229983 32631 raft_consensus.cc:3060] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.218078 32529 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:19.233431 32605 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.232591 32491 raft_consensus.cc:2468] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:19.236176 32530 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:19.236433 32605 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.247150   841 raft_consensus.cc:2804] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:19.247845   841 raft_consensus.cc:697] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:19.248838   841 consensus_queue.cc:237] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:19.250602 32631 raft_consensus.cc:2468] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:19.250720 32605 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.252058   857 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:19.234055 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 98490.9us
I20260709 12:13:19.252614   857 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.252123 32605 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.253103   857 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:19.253497   840 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.238656   850 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.250947   828 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.255043   850 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.255498   850 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.253965 32605 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.252315   641 raft_consensus.cc:2804] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.256021   641 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.256413   641 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.257201 32604 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.257966   828 raft_consensus.cc:2804] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.258370   828 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.258741   828 raft_consensus.cc:3060] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:19.262395 32529 leader_election.cc:336] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.262775   840 raft_consensus.cc:2749] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:19.264096 32605 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.264925   840 raft_consensus.cc:2804] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.265301   840 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.265678   840 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.271029 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:19.285957 32491 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
W20260709 12:13:19.285986 32529 leader_election.cc:336] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.286892 32529 leader_election.cc:336] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.289978 32529 leader_election.cc:336] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.290436 32455 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
W20260709 12:13:19.291536 32529 leader_election.cc:336] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.292639   821 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:19.294689 32604 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.300238 32529 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.298367   833 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.301235   839 raft_consensus.cc:2804] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.317004 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:19.319516 32637 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:19.308497   785 raft_consensus.cc:2804] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.307212 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:19.334681   821 tablet_bootstrap.cc:492] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:19.336012   821 ts_tablet_manager.cc:1403] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.315s	user 0.018s	sys 0.017s
I20260709 12:13:19.319303   839 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.312060   828 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.335637   785 raft_consensus.cc:697] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:19.367580 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:19.372763 32632 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:19.372949   785 consensus_queue.cc:237] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.336644 32639 raft_consensus.cc:3060] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.366864 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:19.329856   833 raft_consensus.cc:697] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:19.374329 32490 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.375145   833 consensus_queue.cc:237] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.373503   828 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:19.371061   839 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.350936 32310 catalog_manager.cc:5697] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 2 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:19.394862 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 97461us
W20260709 12:13:19.396431 32455 leader_election.cc:336] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.403697 24442 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:13:19.404325 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.915s	user 0.337s	sys 0.027s
I20260709 12:13:19.368705   641 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.407675   641 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.410792 32490 raft_consensus.cc:2468] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
W20260709 12:13:19.403795 32455 leader_election.cc:336] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.423074 32529 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.336066   857 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.427130 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:19.427856 32564 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.428416 32639 raft_consensus.cc:2468] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:19.434614   727 raft_consensus.cc:2804] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.435335   727 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.435853   727 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.442725   850 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.448992   821 raft_consensus.cc:359] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:19.453225   840 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.455904   857 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.467546   850 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.450112   821 raft_consensus.cc:740] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.482002 32564 raft_consensus.cc:2468] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:19.473058   821 consensus_queue.cc:260] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:19.487890 32455 leader_election.cc:336] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.491087 32529 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.490785 32455 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.492995 32605 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
W20260709 12:13:19.493960 32455 leader_election.cc:336] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.455927   840 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.494436   843 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:19.499287   641 raft_consensus.cc:2804] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.501264 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:19.502199 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:19.503693   839 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.511617 32559 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.511502 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:19.512262 32491 raft_consensus.cc:3060] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.513039   839 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.504315 32564 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:19.508394 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:19.519948 32638 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.520833 32491 raft_consensus.cc:2468] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:19.523397   727 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.525661   727 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:19.528107 32638 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:19.542984 32604 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:19.528301 32529 leader_election.cc:336] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.543817   865 raft_consensus.cc:2804] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.545342   865 raft_consensus.cc:697] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
W20260709 12:13:19.543886 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 239126us
I20260709 12:13:19.532708 32559 raft_consensus.cc:2468] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:19.533639 32310 catalog_manager.cc:5697] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 2 to 3, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.551666   821 ts_tablet_manager.cc:1434] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.214s	user 0.007s	sys 0.003s
I20260709 12:13:19.501092   785 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:19.552661   785 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:19.536643   641 raft_consensus.cc:697] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:19.538793 32455 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.539736 32637 raft_consensus.cc:1275] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.536477 32564 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:19.531383 32557 raft_consensus.cc:1275] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:19.546947 32529 leader_election.cc:336] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.553953   641 consensus_queue.cc:237] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.552022 32310 catalog_manager.cc:5697] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:19.541677 32603 consensus_peers.cc:597] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:19.559590 32560 raft_consensus.cc:1275] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.547472   865 consensus_queue.cc:237] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.561069   828 consensus_queue.cc:1048] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.562431 32604 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:19.564544 32605 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:19.565508 32605 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:19.563354   828 raft_consensus.cc:2804] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.566857   858 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:19.566960   870 raft_consensus.cc:2804] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.567466   858 raft_consensus.cc:697] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:19.567557   870 raft_consensus.cc:697] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:19.568712   785 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.569044   828 raft_consensus.cc:697] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:19.570437   828 consensus_queue.cc:237] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.568624   858 consensus_queue.cc:237] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.568598   870 consensus_queue.cc:237] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.579376 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:19.580008 32637 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:19.581492 32603 leader_election.cc:336] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.582561 32529 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:19.586784 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 48081.5us
I20260709 12:13:19.612396   850 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.637125   821 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:19.647873 32637 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
W20260709 12:13:19.650048 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 68602.1us
W20260709 12:13:19.651131 32603 leader_election.cc:336] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.652220 32603 leader_election.cc:336] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.660060 32603 leader_election.cc:336] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:19.651889   843 raft_consensus.cc:2804] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.675598 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:19.703713 32486 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:19.711076 32603 leader_election.cc:336] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:19.716765 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 49580us
I20260709 12:13:19.725106   854 consensus_queue.cc:1048] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:19.729709 32486 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:19.733717 32604 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.735743 32529 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:19.753121   850 raft_consensus.cc:697] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:19.735388   843 raft_consensus.cc:697] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:19.754371   839 raft_consensus.cc:2804] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.759289   727 raft_consensus.cc:2804] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.782634   839 raft_consensus.cc:697] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:19.787506   727 raft_consensus.cc:697] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:19.827194 32313 catalog_manager.cc:5697] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 2 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.851200   873 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.851887   727 consensus_queue.cc:237] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.852434   839 consensus_queue.cc:237] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.802424   854 consensus_queue.cc:1048] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:13:19.855419   785 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.824589   850 consensus_queue.cc:237] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.844732   843 consensus_queue.cc:237] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:19.860827   873 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:19.862498   785 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:19.871343 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 102243us
I20260709 12:13:19.901715   873 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:19.969113 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 164443us
W20260709 12:13:19.973886 32529 consensus_peers.cc:597] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:19.974573 32529 consensus_peers.cc:597] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:19.979480 32486 raft_consensus.cc:1275] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:20.002308   894 consensus_queue.cc:1048] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:13:20.003434 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:20.004205 32635 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:20.019443 32529 consensus_peers.cc:597] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.020110 32529 consensus_peers.cc:597] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.036643   821 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.040845   821 tablet_bootstrap.cc:492] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:20.041601   821 ts_tablet_manager.cc:1403] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.458s	user 0.047s	sys 0.051s
I20260709 12:13:20.014684   873 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.045369 32313 catalog_manager.cc:5697] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 2 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.084455 32565 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:20.074040   873 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:20.087437   873 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:20.094391   821 raft_consensus.cc:359] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:20.095249   821 raft_consensus.cc:740] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:20.095963   821 consensus_queue.cc:260] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:20.098148 32310 catalog_manager.cc:5697] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:20.099428 32529 leader_election.cc:336] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:20.100025 32529 consensus_peers.cc:597] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.100471 32529 consensus_peers.cc:597] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.101025 32603 consensus_peers.cc:597] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.101790 32603 consensus_peers.cc:597] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.102777   873 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:20.139991 32455 consensus_peers.cc:597] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.146144 32529 consensus_peers.cc:597] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.121881   873 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:20.163031   873 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:20.118965   828 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:13:20.184702 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 70455.2us
I20260709 12:13:20.190080   821 ts_tablet_manager.cc:1434] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.148s	user 0.019s	sys 0.014s
I20260709 12:13:20.192723 32311 catalog_manager.cc:5697] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.201570   821 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:20.215070 32635 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
W20260709 12:13:20.240257 32455 consensus_peers.cc:597] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.241041 32455 consensus_peers.cc:597] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.241590 32455 consensus_peers.cc:597] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.242125 32455 consensus_peers.cc:597] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.244913 32455 consensus_peers.cc:597] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.245402 32455 consensus_peers.cc:597] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.267052 32558 raft_consensus.cc:1275] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:20.317284 32529 consensus_peers.cc:597] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.334447   911 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.335144   911 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:20.334532 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:20.336654 32529 consensus_peers.cc:597] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.338574   909 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.339453 32632 raft_consensus.cc:1275] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:20.339625 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 77018.9us
I20260709 12:13:20.342361 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:20.339134   909 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:20.345651   909 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:20.347820 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:20.348779 32632 raft_consensus.cc:2393] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 2: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:20.349792 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:20.350472   865 consensus_queue.cc:1048] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:20.352108 32455 consensus_peers.cc:597] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.355602   911 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:20.355993 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:20.360519 32491 raft_consensus.cc:1275] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.364626 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:20.365259 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:20.364845 32559 raft_consensus.cc:1275] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.363194 32490 raft_consensus.cc:1275] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.408998   816 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:20.409150   745 consensus_queue.cc:1048] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:13:20.430963 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 47281.1us
I20260709 12:13:20.442634   865 consensus_queue.cc:1048] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.444960 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:20.432363 32455 consensus_peers.cc:597] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.410467 32638 raft_consensus.cc:1275] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:20.435732 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 49692.8us
I20260709 12:13:20.364650 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:20.448478 32630 raft_consensus.cc:2393] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 2: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:20.437407   911 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:20.437608   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 50699.8us
I20260709 12:13:20.479310   816 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:20.480362   909 raft_consensus.cc:2749] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:20.491592 32529 consensus_peers.cc:597] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.499094 32455 consensus_peers.cc:597] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.499917 32455 consensus_peers.cc:597] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.507618 32638 raft_consensus.cc:1275] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.509750   858 consensus_queue.cc:1048] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:20.528589 32529 consensus_peers.cc:597] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.532346 32529 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:20.543416 32455 consensus_peers.cc:597] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.544240 32455 consensus_peers.cc:597] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:20.545428   845 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.578895   894 consensus_queue.cc:1048] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:20.580179 32603 consensus_peers.cc:597] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.580982 32603 consensus_peers.cc:597] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.581758 32603 consensus_peers.cc:597] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.582176   911 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:20.582866 32487 raft_consensus.cc:1275] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.569905   816 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
W20260709 12:13:20.589421 32603 consensus_peers.cc:597] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.599786 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 62710.3us
I20260709 12:13:20.607755 32634 raft_consensus.cc:1275] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.609369 32630 raft_consensus.cc:1275] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.609163   641 consensus_queue.cc:1048] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.549686   850 consensus_queue.cc:1048] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:13:20.627336 32313 catalog_manager.cc:5697] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } }
I20260709 12:13:20.588836   816 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:20.628849 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:20.629590   909 raft_consensus.cc:3060] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.630785   817 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:20.632187   873 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:20.600945   911 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:20.629086 32313 catalog_manager.cc:5697] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } }
I20260709 12:13:20.619789 32311 catalog_manager.cc:5697] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 2 to 3, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 3 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } }
I20260709 12:13:20.640196 32311 catalog_manager.cc:5697] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.642352 32311 catalog_manager.cc:5697] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } }
I20260709 12:13:20.599753   845 raft_consensus.cc:697] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
W20260709 12:13:20.693605 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 121114us
I20260709 12:13:20.712394   704 consensus_queue.cc:1048] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:13:20.716712   843 consensus_queue.cc:1048] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:13:20.730741   830 consensus_queue.cc:1048] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:13:20.716667   845 consensus_queue.cc:237] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:20.742846   911 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.743465   911 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:20.745672   911 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:20.747824   821 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:20.755999   821 tablet_bootstrap.cc:492] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:20.756783   821 ts_tablet_manager.cc:1403] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.555s	user 0.027s	sys 0.013s
I20260709 12:13:20.757359 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:20.759611 32529 consensus_peers.cc:597] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.757680 32603 consensus_peers.cc:597] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.760558 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 122870us
W20260709 12:13:20.761021 32603 consensus_peers.cc:597] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:20.761363 32603 consensus_peers.cc:597] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:20.761602 32603 consensus_peers.cc:597] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:20.772027   821 raft_consensus.cc:359] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:20.772957   821 raft_consensus.cc:740] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:20.775035   821 consensus_queue.cc:260] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:20.783823   873 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.784403   873 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:20.786490   909 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:20.797516   821 ts_tablet_manager.cc:1434] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.002s
I20260709 12:13:20.798689   821 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:20.901530   873 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:21.008893 32603 consensus_peers.cc:597] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.010689   821 tablet_bootstrap.cc:700] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Time spent opening tablet: real 0.140s	user 0.004s	sys 0.002s
W20260709 12:13:21.018293 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 183844us
W20260709 12:13:21.019119 32455 consensus_peers.cc:597] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.019717 32455 consensus_peers.cc:597] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.020179 32455 consensus_peers.cc:597] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.024804 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:21.026386 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:21.054462 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:21.055346 32455 consensus_peers.cc:597] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.084102 32603 consensus_peers.cc:597] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.117631 32455 consensus_peers.cc:597] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:21.176522 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 166035us
I20260709 12:13:21.184405   817 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:21.252168   942 log.cc:927] Time spent T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.213s	user 0.001s	sys 0.001s
I20260709 12:13:21.251168   873 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:21.259229   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 78704.6us
W20260709 12:13:21.284850 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 94648.9us
I20260709 12:13:21.337591   821 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.339035   821 tablet_bootstrap.cc:492] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:21.339982   821 ts_tablet_manager.cc:1403] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.542s	user 0.039s	sys 0.027s
I20260709 12:13:21.343565   821 raft_consensus.cc:359] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:21.344429   821 raft_consensus.cc:740] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
W20260709 12:13:21.345979   948 log.cc:927] Time spent T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:21.345350   821 consensus_queue.cc:260] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:21.363394   821 ts_tablet_manager.cc:1434] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:13:21.378134   821 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:21.423312   953 log.cc:927] Time spent T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.167s	user 0.003s	sys 0.000s
I20260709 12:13:21.406402   818 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:21.426159   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 307604us
I20260709 12:13:21.427727   873 raft_consensus.cc:2749] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:21.456012   933 log.cc:927] Time spent T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.720s	user 0.000s	sys 0.010s
W20260709 12:13:21.462116 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 202721us
W20260709 12:13:21.469806   943 log.cc:927] Time spent T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.263s	user 0.002s	sys 0.004s
I20260709 12:13:21.481200 32311 catalog_manager.cc:5697] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.484704 32310 catalog_manager.cc:5697] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 1 to 2, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:21.495463 32603 consensus_peers.cc:597] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:21.531351   821 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.548686   821 tablet_bootstrap.cc:492] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:21.549556   821 ts_tablet_manager.cc:1403] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.185s	user 0.018s	sys 0.002s
I20260709 12:13:21.557837   821 raft_consensus.cc:359] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:21.558670   821 raft_consensus.cc:740] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.559485   821 consensus_queue.cc:260] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:21.578397   821 ts_tablet_manager.cc:1434] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.004s
I20260709 12:13:21.579375   821 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:21.591642 32639 raft_consensus.cc:1275] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:21.632323 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 66565.3us
W20260709 12:13:21.678481 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 44104.7us
I20260709 12:13:21.685726   873 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.686393   873 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:21.688654   873 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:21.695616 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:21.724591   936 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:13:21.740798   974 log.cc:927] Time spent T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:13:21.746630 32529 consensus_peers.cc:597] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.764429 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:21.774155   817 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:21.776029   873 raft_consensus.cc:2749] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:21.785632 32310 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34474 (request call id 95) took 1134 ms. Trace:
I20260709 12:13:21.788456   821 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:21.793246   821 tablet_bootstrap.cc:492] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:21.794420   821 ts_tablet_manager.cc:1403] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.215s	user 0.019s	sys 0.010s
I20260709 12:13:21.786139 32310 rpcz_store.cc:276] 0709 12:13:20.651480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.673668 (+ 22188us) service_pool.cc:224] Handling call
0709 12:13:20.774693 (+101025us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b5400909cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:13:21.785543 (+1010850us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:21.583914 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:21.587450 (+  3536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:21.587482 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:13:21.587493 (+    11us) tablet.cc:662] Decoding operations
0709 12:13:21.587831 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:21.587893 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:21.587923 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:21.623905 (+ 35982us) tablet.cc:701] Row locks acquired
0709 12:13:21.623932 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:13:21.632558 (+  8626us) write_op.cc:270] Start()
0709 12:13:21.646361 (+ 13803us) write_op.cc:276] Timestamp: P: 1783599201630312 usec, L: 0
0709 12:13:21.646385 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:13:21.647103 (+   718us) log.cc:844] Serialized 543 byte log entry
0709 12:13:21.762060 (+114957us) op_driver.cc:464] REPLICATION: finished
0709 12:13:21.766949 (+  4889us) write_op.cc:301] APPLY: starting
0709 12:13:21.767033 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:21.767145 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:21.767258 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:21.767509 (+   251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:21.767671 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:21.767718 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:21.768586 (+   868us) log.cc:844] Serialized 22 byte log entry
0709 12:13:21.768772 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:21.768884 (+   112us) write_op.cc:454] Released schema lock
0709 12:13:21.768928 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2307,"reported_tablets":7,"spinlock_wait_cycles":12011904,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":1694,"apply.run_wall_time_us":10771,"num_ops":1,"prepare.queue_time_us":75317,"prepare.run_cpu_time_us":3152,"prepare.run_wall_time_us":69643,"replication_time_us":97015}]]}
I20260709 12:13:21.843518   821 raft_consensus.cc:359] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:21.844367   821 raft_consensus.cc:740] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:21.854434   821 consensus_queue.cc:260] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:21.857652   821 ts_tablet_manager.cc:1434] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:13:21.858613   821 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:22.283049   873 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.291143   873 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:22.294731 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:22.294371   873 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:22.296334   873 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.298079   873 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:22.312296   821 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.313596   821 tablet_bootstrap.cc:492] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.314653   821 ts_tablet_manager.cc:1403] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.456s	user 0.037s	sys 0.017s
I20260709 12:13:22.323074 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:22.333719 32603 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111) [suppressed 348 similar messages]
I20260709 12:13:22.336094 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:22.337314 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 51223.7us
I20260709 12:13:22.319835   873 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:22.348932   821 raft_consensus.cc:359] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.358244   821 raft_consensus.cc:740] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.359745   821 consensus_queue.cc:260] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.362805   821 ts_tablet_manager.cc:1434] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:13:22.367463   873 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.386030   873 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:22.397429   873 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:22.420845 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 51761.7us
W20260709 12:13:22.427649 32529 consensus_peers.cc:597] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:22.438596 24442 thread.cc:641] rpc worker (service pool kudu.consensus.ConsensusService) Time spent creating pthread: real 0.566s	user 0.052s	sys 0.146s
W20260709 12:13:22.442665 24442 thread.cc:608] rpc worker (service pool kudu.consensus.ConsensusService) Time spent starting thread: real 0.571s	user 0.052s	sys 0.146s
I20260709 12:13:22.443243   821 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:22.403988   817 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:22.425657   873 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.443568 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:22.456909   992 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:22.459391   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 72399.9us
I20260709 12:13:22.449913   873 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:22.469120 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:22.487202   873 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:22.534009 32529 consensus_peers.cc:597] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:22.534890 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:22.545044   816 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:22.549194   873 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:22.545898 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:22.558218 32455 consensus_peers.cc:597] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:22.568189 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:22.612864 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 48518.6us
W20260709 12:13:22.613804 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 49093.1us
I20260709 12:13:22.624138   873 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.624831   873 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:22.626726 32603 consensus_peers.cc:597] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:22.631208   821 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.632272   873 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:22.632405   821 tablet_bootstrap.cc:492] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.632941 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:22.633530   821 ts_tablet_manager.cc:1403] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.191s	user 0.030s	sys 0.009s
I20260709 12:13:22.637545   821 raft_consensus.cc:359] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.638669   821 raft_consensus.cc:740] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.639998   821 consensus_queue.cc:260] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.642947   821 ts_tablet_manager.cc:1434] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:13:22.643959   821 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:22.645836   816 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:22.647433   816 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:22.648265   992 raft_consensus.cc:2749] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:22.648705   873 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:22.649736 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:22.658104   816 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:22.659476   873 raft_consensus.cc:2749] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:22.667174 32455 consensus_peers.cc:597] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:22.669809 32455 consensus_peers.cc:597] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:22.671527   873 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.672104   873 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:22.675432   873 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:22.675403 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:22.676069 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:22.679575   816 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:22.681308   873 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:22.688685   821 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.689903   821 tablet_bootstrap.cc:492] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.690752   821 ts_tablet_manager.cc:1403] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.004s
I20260709 12:13:22.696197   821 raft_consensus.cc:359] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:22.697628   821 raft_consensus.cc:740] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.698467   821 consensus_queue.cc:260] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:22.700726   821 ts_tablet_manager.cc:1434] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:22.701650   821 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:22.713929 32603 consensus_peers.cc:597] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:22.726716 32529 consensus_peers.cc:597] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:22.738420   821 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.739809   821 tablet_bootstrap.cc:492] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.740574   821 ts_tablet_manager.cc:1403] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.003s
I20260709 12:13:22.746655   821 raft_consensus.cc:359] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.747575   821 raft_consensus.cc:740] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.748816   821 consensus_queue.cc:260] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.752580   821 ts_tablet_manager.cc:1434] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:13:22.753544   821 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:22.765892 32455 consensus_peers.cc:597] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:22.767972 32603 consensus_peers.cc:597] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:22.784322   821 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.785652   821 tablet_bootstrap.cc:492] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.786473   821 ts_tablet_manager.cc:1403] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.014s
I20260709 12:13:22.789795   821 raft_consensus.cc:359] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:22.790637   821 raft_consensus.cc:740] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.791417   821 consensus_queue.cc:260] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:22.797353   821 ts_tablet_manager.cc:1434] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:22.798628   821 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:22.820652 32455 consensus_peers.cc:597] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:22.827169 32529 consensus_peers.cc:597] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:22.846225 32455 consensus_peers.cc:597] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:22.854720 32603 consensus_peers.cc:597] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:22.866245   821 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.867542   821 tablet_bootstrap.cc:492] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.868347   821 ts_tablet_manager.cc:1403] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.000s
I20260709 12:13:22.871600   821 raft_consensus.cc:359] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.872407   821 raft_consensus.cc:740] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:22.873201   821 consensus_queue.cc:260] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:22.884474   821 ts_tablet_manager.cc:1434] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:13:22.886363   821 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:22.923193   821 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.924268   821 tablet_bootstrap.cc:492] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:22.924999   821 ts_tablet_manager.cc:1403] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.004s
W20260709 12:13:22.924847 32455 consensus_peers.cc:597] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:22.928275   821 raft_consensus.cc:359] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:22.929548   821 raft_consensus.cc:740] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
W20260709 12:13:22.929787 32529 consensus_peers.cc:597] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:22.930572   821 consensus_queue.cc:260] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:22.933485   821 ts_tablet_manager.cc:1434] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:22.934430   821 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:22.959267   873 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.960183   873 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:22.967666 32529 consensus_peers.cc:597] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:22.970369 32529 consensus_peers.cc:597] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:22.973325   873 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:22.975123 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:22.975410 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:22.977448   816 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:22.985909   873 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:23.007462   821 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.008591   821 tablet_bootstrap.cc:492] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.009291   821 ts_tablet_manager.cc:1403] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.075s	user 0.038s	sys 0.029s
I20260709 12:13:23.012352   821 raft_consensus.cc:359] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:23.013077   821 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.013948   821 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:23.016707   821 ts_tablet_manager.cc:1434] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:13:23.017673   821 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:23.023339 32455 consensus_peers.cc:597] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.044282 32603 consensus_peers.cc:597] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:23.048775   821 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.053362   821 tablet_bootstrap.cc:492] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.054152   821 ts_tablet_manager.cc:1403] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.007s
I20260709 12:13:23.057103   821 raft_consensus.cc:359] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.059036   821 raft_consensus.cc:740] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.059886   821 consensus_queue.cc:260] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.062745   821 ts_tablet_manager.cc:1434] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:13:23.063582   821 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:23.069344 32603 consensus_peers.cc:597] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:23.095593 32603 consensus_peers.cc:597] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:23.100654   821 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.101799   821 tablet_bootstrap.cc:492] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.102603   821 ts_tablet_manager.cc:1403] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.016s
I20260709 12:13:23.105459   821 raft_consensus.cc:359] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.106196   821 raft_consensus.cc:740] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.107069   821 consensus_queue.cc:260] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.110940   821 ts_tablet_manager.cc:1434] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:23.111886   821 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:23.115891 32455 consensus_peers.cc:597] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.117774 32603 consensus_peers.cc:597] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:23.174974 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:40497
I20260709 12:13:23.175227  1039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:40497 every 8 connection(s)
I20260709 12:13:23.183331   821 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.184420   821 tablet_bootstrap.cc:492] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.185138   821 ts_tablet_manager.cc:1403] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.025s
I20260709 12:13:23.188048   821 raft_consensus.cc:359] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.188889   821 raft_consensus.cc:740] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.189857   821 consensus_queue.cc:260] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.191788   821 ts_tablet_manager.cc:1434] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:23.192592   821 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:23.253501 32455 consensus_peers.cc:597] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.256081 32455 consensus_peers.cc:597] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:23.271881   873 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.272605   873 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.275318   873 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:23.277675  1003 raft_consensus.cc:3060] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.283111 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:23.284365 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:23.287879   818 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:23.288614   873 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:23.290542   821 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.292295   821 tablet_bootstrap.cc:492] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.293190   821 ts_tablet_manager.cc:1403] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.101s	user 0.027s	sys 0.039s
I20260709 12:13:23.296911   821 raft_consensus.cc:359] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.297829   821 raft_consensus.cc:740] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.298659   821 consensus_queue.cc:260] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.300416   821 ts_tablet_manager.cc:1434] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:23.301723   821 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
W20260709 12:13:23.330164 32455 consensus_peers.cc:597] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:23.339674 32455 consensus_peers.cc:597] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:23.356523   821 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.357694   821 tablet_bootstrap.cc:492] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.358484   821 ts_tablet_manager.cc:1403] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.013s
I20260709 12:13:23.359153  1040 heartbeater.cc:344] Connected to a master server at 127.23.222.190:41543
I20260709 12:13:23.359647  1040 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:23.360713  1040 heartbeater.cc:507] Master 127.23.222.190:41543 requested a full tablet report, sending...
I20260709 12:13:23.372709   821 raft_consensus.cc:359] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.373512   821 raft_consensus.cc:740] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.374356   821 consensus_queue.cc:260] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.376976   821 ts_tablet_manager.cc:1434] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 12:13:23.378029   821 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.383944  1007 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.462853   821 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.463670   821 tablet_bootstrap.cc:492] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.464362   821 ts_tablet_manager.cc:1403] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.087s	user 0.035s	sys 0.013s
W20260709 12:13:23.464479 32603 consensus_peers.cc:597] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:23.467344   821 raft_consensus.cc:359] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:23.470793   821 raft_consensus.cc:740] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.471585   821 consensus_queue.cc:260] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:23.474193   821 ts_tablet_manager.cc:1434] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:23.475063   821 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.479800 32311 ts_manager.cc:194] Re-registered known tserver with Master: 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:23.501726  1007 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.511013  1002 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.524678   821 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.528656   821 tablet_bootstrap.cc:492] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.529450   821 ts_tablet_manager.cc:1403] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.012s
I20260709 12:13:23.532692   821 raft_consensus.cc:359] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.533430   821 raft_consensus.cc:740] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.534228   821 consensus_queue.cc:260] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.543180   821 ts_tablet_manager.cc:1434] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 12:13:23.545037   821 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.568257   821 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.569365   821 tablet_bootstrap.cc:492] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
W20260709 12:13:23.585116 32529 consensus_peers.cc:597] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:23.570068   821 ts_tablet_manager.cc:1403] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 12:13:23.588806 32311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41836
I20260709 12:13:23.589411   821 raft_consensus.cc:359] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.590183   821 raft_consensus.cc:740] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.591097   821 consensus_queue.cc:260] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.595875   821 ts_tablet_manager.cc:1434] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:13:23.596590  1040 heartbeater.cc:499] Master 127.23.222.190:41543 was elected leader, sending a full tablet report...
I20260709 12:13:23.598284   821 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.615438  1007 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.637511   821 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.638748   821 tablet_bootstrap.cc:492] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.639796   821 ts_tablet_manager.cc:1403] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.011s
I20260709 12:13:23.650534  1002 raft_consensus.cc:3060] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.663646   821 raft_consensus.cc:359] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.664460   821 raft_consensus.cc:740] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.665452   821 consensus_queue.cc:260] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.673224   821 ts_tablet_manager.cc:1434] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:13:23.674882  1001 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.686960   821 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.774228   821 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.795395   821 tablet_bootstrap.cc:492] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.796249   821 ts_tablet_manager.cc:1403] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.011s
I20260709 12:13:23.799676   821 raft_consensus.cc:359] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.800434   821 raft_consensus.cc:740] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.802171   821 consensus_queue.cc:260] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:23.804656   821 ts_tablet_manager.cc:1434] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:13:23.805594   821 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.896322   821 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.897548   821 tablet_bootstrap.cc:492] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.898449   821 ts_tablet_manager.cc:1403] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.004s
I20260709 12:13:23.901594   821 raft_consensus.cc:359] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.909166   821 raft_consensus.cc:740] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.910472   821 consensus_queue.cc:260] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:23.912508   821 ts_tablet_manager.cc:1434] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:13:23.913378   821 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:23.938798  1002 raft_consensus.cc:3060] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.978595   821 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:23.979839   821 tablet_bootstrap.cc:492] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:23.980638   821 ts_tablet_manager.cc:1403] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.006s
I20260709 12:13:23.983847   821 raft_consensus.cc:359] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:23.984577   821 raft_consensus.cc:740] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:23.985525   821 consensus_queue.cc:260] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:23.988130   821 ts_tablet_manager.cc:1434] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:13:23.989097   821 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.025274   821 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.026886   821 tablet_bootstrap.cc:492] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.027698   821 ts_tablet_manager.cc:1403] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.003s
I20260709 12:13:24.030303   821 raft_consensus.cc:359] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.042099   821 raft_consensus.cc:740] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.046497   821 consensus_queue.cc:260] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.053920   821 ts_tablet_manager.cc:1434] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:13:24.055058   821 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.129350   821 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.130465   821 tablet_bootstrap.cc:492] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.131076   821 ts_tablet_manager.cc:1403] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.002s
I20260709 12:13:24.133687   821 raft_consensus.cc:359] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.134477   821 raft_consensus.cc:740] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.135172   821 consensus_queue.cc:260] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.142478   821 ts_tablet_manager.cc:1434] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:24.145147   821 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.188369   821 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.189258   821 tablet_bootstrap.cc:492] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.189877   821 ts_tablet_manager.cc:1403] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.008s
I20260709 12:13:24.192055   821 raft_consensus.cc:359] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:24.192772   821 raft_consensus.cc:740] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.193636   821 consensus_queue.cc:260] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:24.195343   821 ts_tablet_manager.cc:1434] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:24.196915   821 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.209183  1001 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.224534   821 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.225749   821 tablet_bootstrap.cc:492] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.226651   821 ts_tablet_manager.cc:1403] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.003s
I20260709 12:13:24.230010   821 raft_consensus.cc:359] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.230785   821 raft_consensus.cc:740] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.231947   821 consensus_queue.cc:260] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.235244   821 ts_tablet_manager.cc:1434] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:24.236650   821 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.263967   821 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.265091   821 tablet_bootstrap.cc:492] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.266036   821 ts_tablet_manager.cc:1403] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 12:13:24.269176   821 raft_consensus.cc:359] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.269928   821 raft_consensus.cc:740] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.270864   821 consensus_queue.cc:260] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.273300   821 ts_tablet_manager.cc:1434] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:13:24.274547   821 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.294950   821 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.295818   821 tablet_bootstrap.cc:492] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.296406   821 ts_tablet_manager.cc:1403] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 12:13:24.299139   821 raft_consensus.cc:359] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.299844   821 raft_consensus.cc:740] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.300587   821 consensus_queue.cc:260] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.302553   821 ts_tablet_manager.cc:1434] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:13:24.303297   821 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.352675   821 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.353756   821 tablet_bootstrap.cc:492] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.354532   821 ts_tablet_manager.cc:1403] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.030s
I20260709 12:13:24.357273   821 raft_consensus.cc:359] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:24.358023   821 raft_consensus.cc:740] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.358765   821 consensus_queue.cc:260] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:24.362381   821 ts_tablet_manager.cc:1434] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:24.363237   821 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.393285   821 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.394349   821 tablet_bootstrap.cc:492] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.396178   821 ts_tablet_manager.cc:1403] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.004s
I20260709 12:13:24.399026   821 raft_consensus.cc:359] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:24.399762   821 raft_consensus.cc:740] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.400465   821 consensus_queue.cc:260] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:24.404080   821 ts_tablet_manager.cc:1434] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:24.406059   821 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.442962   821 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.445184   821 tablet_bootstrap.cc:492] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.446599   821 ts_tablet_manager.cc:1403] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.013s
I20260709 12:13:24.449536   821 raft_consensus.cc:359] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.450344   821 raft_consensus.cc:740] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.451324   821 consensus_queue.cc:260] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.453902   821 ts_tablet_manager.cc:1434] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:24.455183   821 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.478734   821 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.479763   821 tablet_bootstrap.cc:492] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.480540   821 ts_tablet_manager.cc:1403] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.005s
I20260709 12:13:24.485540   821 raft_consensus.cc:359] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.486361   821 raft_consensus.cc:740] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.487221   821 consensus_queue.cc:260] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.488845   821 ts_tablet_manager.cc:1434] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:24.489710   821 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.534382   821 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.535499   821 tablet_bootstrap.cc:492] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.536235   821 ts_tablet_manager.cc:1403] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.013s
I20260709 12:13:24.545146   821 raft_consensus.cc:359] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.545965   821 raft_consensus.cc:740] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.547000   821 consensus_queue.cc:260] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.550663   821 ts_tablet_manager.cc:1434] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:13:24.552181  1001 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.553031   821 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.561583  1002 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.597469  1003 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.619863   821 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:24.621212   821 tablet_bootstrap.cc:492] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.621999   821 ts_tablet_manager.cc:1403] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.024s
I20260709 12:13:24.626451   821 raft_consensus.cc:359] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.627377   821 raft_consensus.cc:740] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.628072   821 consensus_queue.cc:260] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:24.630623   821 ts_tablet_manager.cc:1434] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:24.631559   821 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap starting.
I20260709 12:13:24.688019   821 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:24.689203   821 tablet_bootstrap.cc:492] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Bootstrap complete.
I20260709 12:13:24.694562  1003 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:24.702822   821 ts_tablet_manager.cc:1403] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Time spent bootstrapping tablet: real 0.071s	user 0.034s	sys 0.018s
I20260709 12:13:24.706175   821 raft_consensus.cc:359] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.707026   821 raft_consensus.cc:740] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Initialized, Role: FOLLOWER
I20260709 12:13:24.707798   821 consensus_queue.cc:260] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:24.710299   821 ts_tablet_manager.cc:1434] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:24.789919  1001 raft_consensus.cc:3060] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:25.449640 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 71374.4us
W20260709 12:13:25.457837 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 49149.9us
W20260709 12:13:27.239804 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 44116.4us
I20260709 12:13:33.299233 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.371706 32631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:33.372740 32631 raft_consensus.cc:606] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:33.375905 32631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2433debd51544aefbf04917c84186bbd"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:33.376509 32631 raft_consensus.cc:606] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:33.391120 32491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70f9e9a08efa4169b31414570a994868"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:33.391868 32491 raft_consensus.cc:606] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:33.394837 32631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:33.395373 32631 raft_consensus.cc:606] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:33.398366 32631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:33.399096 32631 raft_consensus.cc:606] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:33.402070 32631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:33.402733 32631 raft_consensus.cc:606] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Received request to transfer leadership to TS 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:33.404264 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:33.406317 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.407485 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:33.443297  1120 raft_consensus.cc:993] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:33.444200  1116 raft_consensus.cc:1081] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Signalling peer 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:33.446194 32560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:33.446954 32560 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.447342 32560 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.456142 32560 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:33.458482 32560 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:33.459640 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:33.459602 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:33.460759 32631 raft_consensus.cc:3055] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.460861 32491 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.461179 32631 raft_consensus.cc:740] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:33.462508 32631 consensus_queue.cc:260] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:33.464011 32631 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.469082 32491 raft_consensus.cc:2468] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:33.471519 32530 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:33.472100 32631 raft_consensus.cc:2468] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:33.473006  1123 raft_consensus.cc:2804] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.473615  1123 raft_consensus.cc:697] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:33.475500  1123 consensus_queue.cc:237] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:33.489272 32314 catalog_manager.cc:5697] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.495453  1120 raft_consensus.cc:993] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.496255  1116 raft_consensus.cc:1081] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.499266  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:13:33.499876  1002 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.500319  1002 raft_consensus.cc:3060] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.510076  1002 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.515483 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:33.516294 32630 raft_consensus.cc:3055] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.516566 32630 raft_consensus.cc:740] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:33.517447 32630 consensus_queue.cc:260] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.515280 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:33.518849 32560 raft_consensus.cc:3060] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.522277 32630 raft_consensus.cc:3060] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.536048 32560 raft_consensus.cc:2468] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:33.514726  1002 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:33.537856   818 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:33.539923  1135 raft_consensus.cc:2804] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.541239  1135 raft_consensus.cc:697] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:33.542646 32630 raft_consensus.cc:2468] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:33.542302  1135 consensus_queue.cc:237] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.555222 32314 catalog_manager.cc:5697] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.611043  1120 raft_consensus.cc:993] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.611613  1120 raft_consensus.cc:1081] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.613312  1001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:13:33.613842  1001 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.614475  1001 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.622107  1001 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.624840 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:33.625526 32560 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.632586 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:33.633450 32630 raft_consensus.cc:3055] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.633708 32560 raft_consensus.cc:2468] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:33.633857 32630 raft_consensus.cc:740] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:33.634392  1001 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:33.635165 32630 consensus_queue.cc:260] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.636070   818 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:33.636577 32630 raft_consensus.cc:3060] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.643185  1135 raft_consensus.cc:2804] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.643857  1135 raft_consensus.cc:697] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:33.644865  1135 consensus_queue.cc:237] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.649281 32630 raft_consensus.cc:2468] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:33.661940 32314 catalog_manager.cc:5697] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 3, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.707283  1116 raft_consensus.cc:993] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.708942  1116 raft_consensus.cc:1081] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.712673  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2433debd51544aefbf04917c84186bbd"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:13:33.713796  1002 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.714332  1002 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.724104  1002 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:33.727492 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:33.727599  1002 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:33.730221 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:33.730984 32491 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.728174 32630 raft_consensus.cc:3055] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.734511 32630 raft_consensus.cc:740] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:33.735386 32630 consensus_queue.cc:260] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:33.736753 32630 raft_consensus.cc:3060] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.761677  1120 raft_consensus.cc:993] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.763839  1116 raft_consensus.cc:1081] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.765025 32491 raft_consensus.cc:2468] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:33.767272   817 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:33.768215  1135 raft_consensus.cc:2804] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.768679  1135 raft_consensus.cc:697] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:33.769518  1135 consensus_queue.cc:237] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:33.765693  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52100
I20260709 12:13:33.774206  1002 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.774735  1002 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.777705 32630 raft_consensus.cc:2468] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:33.789232  1002 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.783511 32314 catalog_manager.cc:5697] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 3, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.793174 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:33.793877 32491 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.801344  1002 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:33.802829 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:33.803555 32630 raft_consensus.cc:3055] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.803845 32630 raft_consensus.cc:740] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:33.804746 32630 consensus_queue.cc:260] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.806493 32630 raft_consensus.cc:3060] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.816126 32630 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:33.816758 32491 raft_consensus.cc:2468] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:33.817569   816 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:33.818737  1135 raft_consensus.cc:2804] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.819290  1135 raft_consensus.cc:697] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:33.820207  1135 consensus_queue.cc:237] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:33.830188 32314 catalog_manager.cc:5697] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 3, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:33.921344  1126 raft_consensus.cc:993] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.921888  1126 raft_consensus.cc:1081] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:33.923733  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70f9e9a08efa4169b31414570a994868"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:13:33.923810 32630 raft_consensus.cc:1275] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.924270  1002 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.924626  1002 raft_consensus.cc:3060] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.925179  1135 consensus_queue.cc:1048] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.932252  1002 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:33.935010  1002 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:33.936404 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:33.937117 32491 raft_consensus.cc:3055] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.937325 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:33.938032 32635 raft_consensus.cc:3060] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.937424 32491 raft_consensus.cc:740] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:33.943403 32491 consensus_queue.cc:260] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:33.944555 32491 raft_consensus.cc:3060] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.947063 32635 raft_consensus.cc:2468] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:33.948690   816 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:33.949671  1135 raft_consensus.cc:2804] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.951118  1135 raft_consensus.cc:697] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:33.952054  1135 consensus_queue.cc:237] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:33.962284 32491 raft_consensus.cc:2468] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:33.969108 32560 raft_consensus.cc:1275] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.970858  1136 consensus_queue.cc:1048] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:33.973479 32491 raft_consensus.cc:1275] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:33.975965 32311 catalog_manager.cc:5697] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.988365  1139 consensus_queue.cc:1048] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:34.018342 32635 raft_consensus.cc:1275] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.021247  1114 consensus_queue.cc:1048] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:34.214337 32635 raft_consensus.cc:1275] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.216861  1136 consensus_queue.cc:1048] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.217449 32635 raft_consensus.cc:1275] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.219635  1136 consensus_queue.cc:1048] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.231308 32482 raft_consensus.cc:1275] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.234622  1135 consensus_queue.cc:1048] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.235023 32562 raft_consensus.cc:1275] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.253091  1135 consensus_queue.cc:1048] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.375232 32631 raft_consensus.cc:1275] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.376731 32482 raft_consensus.cc:1275] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:34.377300  1157 consensus_queue.cc:1048] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:34.383473  1157 consensus_queue.cc:1048] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:34.403923 32631 raft_consensus.cc:1275] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.406041  1146 consensus_queue.cc:1048] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:34.426427 32490 raft_consensus.cc:1275] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:34.428519  1157 consensus_queue.cc:1048] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:34.453246 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.499485 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:34.500185 32490 raft_consensus.cc:606] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:34.515707 32562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:34.516333 32562 raft_consensus.cc:606] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:34.519690 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:34.520421 32490 raft_consensus.cc:606] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:34.524113 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:34.524708 32490 raft_consensus.cc:606] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:34.527436 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:34.527956 32490 raft_consensus.cc:606] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:34.529275 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:34.530954 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:34.531761 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:34.606699  1111 raft_consensus.cc:993] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:34.607223  1148 raft_consensus.cc:1081] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:34.608654 32562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:56764
I20260709 12:13:34.609076 32562 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.609319 32562 raft_consensus.cc:3060] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.615906 32562 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:34.618233 32562 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:34.618995 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:34.619226 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:34.619778 32490 raft_consensus.cc:3055] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.619827 32635 raft_consensus.cc:3060] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.620163 32490 raft_consensus.cc:740] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:34.620970 32490 consensus_queue.cc:260] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:34.622088 32490 raft_consensus.cc:3060] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.629175 32490 raft_consensus.cc:2468] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:34.629582 32635 raft_consensus.cc:2468] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:34.630717 32530 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:34.632140  1114 raft_consensus.cc:2804] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.632596  1114 raft_consensus.cc:697] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:34.633478  1114 consensus_queue.cc:237] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:34.638203  1111 raft_consensus.cc:993] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:34.638803  1111 raft_consensus.cc:1081] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:34.643146 32635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:52296
I20260709 12:13:34.643764 32635 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.644109 32635 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.648351  1148 raft_consensus.cc:993] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:34.648914  1148 raft_consensus.cc:1081] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:34.653328 32635 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:34.654556  1005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:13:34.655259  1005 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.655777  1005 raft_consensus.cc:3060] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.658087 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:34.658413 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:34.658785 32562 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.659049 32482 raft_consensus.cc:3055] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.659376 32482 raft_consensus.cc:740] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:34.660167 32482 consensus_queue.cc:260] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:34.665226 32313 catalog_manager.cc:5697] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.670554 32482 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.672920 32562 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:34.674607 32605 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:34.675035 32635 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:34.675637  1120 raft_consensus.cc:2804] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.676239  1120 raft_consensus.cc:697] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:34.677440  1120 consensus_queue.cc:237] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:34.683766  1005 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:34.691628 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:34.692660 32635 raft_consensus.cc:3060] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.692642  1005 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:34.695508 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:34.696177 32490 raft_consensus.cc:3055] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.696537 32490 raft_consensus.cc:740] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:34.697628 32490 consensus_queue.cc:260] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:34.699106 32490 raft_consensus.cc:3060] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.709705 32482 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:34.709250 32314 catalog_manager.cc:5697] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:34.736974 32490 raft_consensus.cc:2468] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:34.738488   817 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:34.738694 32635 raft_consensus.cc:2468] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:34.739867  1146 raft_consensus.cc:2804] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.740374  1146 raft_consensus.cc:697] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:34.741381  1146 consensus_queue.cc:237] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:34.760778 32311 catalog_manager.cc:5697] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.930303  1168 raft_consensus.cc:993] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:34.930999  1152 raft_consensus.cc:1081] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:34.932740  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52080
I20260709 12:13:34.933331  1002 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:34.933630  1002 raft_consensus.cc:3060] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.943048  1002 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:34.953105  1002 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:34.954288 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:34.954089 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:34.954955 32562 raft_consensus.cc:3055] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:34.955049 32482 raft_consensus.cc:3060] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.955274 32562 raft_consensus.cc:740] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:34.956166 32562 consensus_queue.cc:260] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:34.957679 32562 raft_consensus.cc:3060] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:34.963243 32482 raft_consensus.cc:2468] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:34.964881   817 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:34.965744  1157 raft_consensus.cc:2804] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:34.966356  1157 raft_consensus.cc:697] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:34.967281  1157 consensus_queue.cc:237] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:34.969853 32562 raft_consensus.cc:2468] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:34.982465 32311 catalog_manager.cc:5697] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.032676  1125 raft_consensus.cc:993] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:35.033177  1125 raft_consensus.cc:1081] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:35.034960  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:13:35.035457  1002 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.035729  1002 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.041971  1002 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:35.044574  1002 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:35.045127 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:35.045617 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:35.045871 32635 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.046331 32482 raft_consensus.cc:3055] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:35.046641 32482 raft_consensus.cc:740] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:35.047389 32482 consensus_queue.cc:260] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:35.048378 32482 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.053352 32635 raft_consensus.cc:2468] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:35.053903 32482 raft_consensus.cc:2468] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:35.055109   816 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:35.056087  1157 raft_consensus.cc:2804] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:35.056569  1157 raft_consensus.cc:697] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:35.057500  1157 consensus_queue.cc:237] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:35.069227 32311 catalog_manager.cc:5697] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.171249 32482 raft_consensus.cc:1275] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.172955  1168 consensus_queue.cc:1048] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:35.195309 32635 raft_consensus.cc:1275] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.198657  1152 consensus_queue.cc:1048] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.203011 32562 raft_consensus.cc:1275] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.206701  1120 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.207448 32482 raft_consensus.cc:1275] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.212360  1120 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.233676 32490 raft_consensus.cc:1275] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.238523  1157 consensus_queue.cc:1048] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.337265 32630 raft_consensus.cc:1275] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.340231  1136 consensus_queue.cc:1048] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.386278 32482 raft_consensus.cc:1275] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.393234  1136 consensus_queue.cc:1048] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:35.439266 32561 raft_consensus.cc:1275] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.441458  1157 consensus_queue.cc:1048] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.544526 32482 raft_consensus.cc:1275] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.563714  1136 consensus_queue.cc:1048] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:35.577337 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.624888 32630 raft_consensus.cc:1275] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:35.627149  1192 consensus_queue.cc:1048] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:35.756062 32630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:35.757237 32630 raft_consensus.cc:606] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:35.778589 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:35.779338 32490 raft_consensus.cc:606] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:35.783257 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:35.783993 32490 raft_consensus.cc:606] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:35.791957 32562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:35.792833 32562 raft_consensus.cc:606] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:35.803874 32490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffe193066934411da2b11565c9080849"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:35.804683 32490 raft_consensus.cc:606] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:35.823810 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:35.826699 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:35.833819  1148 raft_consensus.cc:993] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:35.850497  1148 raft_consensus.cc:1081] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:35.852805  1001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:13:35.855320  1001 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.855834  1001 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.848531 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:35.867874  1001 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:35.871409 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:35.871688 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:35.872623 32490 raft_consensus.cc:3055] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:35.872959 32490 raft_consensus.cc:740] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:35.871448  1001 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:35.872961 32560 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.874686 32490 consensus_queue.cc:260] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:35.876478 32490 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.884164 32560 raft_consensus.cc:2468] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:35.886173   818 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:35.887274  1192 raft_consensus.cc:2804] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:35.887789  1192 raft_consensus.cc:697] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:35.889077 32490 raft_consensus.cc:2468] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:35.888804  1192 consensus_queue.cc:237] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:35.896437  1111 raft_consensus.cc:993] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:35.897078  1111 raft_consensus.cc:1081] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:35.907816  1001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffe193066934411da2b11565c9080849"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:13:35.908614  1001 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:35.909065  1001 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.940203  1001 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:35.940721 32314 catalog_manager.cc:5697] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:35.943069  1001 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:35.944171 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:35.944531 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:35.945163 32490 raft_consensus.cc:3055] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:35.945430 32561 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.945663 32490 raft_consensus.cc:740] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:35.947707 32490 consensus_queue.cc:260] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:35.949254 32490 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:35.960484 32490 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:35.962369   817 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:35.963683  1157 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:35.964298  1157 raft_consensus.cc:697] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:35.964951 32561 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:35.965685  1157 consensus_queue.cc:237] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:35.989255 32314 catalog_manager.cc:5697] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.023324  1196 raft_consensus.cc:993] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:36.024006  1196 raft_consensus.cc:1081] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:36.027277 32561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:56764
I20260709 12:13:36.028527 32561 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:36.029318 32561 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.094688  1215 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.095741  1215 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.080834  1192 raft_consensus.cc:493] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.098526  1192 raft_consensus.cc:515] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.112718  1192 leader_election.cc:290] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.120209  1216 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.121398  1216 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.113415  1192 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.123369  1192 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.131975  1213 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.132771  1215 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.133648  1215 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.133262  1213 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.134302  1215 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.136677  1212 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.131991  1192 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.143262  1192 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.142782  1212 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.143766  1192 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.145991  1192 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.134022 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.163810  1213 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.164963  1209 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.165324  1216 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.149130  1212 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.136765  1215 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.165843  1209 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.181824 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.179318  1212 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.184649  1212 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.186954  1212 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.187000  1215 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.187674  1215 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.190613  1216 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.191316  1216 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.193693  1216 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.200896  1207 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.203491  1207 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.198215  1215 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:37.245652 32561 consensus_meta.cc:287] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: Time spent flushing consensus metadata: real 1.216s	user 0.024s	sys 0.000s
I20260709 12:13:37.254689 32561 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.257972 32561 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.270475 32561 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56764 (request call id 766) took 1243 ms. Trace:
I20260709 12:13:37.271530 32561 rpcz_store.cc:276] 0709 12:13:36.026636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.027054 (+   418us) service_pool.cc:224] Handling call
0709 12:13:37.270334 (+1243280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:37.278177  1219 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.278923  1219 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.281971  1219 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.288300  1218 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.289078  1218 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.276341  1207 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.291018  1217 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.226050  1209 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.291740  1218 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.291899  1219 raft_consensus.cc:493] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.292575  1218 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.292698  1219 raft_consensus.cc:515] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.293208  1218 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.291751  1217 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.294875  1210 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.297381  1210 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.296661  1218 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.301347  1219 leader_election.cc:290] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.302467  1210 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.295981  1216 raft_consensus.cc:493] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.364841  1217 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.373353  1207 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.373586  1222 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.374071  1207 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.374228  1222 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.375115  1208 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.375725  1208 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.376484  1207 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.376820  1222 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.386936  1213 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.387643  1213 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.389842  1206 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.380746  1218 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.368224  1209 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.393424  1218 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.396211  1209 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.411428  1209 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.411509  1218 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.403358 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.378485  1217 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.426270 32485 raft_consensus.cc:2468] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:37.395022  1221 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.427747  1210 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.427901  1221 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.428467  1210 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.430904  1221 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.367650  1216 raft_consensus.cc:515] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.397780  1208 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.390193  1213 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.414245  1212 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.438112  1217 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.439935  1207 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.439882  1222 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.447772  1207 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.448100  1222 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.449271  1217 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.449677  1219 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.449887  1217 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.450341  1219 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.441886  1208 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.452957 32482 raft_consensus.cc:1275] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.450032  1207 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.456712  1221 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.462141  1221 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.462524 32483 raft_consensus.cc:1275] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.463397  1224 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.463980  1224 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.464298  1214 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.464576  1221 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.464893  1214 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.447139  1223 raft_consensus.cc:493] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.466517  1223 raft_consensus.cc:515] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.467300  1214 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.468976  1223 leader_election.cc:290] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.462587  1208 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.467365 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.471122  1208 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.471889  1215 raft_consensus.cc:493] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.390736  1206 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.472528  1215 raft_consensus.cc:515] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.474400  1206 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.438531  1218 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.476013  1219 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.453464  1222 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.476562  1218 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.480901  1218 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.467974  1226 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.486554  1211 raft_consensus.cc:493] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.493992  1226 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.494100  1211 raft_consensus.cc:515] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.481454  1212 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.507766  1229 raft_consensus.cc:493] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.508085  1211 leader_election.cc:290] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.488654  1224 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.508539  1229 raft_consensus.cc:515] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.509348  1218 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.509975  1218 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.511193  1229 leader_election.cc:290] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.512283  1218 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.512676  1192 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.512900  1230 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.513513  1230 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.513881  1215 leader_election.cc:290] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.459028  1217 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.516018  1230 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.469182  1214 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.518613  1214 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.519645  1227 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.513439  1210 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.524387  1228 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.524011  1227 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.525170  1214 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.525005  1228 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.476092  1206 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.525969  1206 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.526714  1227 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.527068  1230 raft_consensus.cc:493] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.527257  1227 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.528167  1224 raft_consensus.cc:493] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.481351  1216 leader_election.cc:290] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.528273  1227 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.528815  1224 raft_consensus.cc:515] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.513497  1192 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.531087  1224 leader_election.cc:290] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.528941  1226 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.531186  1227 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.533025  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.535229  1230 raft_consensus.cc:515] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.538625  1230 leader_election.cc:290] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.539160  1192 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.528268  1206 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.539732  1217 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.541688  1220 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.542523  1003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.544333  1228 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.531646  1224 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.574504  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.575385  1002 raft_consensus.cc:2468] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:37.527385  1222 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.582239  1211 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.587050  1212 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.587514  1225 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.587656  1222 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.588207  1225 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.590829  1211 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.583129  1226 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.595065  1226 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.596037  1211 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.597447  1226 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.598212   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.599805   985 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:37.600591   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.600919   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.601586   985 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:37.601953  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.602347  1233 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.598969   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.602955  1233 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.590852  1234 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.573002  1208 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.607363  1217 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.590029  1222 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.609968 32560 raft_consensus.cc:1275] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.601982  1216 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.610796  1217 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.611429  1231 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.610663  1208 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.612192  1231 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.613574  1217 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.613766  1208 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.614217  1217 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.614526  1208 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.614816  1217 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.615139  1208 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.615514  1234 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.610736  1210 raft_consensus.cc:493] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.616873  1210 raft_consensus.cc:515] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.617286  1208 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.584939  1224 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.611358  1216 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.621501  1224 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.590914  1228 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.618644  1217 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.622131 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.623816 32490 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.626664  1216 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.622764 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.627795 32491 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.622852 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.631815 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.632543 32561 raft_consensus.cc:2468] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.628952 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.634670 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.634712  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.635514  1233 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.635881  1235 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.636124  1233 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.636633  1235 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.637022 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.637691 32561 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.637912  1231 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.638635  1216 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.639181  1235 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.636742  1233 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.639890  1212 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.642855 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:37.560065 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 122303us
I20260709 12:13:37.654052 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.618008  1234 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.640470  1216 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.654515 32562 raft_consensus.cc:2468] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.663364 32560 raft_consensus.cc:1275] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:37.669540 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.670454  1218 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.671078  1218 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.657900  1212 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.672130  1210 leader_election.cc:290] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.673069   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.662899  1209 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.673353  1212 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.663327  1207 raft_consensus.cc:493] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.673893   987 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:37.674412  1209 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.674728   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.658238  1222 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.675875  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.676407  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.674530  1207 raft_consensus.cc:515] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.666558  1224 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.678323 32604 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.678222  1224 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.679029  1209 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.679399  1232 raft_consensus.cc:2804] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.679780  1232 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:37.680122  1232 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.680663  1224 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.681547 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.668155  1213 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.673399  1218 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.682762  1213 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.683689 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.542560  1220 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.688295 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.711009 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.711694  1220 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.712179 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.689574  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.689988 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.683703   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.690291 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.719515  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.691146 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.694396  1213 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.695770 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.690306 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.696705  1237 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.729009  1237 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.730479 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.730674 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.731324 32557 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:37.697191  1226 raft_consensus.cc:493] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.734104 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.734588  1226 raft_consensus.cc:515] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.737253  1226 leader_election.cc:290] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.737681  1209 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.733234 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.738480  1209 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.676424  1222 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.741878  1222 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.731727  1237 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.700345  1234 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.622937  1228 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.746788 32561 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:37.748153  1228 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.749114  1234 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.700831  1224 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.751087  1224 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.752373  1234 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.754508 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.701263  1216 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.755329  1224 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.701759  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.702437 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.757136  1233 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.757331 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.703585 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.704140  1227 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.758157 32634 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:37.758613  1227 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.761030  1227 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.702947   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.705054 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.763664 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.758179 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.765676 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.766932 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.767084 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.767302 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.767535 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.768177 32557 raft_consensus.cc:2393] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 2: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:37.706203 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.769028 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.655349  1225 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.769840 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.770663 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.651423  1215 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.771566 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.772329 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.772176  1215 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.772694 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.773041 32557 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:37.714931  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.715142 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.772330 32556 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:37.715590   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.774013 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.766350 32564 raft_consensus.cc:2468] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.775337   986 raft_consensus.cc:2468] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:37.716936  1192 consensus_queue.cc:1048] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:37.778040 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.771884 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.778887 32630 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:37.765074 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.782985 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37b1dfe917c4fe7bcb6254184f6b369" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.784808 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.785104  1003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.785490 32630 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:37.787369  1239 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.723476 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:37.788178   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 103321us
I20260709 12:13:37.788846  1239 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.791181  1215 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.720479  1005 raft_consensus.cc:2468] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:37.792893  1239 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.718786 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.733222 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.793643 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.793912 32635 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.733712 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.698223  1207 leader_election.cc:290] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.700057 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.795100 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.744465 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.775358 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.744596  1209 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.796696 32561 raft_consensus.cc:1240] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:37.754312 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.797370 32632 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.701085 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.773928 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:37.787596 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 164478us
I20260709 12:13:37.788301 32485 raft_consensus.cc:3055] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:37.799078 32485 raft_consensus.cc:740] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:37.799844   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.800122 32485 consensus_queue.cc:260] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.801234 32485 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.801640   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.722666 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.802486 32455 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.722236  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.803351 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.709228  1232 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.804379  1225 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.804827  1225 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.805166  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.805392 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.798162 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.808238   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.810453   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.805191  1225 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.803673 32455 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.806936  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.808182 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.812012 32632 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:37.813066  1221 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.813473  1221 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.813853  1221 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.819449 32632 raft_consensus.cc:1240] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:37.798569   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.806264 32630 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.820327 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.828099 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.828379 32635 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:37.832356 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:37.833647 32455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.806879  1241 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.834638   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.834580  1241 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.837069 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:37.837373   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 124239us
I20260709 12:13:37.819521 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.837973  1241 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.822558  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.823033 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.838536  1214 consensus_queue.cc:1048] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:37.839087   816 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.839217 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.840531  1214 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.840904  1214 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.841275  1214 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.825320  1232 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.827067 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.845552 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.846971 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.848615 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.849817 32605 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:37.850178 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.850343   817 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.850849  1232 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:37.851261  1232 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.851648  1232 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:37.852258 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.853876  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.853269 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.854861 32605 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:37.851842 32485 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:37.855775  1207 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.858050   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.858428  1207 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.859025  1207 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.859483 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.857251  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.864539 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.865326 32482 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:37.858090  1225 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.867152 32604 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:37.868042  1222 raft_consensus.cc:2749] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.868659  1215 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.869218  1215 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.869587  1215 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.870844   816 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.872399  1218 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.872805  1218 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.873317  1218 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.874176 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.876016 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.877682 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.867441  1225 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.878736 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:37.879962 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.880172   816 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.881388   816 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.880649 32562 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:37.882469  1242 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.883162  1240 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.883694  1240 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.883639  1242 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:37.884370  1242 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.884395 32529 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.885381  1234 raft_consensus.cc:2804] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.885771  1234 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.886147  1234 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.884363  1240 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.889981 32604 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:37.889740   816 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.891032  1222 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.891402  1192 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.891881  1192 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.892261  1192 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.896384  1234 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.898876  1234 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.899930  1222 raft_consensus.cc:2749] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.872870  1207 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:37.905259 32604 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:37.905387   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 55144.1us
I20260709 12:13:37.906819   817 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.918088  1233 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.908483  1209 raft_consensus.cc:2749] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.908813 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.918723  1233 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.910547 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.919787 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.920496  1215 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.921125 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.921478   817 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:37.911021   816 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.911293  1207 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.911435 32604 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:37.922611 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.922767  1215 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.905288  1192 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.923461 32604 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.923805 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.924953  1192 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.912226  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.915215   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:37.925622  1192 consensus_queue.cc:1059] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:37.926894  1209 raft_consensus.cc:2804] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.927397  1209 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.927785  1209 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.928387  1222 raft_consensus.cc:2749] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.913513 32529 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.929263  1225 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.929800  1234 raft_consensus.cc:2804] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.916523 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:37.914059  1221 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.917843 32605 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:37.907622 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.919198  1233 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.933571  1215 raft_consensus.cc:3055] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:37.934000  1215 raft_consensus.cc:740] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:37.934860  1215 consensus_queue.cc:260] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.935315  1221 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.915998  1218 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:37.935680 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.931290 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.922827  1216 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:37.932077 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:37.932713  1222 raft_consensus.cc:2749] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.937866 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.930194  1234 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.937996  1216 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:37.939248  1234 raft_consensus.cc:3060] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.939539  1216 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:37.929827  1225 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.941454  1214 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.941854  1218 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:37.930586 32529 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:37.943791  1237 raft_consensus.cc:2804] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:37.926873 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:37.944604  1237 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:37.953683 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.945029  1237 raft_consensus.cc:3060] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.956113 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:37.958580 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:37.961638 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:37.962041  1214 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:37.962827  1214 raft_consensus.cc:2749] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.964570 32457 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:37.966528 32604 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:37.967597  1222 raft_consensus.cc:2749] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.967737  1234 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:37.970542  1241 raft_consensus.cc:2749] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:37.971675  1225 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.973555 32457 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:37.969993  1234 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:37.976824  1241 raft_consensus.cc:2749] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:37.979400  1233 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:37.980358 32457 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:37.984818 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:37.996870  1215 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.001364 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:38.002772 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:37.997171  1209 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.003803 32562 raft_consensus.cc:2468] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:38.006434 32457 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:38.006966 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:38.008428  1241 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.010673  1241 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.011241  1241 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.011828  1233 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.013159 32630 raft_consensus.cc:1240] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.009274 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:38.009882  1221 raft_consensus.cc:2804] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.015391  1221 raft_consensus.cc:493] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.015795  1221 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:38.018790   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 97394.8us
I20260709 12:13:38.020632 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:38.020707   817 leader_election.cc:304] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.017949 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.023206 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:38.024399   817 leader_election.cc:304] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:38.006464   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 61551.3us
I20260709 12:13:38.025619  1214 raft_consensus.cc:2749] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.023265 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.022282  1209 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:37.977828  1216 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.028992 32605 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.030203  1209 raft_consensus.cc:2749] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.034581  1221 raft_consensus.cc:515] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.036535 32634 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:38.035509  1233 raft_consensus.cc:2749] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:37.994383   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 70788.2us
I20260709 12:13:38.038856 32455 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.039940 32565 raft_consensus.cc:1240] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.043048 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.043313 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.044106 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.054657  1225 raft_consensus.cc:2749] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.054613 32455 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:38.055518  1210 raft_consensus.cc:2804] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.044178 32491 raft_consensus.cc:1240] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:38.055895  1210 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:38.055994 32455 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.043246 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.056380  1210 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.045907 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:38.057085  1220 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.047051 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.057405  1227 consensus_queue.cc:1059] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:38.050163 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.048173 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "849d745295ee45abb8a522d542819654" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.058594 32639 raft_consensus.cc:2393] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 2: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:38.050781 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8288c4510048649fa8421e99bbcdb5" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.051443 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.051807 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.047700  1216 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.048552 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.063414  1207 raft_consensus.cc:3055] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.064136  1207 raft_consensus.cc:740] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.064357 32530 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:38.065251  1234 raft_consensus.cc:2804] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.066025  1234 raft_consensus.cc:697] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.067049  1234 consensus_queue.cc:237] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.065382  1207 consensus_queue.cc:260] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.059779   816 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:38.052706  1237 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.072060   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:38.080703  1221 leader_election.cc:290] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.151681 32562 raft_consensus.cc:1240] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.071996  1240 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.153862  1240 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:38.131042  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:38.081105  1207 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.088544   818 leader_election.cc:304] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.126869   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.074229   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:38.156944   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 68539.8us
I20260709 12:13:38.157945   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.159909   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:38.076982   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.146971  1242 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.192806  1242 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:38.161487 32562 raft_consensus.cc:1240] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.161892   987 raft_consensus.cc:1240] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.083630 32530 leader_election.cc:304] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:38.203895 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 120408us
I20260709 12:13:38.205626 32530 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.206467  1207 consensus_queue.cc:1059] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.207706  1207 raft_consensus.cc:3055] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.208076  1207 raft_consensus.cc:740] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.209012  1207 consensus_queue.cc:260] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.209753 32314 catalog_manager.cc:5697] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.210904  1228 raft_consensus.cc:2749] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.211587  1228 raft_consensus.cc:2749] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.212981 32530 leader_election.cc:304] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.214517 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.214936  1229 raft_consensus.cc:2749] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.216291  1207 raft_consensus.cc:3060] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.090597  1244 consensus_queue.cc:1048] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:13:38.163779  1243 raft_consensus.cc:2804] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.218535  1243 raft_consensus.cc:493] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:38.218984  1243 raft_consensus.cc:3060] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.089430  1003 raft_consensus.cc:1240] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.109510 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a3d4e0554c4f00956aa265c66fe82c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.220410 32565 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.157011  1227 consensus_queue.cc:1059] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:13:38.223001  1227 raft_consensus.cc:3055] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.223363  1227 raft_consensus.cc:740] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.224246  1227 consensus_queue.cc:260] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.225291 32491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:38.225507  1227 raft_consensus.cc:3060] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.225934 32491 raft_consensus.cc:606] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.082492  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:38.173774  1214 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.226583  1214 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:38.174320   818 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.175588   988 raft_consensus.cc:1240] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.227059  1214 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.227725   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 69452.6us
I20260709 12:13:38.228509  1244 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.183183 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.184450 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.187016 32455 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:38.231208 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 44288.9us
W20260709 12:13:38.232764 32454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.234372  1225 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.235190  1225 consensus_queue.cc:1059] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:38.236320  1225 raft_consensus.cc:3055] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.236660  1225 raft_consensus.cc:740] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.237512  1225 consensus_queue.cc:260] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.239217  1225 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.234421 32565 raft_consensus.cc:2468] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:38.245093 32457 leader_election.cc:304] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.245915  1238 raft_consensus.cc:2804] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:38.246501  1238 raft_consensus.cc:697] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.247375  1238 consensus_queue.cc:237] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.251112 32482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:36910
I20260709 12:13:38.251786 32482 raft_consensus.cc:606] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.258095 32565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:38.258781 32565 raft_consensus.cc:606] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:38.164633   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 104970us
I20260709 12:13:38.156116  1237 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:38.073423  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.072959  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:38.193648 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.195046 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.195842 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.196949 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:38.197810 32604 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.198941 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.189630  1232 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.200065 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.277892 32633 raft_consensus.cc:1240] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.286921 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.287854 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.217576 32530 leader_election.cc:304] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.221832 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
W20260709 12:13:38.290212 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 72749.8us
I20260709 12:13:38.074088   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:38.228629   818 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.289204 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.293787  1234 raft_consensus.cc:2749] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:38.294559   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 66025.2us
I20260709 12:13:38.295079  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.295670   818 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.295917  1244 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.296320  1244 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:38.296661  1244 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.297499 32491 raft_consensus.cc:1240] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.155557  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.188469  1241 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.298494  1215 consensus_queue.cc:1048] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.300311  1215 raft_consensus.cc:2804] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.300714  1215 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:38.301084  1215 raft_consensus.cc:3060] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.301792  1220 raft_consensus.cc:993] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:38.302295  1220 raft_consensus.cc:1081] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:38.302631 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.303540 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.229076  1233 consensus_queue.cc:1059] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.179160  1210 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.278075 32639 raft_consensus.cc:2468] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:38.305130  1242 raft_consensus.cc:3055] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.305361 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.306275 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.306098 32487 raft_consensus.cc:2393] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 3: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:38.306922 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.308522 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:38.275754 32660 debug-util.cc:398] Leaking SignalData structure 0x7b08001e04c0 after lost signal to thread 24445
I20260709 12:13:38.280037 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.280154   816 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:38.280845 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.281764 32630 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 4: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:38.282380 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4179064b9784670ae3b11664ecb7205" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.305505  1242 raft_consensus.cc:740] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:38.282881  1232 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.200608 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.284634 32636 raft_consensus.cc:2468] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:38.285465 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.310132   988 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52088
I20260709 12:13:38.315659   988 raft_consensus.cc:493] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.316192   988 raft_consensus.cc:3060] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.316679 32605 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.310725  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
W20260709 12:13:38.311419 32660 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1680 after lost signal to thread 32348
I20260709 12:13:38.319583  1232 raft_consensus.cc:2749] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.312664   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.290655   986 raft_consensus.cc:1240] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.313437 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0db16bbcbab34732ad62610122fd4ddd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:38.322778 32660 debug-util.cc:398] Leaking SignalData structure 0x7b080022b0e0 after lost signal to thread 32515
I20260709 12:13:38.322924 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.324476 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.325181 32634 raft_consensus.cc:3060] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.313634  1216 raft_consensus.cc:2804] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.326908  1216 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:38.327378  1216 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.327829  1221 consensus_queue.cc:1059] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:38.310071 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.314065  1242 consensus_queue.cc:260] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.330101  1242 raft_consensus.cc:3060] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.330163  1217 raft_consensus.cc:3055] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.330608 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.330854  1217 raft_consensus.cc:740] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.332147  1217 consensus_queue.cc:260] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.311224 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.335266 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.336387 32638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:38.336962 32638 raft_consensus.cc:606] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Received request to transfer leadership to TS 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:38.312052 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.344208 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:13:38.343793   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 46912.1us
I20260709 12:13:38.276901 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.348485 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.350054 32632 raft_consensus.cc:1240] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.331979 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.295143 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:38.346206 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:38.355593 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.355986  1234 consensus_queue.cc:1059] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:38.347033   818 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.345801 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.357853  1229 raft_consensus.cc:3055] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.358310  1229 raft_consensus.cc:740] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.359373  1229 consensus_queue.cc:260] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.360680  1229 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.344189 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.356510 32529 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.363929 32529 leader_election.cc:304] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.364856  1224 raft_consensus.cc:2749] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.365557  1224 raft_consensus.cc:2749] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.365660   816 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.367070 32529 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.370198  1237 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.376713 32637 raft_consensus.cc:2468] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:38.380360 32490 raft_consensus.cc:1240] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.380911  1243 raft_consensus.cc:515] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.381433 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.379129 32529 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.404198 32529 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.405370  1228 raft_consensus.cc:2749] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.383482  1209 raft_consensus.cc:993] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:38.406435  1209 raft_consensus.cc:1081] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Signalling peer 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:38.407568  1228 raft_consensus.cc:2749] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.409967 32562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:38.410782 32562 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.411207 32562 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.412209 32529 leader_election.cc:304] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.274372  1214 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.388151 32639 raft_consensus.cc:2393] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 2: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:38.389657  1240 raft_consensus.cc:2749] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.389889  1192 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.391162   818 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.427500  1192 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:38.427651 32485 raft_consensus.cc:1240] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:38.428001  1192 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.417385  1224 raft_consensus.cc:2749] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.418081   985 raft_consensus.cc:1240] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.419241  1209 consensus_queue.cc:1059] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:38.429183  1240 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.429625  1240 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:38.429862  1209 raft_consensus.cc:3055] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.429982  1240 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.419271  1003 raft_consensus.cc:1240] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.422062 32529 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.428444   818 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:38.409235 32660 debug-util.cc:398] Leaking SignalData structure 0x7b0800305180 after lost signal to thread 32589
I20260709 12:13:38.430382  1209 raft_consensus.cc:740] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.447103  1209 consensus_queue.cc:260] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.433852  1218 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.448436  1209 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.448529  1214 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.433683   818 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.437863 32529 leader_election.cc:304] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.376713  1215 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.441582 32631 raft_consensus.cc:1240] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:38.450858  1241 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.451426  1215 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.447355  1234 consensus_queue.cc:1059] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.454916  1234 raft_consensus.cc:3055] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.455324  1234 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.456446  1234 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.452004  1228 raft_consensus.cc:2749] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.459216  1234 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.445222  1217 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.433619  1210 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.453548 32529 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.465369   818 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.460049  1244 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.472961   818 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.474570  1218 raft_consensus.cc:2804] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.474242   818 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.471451  1233 raft_consensus.cc:2749] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.475533  1214 consensus_queue.cc:1059] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:38.480139 32634 raft_consensus.cc:2468] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:38.471484  1228 raft_consensus.cc:2749] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.474980  1218 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:38.482998  1218 raft_consensus.cc:3060] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.484349  1240 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.482139 32603 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:38.487269 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 100047us
I20260709 12:13:38.487460 32485 raft_consensus.cc:1275] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:38.487831 32632 raft_consensus.cc:1240] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.488364  1215 raft_consensus.cc:2749] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:13:38.489677 32660 debug-util.cc:398] Leaking SignalData structure 0x7b08002414c0 after lost signal to thread 32663
W20260709 12:13:38.491236 32660 debug-util.cc:398] Leaking SignalData structure 0x7b080021a800 after lost signal to thread 1039
I20260709 12:13:38.492137   988 raft_consensus.cc:515] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.491040  1228 consensus_queue.cc:1048] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.493234  1227 raft_consensus.cc:2749] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:38.493896 32602 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.494473  1005 raft_consensus.cc:2468] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:38.496500  1214 raft_consensus.cc:3055] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.496942  1214 raft_consensus.cc:740] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:38.492826   818 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.500474 32603 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.501814 32603 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.502223 32635 raft_consensus.cc:2468] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:38.497768  1214 consensus_queue.cc:260] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.504187  1212 raft_consensus.cc:2749] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.504437  1214 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.502465  1242 raft_consensus.cc:2749] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.505126  1232 raft_consensus.cc:2749] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.505961  1237 raft_consensus.cc:2749] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.507974   818 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.501842 32562 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.509420   818 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:38.475134 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 88745.8us
I20260709 12:13:38.510210 32603 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.504458  1240 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.514473  1233 raft_consensus.cc:2749] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.515259  1215 raft_consensus.cc:2749] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.516813  1232 raft_consensus.cc:2749] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.517421  1192 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.518062  1242 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.515354  1216 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.521581   988 leader_election.cc:290] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.522980  1005 raft_consensus.cc:1240] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.528506   818 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.529443  1242 raft_consensus.cc:2749] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.511760  1224 raft_consensus.cc:2749] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.532532  1218 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.536164 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.537546 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.538667 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.541625 32491 raft_consensus.cc:3055] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:38.542481 32531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.543346 32565 raft_consensus.cc:1240] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:38.541954 32491 raft_consensus.cc:740] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.545300 32603 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.550027 32603 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.552167 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.556097 32483 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.553676 32562 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.559561 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.520277  1216 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.562681 32603 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.566114 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.569772  1210 consensus_queue.cc:1059] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:38.575171   988 raft_consensus.cc:1240] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.575840 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.576361  1221 consensus_queue.cc:1059] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:38.575953  1241 raft_consensus.cc:3055] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.577473  1221 raft_consensus.cc:3055] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.577946  1241 raft_consensus.cc:740] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.578095  1221 raft_consensus.cc:740] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.579135  1241 consensus_queue.cc:260] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.579133  1221 consensus_queue.cc:260] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.579728   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:38.580569  1221 raft_consensus.cc:3060] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.580693  1241 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.581434   985 raft_consensus.cc:1240] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.582502 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.586898   987 raft_consensus.cc:1240] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.588224  1192 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.569543  1209 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.593524 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.594517   818 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
W20260709 12:13:38.596019 32457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.577370 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.567101 32491 consensus_queue.cc:260] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.601035 32491 raft_consensus.cc:3060] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.602742 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.551872  1232 raft_consensus.cc:2749] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.608067 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:38.596714   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 141572us
I20260709 12:13:38.610577 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.605019  1209 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.611860  1243 leader_election.cc:290] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:38.613071   816 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.613664  1218 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.613966  1233 raft_consensus.cc:2749] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.605438  1244 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:38.606706  1240 raft_consensus.cc:2749] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.615442   816 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.618366 32483 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:38.620293 32530 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:38.620513 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9a0efab86054946bbce18dc6e29c467" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.620671 32603 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.621173 32564 raft_consensus.cc:3060] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.621769   818 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.622149 32603 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.625005 32491 raft_consensus.cc:2468] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:38.625895 32489 raft_consensus.cc:1240] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.628597  1227 raft_consensus.cc:2749] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.628062  1192 raft_consensus.cc:2749] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.630446  1240 raft_consensus.cc:2804] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:38.630384 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:38.631949  1240 raft_consensus.cc:697] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:38.632911  1240 consensus_queue.cc:237] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.635179 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.635932 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.636088 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.625432  1207 raft_consensus.cc:2749] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.638592 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.639626   816 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.641058   816 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.641398  1244 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.649317  1244 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.649145 32632 raft_consensus.cc:2468] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
W20260709 12:13:38.642846   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 100947us
I20260709 12:13:38.626578  1237 raft_consensus.cc:2804] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:38.650617  1237 raft_consensus.cc:697] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.651731  1237 consensus_queue.cc:237] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.656942 32529 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.658123  1229 raft_consensus.cc:2749] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.658497 32529 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.659353   816 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.659906  1253 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:38.660782   816 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:38.661165 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.662295 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.663228 32634 raft_consensus.cc:2393] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 2: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:38.663548 32529 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.661278  1192 raft_consensus.cc:2749] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.666816 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:38.668094  1003 raft_consensus.cc:1275] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:38.668478  1003 pending_rounds.cc:85] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Aborting all ops after (but not including) 1
I20260709 12:13:38.668717  1003 pending_rounds.cc:107] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:38.669026  1003 raft_consensus.cc:2889] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:38.668855   816 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.627694 32603 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.660682  1227 consensus_queue.cc:1059] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:38.664014  1228 consensus_queue.cc:1059] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:38.666617  1245 raft_consensus.cc:2804] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.679448  1227 raft_consensus.cc:3055] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.679797  1245 raft_consensus.cc:697] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:38.679901  1227 raft_consensus.cc:740] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.680795  1245 consensus_queue.cc:237] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.666555  1226 consensus_queue.cc:1059] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:38.670864  1001 raft_consensus.cc:1240] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.673192   817 leader_election.cc:304] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:38.683894  1244 raft_consensus.cc:2804] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.675810 32564 raft_consensus.cc:2468] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
W20260709 12:13:38.685305 32454 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.685599 32565 raft_consensus.cc:1240] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:38.672451 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 44848.4us
I20260709 12:13:38.677546  1215 raft_consensus.cc:2749] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.677670  1213 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.680876  1227 consensus_queue.cc:260] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.665012 32529 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.670758   816 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.686885 32490 raft_consensus.cc:2468] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:38.687718 32603 leader_election.cc:304] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.678623  1209 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.692095 32603 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.692142  1209 raft_consensus.cc:2749] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.692878  1232 raft_consensus.cc:2749] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.693310  1228 raft_consensus.cc:3055] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.693778  1228 raft_consensus.cc:740] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.694337 32603 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.695111  1232 raft_consensus.cc:2749] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.694778  1228 consensus_queue.cc:260] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.696471  1228 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.682816  1224 raft_consensus.cc:3055] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.684988  1244 raft_consensus.cc:697] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:38.699520   817 leader_election.cc:304] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:38.696447 32603 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.698498  1252 consensus_queue.cc:1048] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:38.702086  1242 raft_consensus.cc:2749] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.702673  1244 consensus_queue.cc:237] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.704607  1215 raft_consensus.cc:2804] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:38.705163  1215 raft_consensus.cc:697] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:38.707497  1229 raft_consensus.cc:2749] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.706044  1215 consensus_queue.cc:237] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.706231  1217 consensus_queue.cc:1059] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:38.708874  1217 raft_consensus.cc:3055] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.709285  1217 raft_consensus.cc:740] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.710489  1217 consensus_queue.cc:260] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.712822 32603 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:38.716809  1227 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.717036 32455 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.699764  1224 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.727375  1224 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.718569 32455 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.729947  1241 raft_consensus.cc:2749] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.730551 32455 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.731352  1241 raft_consensus.cc:2749] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.731797 32455 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.717296  1209 raft_consensus.cc:2804] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:38.732584  1241 raft_consensus.cc:2749] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.732853  1209 raft_consensus.cc:697] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.725528  1003 raft_consensus.cc:1240] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.733821  1209 consensus_queue.cc:237] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:38.726399  1250 raft_consensus.cc:2749] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.713841  1232 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.711722  1217 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:38.730588 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 65616.7us
I20260709 12:13:38.739310  1229 consensus_queue.cc:1059] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:38.740770  1253 raft_consensus.cc:3055] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.741206  1253 raft_consensus.cc:740] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.742066  1253 consensus_queue.cc:260] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.751345 32455 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.752964 32455 leader_election.cc:304] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.757387 32631 raft_consensus.cc:1275] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:38.761686  1241 raft_consensus.cc:2749] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.756188 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:38.765569 32455 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.767792 32455 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.775703 32455 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.756529  1213 raft_consensus.cc:2749] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.786795  1260 consensus_queue.cc:1059] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:38.757952  1250 raft_consensus.cc:2749] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.764899  1207 consensus_queue.cc:1059] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:13:38.778137 32455 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.765347  1224 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.792479 32455 leader_election.cc:304] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.795674 32455 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:38.777694  1241 raft_consensus.cc:2749] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.758591  1226 consensus_queue.cc:1059] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:13:38.779249  1252 raft_consensus.cc:2749] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.780607  1221 raft_consensus.cc:2749] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:38.811160 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 45485.1us
I20260709 12:13:38.811921 32457 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:38.798797  1210 raft_consensus.cc:2749] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.794970  1225 raft_consensus.cc:2749] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.835475  1253 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:38.838805 32456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.839491 32456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.841542  1251 raft_consensus.cc:2749] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.810508  1250 raft_consensus.cc:2749] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.857806  1226 raft_consensus.cc:3055] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:38.858457  1226 raft_consensus.cc:740] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.859390  1226 consensus_queue.cc:260] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.860814  1226 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.843534  1241 consensus_queue.cc:1059] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:38.870908  1250 raft_consensus.cc:3055] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.871357  1250 raft_consensus.cc:740] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:38.872208  1250 consensus_queue.cc:260] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:38.907583 32313 catalog_manager.cc:5697] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 2 to 3, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 3 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.927310 32632 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:38.928359  1212 raft_consensus.cc:3055] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.928972  1212 raft_consensus.cc:740] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.931955  1267 raft_consensus.cc:3055] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:38.932451  1267 raft_consensus.cc:740] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:38.933429  1267 consensus_queue.cc:260] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:38.950800  1267 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.944073  1212 consensus_queue.cc:260] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.978418  1212 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.934410 32311 catalog_manager.cc:5697] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 3, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.979436  1001 raft_consensus.cc:1240] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:38.985462  1207 consensus_queue.cc:1059] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:38.986886  1207 raft_consensus.cc:3055] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:38.987290  1207 raft_consensus.cc:740] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:38.988183  1207 consensus_queue.cc:260] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:38.989701  1207 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:38.995841 32456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:38.998874  1250 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:39.002844 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 190947us
W20260709 12:13:39.008147 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 196481us
I20260709 12:13:39.012490 32311 catalog_manager.cc:5697] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.028797 32529 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:39.049106 32529 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.050237 32529 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.050678  1273 raft_consensus.cc:2804] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.051174  1273 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:39.051529  1273 raft_consensus.cc:3060] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.051442 32529 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:39.053181 32529 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.053917  1226 raft_consensus.cc:2749] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:39.036990 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 213909us
I20260709 12:13:39.013115 32455 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.055784  1265 raft_consensus.cc:2804] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.056322  1265 raft_consensus.cc:697] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:39.056524 32455 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:39.057237  1265 consensus_queue.cc:237] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:39.058172  1260 consensus_queue.cc:1048] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.059126  1250 raft_consensus.cc:2749] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.059814  1252 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.054673  1264 raft_consensus.cc:2804] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.063452  1264 raft_consensus.cc:697] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:39.064623  1264 consensus_queue.cc:237] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:39.059840  1250 consensus_queue.cc:1059] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:13:39.054703  1226 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.068188  1241 raft_consensus.cc:3055] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.068629  1241 raft_consensus.cc:740] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:39.068331 32311 catalog_manager.cc:5697] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.069475  1241 consensus_queue.cc:260] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.070096 32311 catalog_manager.cc:5697] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.078914   985 raft_consensus.cc:1240] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.079479   987 raft_consensus.cc:1240] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.084124 32313 catalog_manager.cc:5697] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 2 to 3, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.115366 32457 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.085866  1241 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.120891  1275 consensus_queue.cc:1059] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:39.124331  1275 raft_consensus.cc:3055] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.124473  1226 raft_consensus.cc:2749] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.124720  1275 raft_consensus.cc:740] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:39.126371 32564 raft_consensus.cc:1240] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.118829  1229 consensus_queue.cc:1059] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:39.119279  1250 raft_consensus.cc:2749] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.130367 32490 raft_consensus.cc:1275] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:39.133805 32455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.125666  1275 consensus_queue.cc:260] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:39.145697  1267 raft_consensus.cc:3055] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.146309 32560 raft_consensus.cc:1275] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.146401  1267 raft_consensus.cc:740] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:39.147738  1267 consensus_queue.cc:260] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:39.149056  1275 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.149156  1267 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.165477  1252 raft_consensus.cc:2749] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.173558  1245 consensus_queue.cc:1048] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:39.176666  1273 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.181180 32564 raft_consensus.cc:1240] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.186774 32564 raft_consensus.cc:3060] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.187420 32489 raft_consensus.cc:1240] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.207346 32560 raft_consensus.cc:1275] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.228646 32560 raft_consensus.cc:1275] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:39.226145  1229 consensus_queue.cc:1059] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:13:39.237854 32631 raft_consensus.cc:1275] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:39.204411  1242 consensus_queue.cc:1048] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:39.241688 32564 raft_consensus.cc:1275] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.245395  1233 consensus_queue.cc:1048] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.215551  1215 consensus_queue.cc:1048] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:13:39.247776  1210 consensus_queue.cc:1048] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:39.252862  1251 consensus_queue.cc:1059] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:39.255157  1251 raft_consensus.cc:3055] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.255544  1251 raft_consensus.cc:740] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:39.259008 32485 raft_consensus.cc:1275] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:39.260751  1264 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:39.256501  1251 consensus_queue.cc:260] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.268422 32490 raft_consensus.cc:3060] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.261626 32313 catalog_manager.cc:5697] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.272164 32313 catalog_manager.cc:5697] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 2 to 3, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.280323 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:39.267153  1265 raft_consensus.cc:3055] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.292156 32490 raft_consensus.cc:1275] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:39.283030  1268 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 12:13:39.295612  1277 log.cc:927] Time spent T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:39.297828  1273 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:39.285984  1265 raft_consensus.cc:740] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:39.301471  1265 consensus_queue.cc:260] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:39.303087  1265 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.311717 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:39.318790 32489 raft_consensus.cc:1275] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.314273  1232 consensus_queue.cc:1048] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:39.327138  1251 raft_consensus.cc:3060] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.324592  1233 consensus_queue.cc:1048] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:13:39.361256 32632 raft_consensus.cc:1275] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.331039  1215 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:39.363642  1215 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:39.365806  1215 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:39.336544   987 raft_consensus.cc:1275] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:39.375388  1218 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:39.377667  1218 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:39.379052 32482 raft_consensus.cc:1275] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.380092  1218 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:39.400336 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:39.398537  1209 consensus_queue.cc:1048] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:13:39.401540  1215 consensus_queue.cc:1048] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:13:39.435401 32636 raft_consensus.cc:1275] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:39.440713 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:39.442196 32632 raft_consensus.cc:2393] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 3: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:39.454654 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:39.455699 32482 raft_consensus.cc:2393] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 2: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:39.448143  1233 consensus_queue.cc:1048] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:13:39.469137 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:39.485675 32313 catalog_manager.cc:5697] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 2 to 3, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 3 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.490636  1270 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.491473  1270 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:39.495560 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:39.484884 32632 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:39.499311   816 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:39.500049  1242 consensus_queue.cc:1048] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:39.501447   816 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:39.501518  1242 raft_consensus.cc:3060] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.518967 32491 raft_consensus.cc:2468] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:39.527547  1268 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.546594   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:39.529016  1270 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:39.542587 32530 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
W20260709 12:13:39.580627   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 79313.1us
I20260709 12:13:39.541214  1244 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.599845  1244 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:39.600344  1244 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.604892   987 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:39.612730 32632 raft_consensus.cc:1275] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:39.596259 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 44862us
W20260709 12:13:39.621273 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 78796.4us
I20260709 12:13:39.622818 32455 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:39.622077  1267 consensus_queue.cc:1048] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:13:39.628502  1264 raft_consensus.cc:2804] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.634549  1251 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.595043  1268 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.657146  1264 raft_consensus.cc:697] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:39.667228  1264 consensus_queue.cc:237] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.653940  1251 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.670569  1251 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.677538  1242 raft_consensus.cc:2749] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.678617   985 raft_consensus.cc:1275] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:39.680087  1003 raft_consensus.cc:1275] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.694176  1265 consensus_queue.cc:1048] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:39.695927  1228 consensus_queue.cc:1048] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:39.731032 32630 raft_consensus.cc:1275] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:39.732677  1228 consensus_queue.cc:1048] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:39.749277  1244 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:39.751813  1268 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:39.752837 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:39.753227 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:39.754014 32634 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:39.756335 32529 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:39.772958 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:39.822808  1244 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:39.824699 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:39.825901 32483 raft_consensus.cc:2393] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 2: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:39.797916  1252 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:39.826763  1252 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:39.829093  1252 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:39.795624  1215 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.830343  1215 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:39.832623  1215 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:39.794670  1265 raft_consensus.cc:2804] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.833361  1265 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.833740  1265 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.840673 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:39.844274 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:39.846446 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:39.842186 32561 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:39.850212 32457 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:39.845063 32483 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:39.855388   817 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:39.856438 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:39.856530  1250 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.857415  1250 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:39.857832  1250 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.860225   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:39.861140   985 raft_consensus.cc:2393] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 2: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:39.865232  1244 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.865693  1244 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.866017  1244 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.877280 32561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:39.879251 32561 raft_consensus.cc:606] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.879846 32561 raft_consensus.cc:614] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:39.884413 32313 catalog_manager.cc:5697] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 2, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.888238 32561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:39.890689 32561 raft_consensus.cc:606] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:39.895460 32560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:39.896322 32560 raft_consensus.cc:606] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.896724 32560 raft_consensus.cc:614] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:39.898110 32634 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:39.900014   816 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:39.905897 32561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:39.907128 32561 raft_consensus.cc:606] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:39.907823 32561 raft_consensus.cc:614] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:39.911222  1292 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.911957  1292 raft_consensus.cc:697] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:39.912235 32561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:39.913265 32561 raft_consensus.cc:606] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:39.914143  1292 consensus_queue.cc:237] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:39.916306 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:39.919078 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:39.919209  1226 raft_consensus.cc:993] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:39.919788  1264 raft_consensus.cc:1081] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Signalling peer 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:39.920872 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:39.923453 32634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:52284
I20260709 12:13:39.924158 32634 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.924556 32634 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.914158  1244 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:39.930780 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
W20260709 12:13:39.934475  1302 log.cc:927] Time spent T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:13:39.936266  1300 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.936836  1300 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.937852  1244 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:39.942610  1226 raft_consensus.cc:993] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:39.943209  1264 raft_consensus.cc:1081] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Signalling peer 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:39.944878 32631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:52284
I20260709 12:13:39.945416 32631 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.945775 32631 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.947096  1300 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:39.948724 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:39.949451 32560 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:39.950856 32605 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:39.953346 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:39.954087 32483 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:39.955523 32631 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.960845 32634 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:39.963127  1232 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.963536 32631 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:39.963644  1232 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.964082  1232 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.965194  1264 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.965739  1264 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:39.968048  1264 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:39.969926   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:39.971019   985 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:39.973078 32529 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:39.975927  1264 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.976473  1264 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.976895  1264 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.787613  1251 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:39.981367 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:39.982347 32487 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.991479 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:39.992460 32482 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.995628  1226 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.996580  1226 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:39.997387  1228 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.997910  1228 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.000692  1228 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.002779  1226 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.007269 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.008963   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.009791 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:40.009922   985 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:40.010926 32483 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.015455 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.017849   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.018013  1264 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.018631   985 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.021622  1264 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:40.022547   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:40.023250   985 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.035465 32487 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:40.037452 32529 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:40.040432  1226 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.040869  1226 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.041229  1226 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.041340 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:40.042059 32490 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.044963 32529 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:40.045835  1264 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.046357  1264 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.046794  1264 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.047169 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:40.050184  1241 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.051249  1241 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.053176 32490 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.055603  1251 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.058496 32634 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.060343 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:40.126107  1264 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.126811 32560 raft_consensus.cc:3055] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.127157 32560 raft_consensus.cc:740] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:40.127934 32560 consensus_queue.cc:260] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.128371  1264 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.129029 32482 raft_consensus.cc:2468] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 4.
I20260709 12:13:40.062736   985 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.065503 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:40.130247 32561 raft_consensus.cc:3055] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.130611 32561 raft_consensus.cc:740] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:40.131399 32561 consensus_queue.cc:260] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.132623 32561 raft_consensus.cc:3060] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:40.070570 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 78365.8us
I20260709 12:13:40.134830 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:40.137252 32529 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:40.073261 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:40.073944 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:40.139535 32631 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.083761   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:40.094331   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.108867  1265 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.120671  1250 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.124294 32632 raft_consensus.cc:3060] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.163764  1268 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.164465  1268 raft_consensus.cc:697] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:40.129143 32560 raft_consensus.cc:3060] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.054019  1241 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.069630  1226 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.143779 32604 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.150553   817 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:40.139058 32564 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:40.158849 32483 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:40.159796   986 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:40.159982  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:40.170519 32561 raft_consensus.cc:2468] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:40.184993 32605 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:40.186297  1209 raft_consensus.cc:2804] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.183405 32457 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.188624  1308 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.188783  1005 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.189196  1308 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.189733  1308 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:40.156129 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 75013.4us
W20260709 12:13:40.194303   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 43863.8us
I20260709 12:13:40.198079  1244 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.198753  1244 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.202785  1005 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
I20260709 12:13:40.203255  1244 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.205284 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:40.205937  1226 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.206910  1209 raft_consensus.cc:697] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:40.165995   987 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.208761 32529 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:40.209717 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.209815 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:40.210682  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:40.219264  1005 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.200405 32631 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:40.165666  1268 consensus_queue.cc:237] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.218672 32634 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 4.
I20260709 12:13:40.174836  1245 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.223084 32560 raft_consensus.cc:2468] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:40.183215  1251 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.207998  1240 raft_consensus.cc:2804] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.226960 32455 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.250993   816 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:40.253247  1244 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:40.253698  1244 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.254045  1244 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.256286  1252 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.218940  1212 raft_consensus.cc:2804] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.258306  1005 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.260097 32529 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:40.192111  1232 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.227141  1253 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.274144  1264 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.269258  1241 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.231911  1251 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:40.274000  1240 raft_consensus.cc:697] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 4 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:40.234339  1245 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.293715 32483 raft_consensus.cc:1275] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.280422  1313 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.301040 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:40.301716 32482 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.303445  1314 consensus_queue.cc:1048] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:40.282250  1264 raft_consensus.cc:697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:40.284430  1315 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.311733 32482 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.325554 32530 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.333910  1317 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.331923  1226 raft_consensus.cc:2804] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.267446  1209 consensus_queue.cc:237] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.292999  1241 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.356104  1241 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.357409  1250 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.357472 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:40.358381 32560 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:40.360003 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:40.363618 32314 catalog_manager.cc:5697] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 2, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.365727 32632 raft_consensus.cc:1275] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.329047  1315 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.367422  1264 consensus_queue.cc:237] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.368497  1315 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.368889  1265 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:40.315338  1313 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.341756  1317 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.446657 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:40.428308 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.464478 32491 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.465058 32634 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:40.356379  1251 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.400360  1283 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.372377  1212 raft_consensus.cc:697] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:40.468119 32455 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.482218 32491 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
W20260709 12:13:40.482614 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 165559us
I20260709 12:13:40.382490  1226 raft_consensus.cc:697] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:40.486953 32604 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.371526  1252 raft_consensus.cc:697] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:40.406571   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.461356  1315 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.493202  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:40.460556  1253 raft_consensus.cc:697] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:40.467018  1232 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.501677  1001 raft_consensus.cc:2393] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 2: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:40.475660  1314 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:40.446121  1267 consensus_queue.cc:1048] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:13:40.461843  1308 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.493685  1241 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.509914  1316 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.531540   986 raft_consensus.cc:2368] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3.
I20260709 12:13:40.519591  1232 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.381407  1240 consensus_queue.cc:237] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.526957  1241 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.505856  1315 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.526240  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.551754  1007 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:40.520385   987 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:40.533696  1228 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.539362   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.486778  1283 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.539499  1321 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.514736  1314 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.569291 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:40.576906 32564 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.548740  1241 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.567684 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:40.561975  1232 raft_consensus.cc:697] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:40.584995  1232 consensus_queue.cc:237] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.587035  1313 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.542295  1252 consensus_queue.cc:237] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:40.590353  1321 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.570675  1265 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:40.603204  1265 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:40.632191 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 107125us
I20260709 12:13:40.541718  1212 consensus_queue.cc:237] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.539808  1316 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.548318  1226 consensus_queue.cc:237] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.562508  1228 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.619733  1319 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.634280   988 raft_consensus.cc:2393] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 2: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:40.654716 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:40.657476 32560 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:40.624274  1283 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:40.627637  1330 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.558667  1253 consensus_queue.cc:237] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.676626 32564 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:40.679494 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:40.680946 32631 raft_consensus.cc:3060] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.677258  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:40.683845 32457 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
W20260709 12:13:40.688560 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 201724us
I20260709 12:13:40.681777  1001 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.696367 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.697165 32635 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:40.699487  1210 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.708714  1210 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.709136  1210 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.712464 32603 leader_election.cc:400] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3.
I20260709 12:13:40.712898 32603 leader_election.cc:403] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:40.672086  1301 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.714968 32631 raft_consensus.cc:2468] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:40.728261  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:40.729318  1005 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.659687  1244 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.786278  1268 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.787272  1268 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.790657  1268 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.658110  1319 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.737164  1317 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:40.801062 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 102046us
I20260709 12:13:40.801607  1005 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:40.685784  1330 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:40.733614  1301 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.805408  1308 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.838955  1240 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.841074  1292 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.839078  1242 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.870538 32491 raft_consensus.cc:1275] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.847980  1315 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.842762 32556 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:40.875911 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.848869  1265 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.910079  1314 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.916253  1330 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.918903  1244 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.919165  1245 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:40.922454 32631 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:40.895403  1240 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:40.901361  1325 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.951988  1241 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:40.953015  1325 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:40.955000  1241 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.904696  1322 consensus_queue.cc:1048] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:40.907186  1328 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:40.956668  1328 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:40.909000  1316 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.858134  1336 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.964324  1240 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.965512  1321 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.943456 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:40.947566 32634 raft_consensus.cc:1275] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.951882 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:40.966202 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.966370 32636 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.967938 32639 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:40.967252 32487 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:40.972198  1228 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.981063 32604 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.995211 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:40.996322 32556 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:40.997319  1301 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:40.899175  1292 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.000185  1292 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:40.966667 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:41.001060 32491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:41.001237 32485 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:41.002885   817 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:40.966655  1325 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:41.003377  1228 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.004032  1335 log.cc:927] Time spent T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.140s	user 0.001s	sys 0.003s
I20260709 12:13:40.899448  1242 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.004050  1228 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.006762  1242 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.007447  1242 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.007853  1242 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.008162 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:41.008447  1228 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:41.008985 32483 raft_consensus.cc:2393] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 2: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:41.013033 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:40.990703 32636 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 5.
I20260709 12:13:41.021471 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:41.013839 32635 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:41.029505   816 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.032212 32455 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:41.035413 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:41.036553 32564 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:41.037673  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.008225  1242 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.038659  1001 raft_consensus.cc:2368] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:41.038599  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.039359  1005 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:41.030961   816 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.044157  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.044853  1001 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 2.
I20260709 12:13:41.045349  1270 raft_consensus.cc:2804] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.045810 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.046548 32556 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:41.047379  1325 raft_consensus.cc:2804] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.047708  1347 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:41.047793  1325 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.048230  1347 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.048328  1325 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.048656  1347 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:41.048564  1270 raft_consensus.cc:697] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:41.050448  1270 consensus_queue.cc:237] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.051949  1336 raft_consensus.cc:2749] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3.
I20260709 12:13:41.054483  1005 raft_consensus.cc:1275] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.995816  1328 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.057545  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.041821 32529 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.076704 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.077755 32560 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:41.067020   816 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:40.916402  1319 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:41.108180 32529 leader_election.cc:400] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:41.108764 32529 leader_election.cc:403] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:41.109766 32529 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.110939 32529 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.082196   816 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.120043 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.121047 32561 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:41.124923 32564 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 5.
I20260709 12:13:41.045821   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.066278  1250 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.148413 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.151317 32560 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:41.081276  1228 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.156822  1333 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.157874  1350 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.158772 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.105427  1003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.161648  1250 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.117228  1240 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:41.137184  1267 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.138011  1313 raft_consensus.cc:2804] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.105687  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:41.081838  1210 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.126430  1268 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:41.152877  1265 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:13:41.053769  1233 consensus_queue.cc:1048] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:13:41.195106 32490 raft_consensus.cc:1275] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:13:41.184471 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 488132us
I20260709 12:13:41.181030  1228 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.193989   818 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:41.185500  1333 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.203104 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.202761 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.204069 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.186476  1350 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.208304 32565 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:41.187115  1313 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.211475 32491 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:41.212275   818 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:41.188050 32556 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:41.192754  1007 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.228108  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.207618  1228 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.209623  1333 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.229830 32605 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:41.237042  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.209329  1311 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.295847  1311 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.296380  1311 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.218600 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.241411 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:41.298331 32635 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:41.241993 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:41.299275 32636 raft_consensus.cc:3060] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.242663  1210 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.218528 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.300482 32455 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:41.301179 32558 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:41.246861 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:41.246641  1327 consensus_queue.cc:1048] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:13:41.249868 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:41.305495 32314 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41836 (request call id 76) took 1057 ms. Trace:
I20260709 12:13:41.218780  1313 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.255432 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:41.306401  1309 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.306911  1309 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:41.307478  1309 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.259141  1250 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.229372  1244 raft_consensus.cc:2804] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.309417  1244 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:41.309852  1244 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.226052  1267 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.311105  1267 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.311477   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.312541   985 raft_consensus.cc:2393] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 3: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:41.262238 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:41.315860 32631 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:41.265784 32487 raft_consensus.cc:1275] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.215615  1350 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.276549 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:41.335621 32634 raft_consensus.cc:2368] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:41.277704   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.277787   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:41.278168   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.286454  1316 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:41.292152 32457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.055s	sys 0.058s
W20260709 12:13:41.357414 32457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.056s	sys 0.058s
I20260709 12:13:41.292321 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.209630  1240 raft_consensus.cc:697] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:41.306759 32632 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 1.
I20260709 12:13:41.258435 32491 raft_consensus.cc:1275] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:41.381014 32605 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:41.341854 32529 leader_election.cc:400] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207) with higher term. Message: Invalid argument: T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:41.345468 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:41.357861 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 668615us
I20260709 12:13:41.371254 32636 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:41.391258 32457 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:41.392367 32457 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:41.305881 32314 rpcz_store.cc:276] 0709 12:13:40.248551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.274975 (+ 26424us) service_pool.cc:224] Handling call
0709 12:13:41.305425 (+1030450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:40.403445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:40.502003 (+ 98558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:40.505232 (+  3229us) write_op.cc:435] Acquired schema lock
0709 12:13:40.505252 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:40.543543 (+ 38291us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:40.547933 (+  4390us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:40.550585 (+  2652us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:40.571975 (+ 21390us) tablet.cc:701] Row locks acquired
0709 12:13:40.576192 (+  4217us) write_op.cc:260] PREPARE: finished
0709 12:13:40.591085 (+ 14893us) write_op.cc:270] Start()
0709 12:13:40.591286 (+   201us) write_op.cc:276] Timestamp: P: 1783599220591005 usec, L: 0
0709 12:13:40.591313 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:13:40.592217 (+   904us) log.cc:844] Serialized 543 byte log entry
0709 12:13:41.011278 (+419061us) op_driver.cc:464] REPLICATION: finished
0709 12:13:41.300030 (+288752us) write_op.cc:301] APPLY: starting
0709 12:13:41.300136 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:41.300250 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:41.300377 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:41.300601 (+   224us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:41.300774 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:41.300818 (+    44us) write_op.cc:312] APPLY: finished
0709 12:13:41.301031 (+   213us) log.cc:844] Serialized 22 byte log entry
0709 12:13:41.301249 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:41.301348 (+    99us) write_op.cc:454] Released schema lock
0709 12:13:41.301395 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:41.301782 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:41.301810 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":288429,"apply.run_cpu_time_us":1754,"apply.run_wall_time_us":1753,"num_ops":1,"prepare.queue_time_us":287,"prepare.run_cpu_time_us":4772,"prepare.run_wall_time_us":193201,"replication_time_us":385304,"thread_start_us":184679,"threads_started":1}]]}
I20260709 12:13:41.396453  1252 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:41.396965  1252 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.397289  1252 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:41.391036 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 49440.7us
I20260709 12:13:41.392849 32455 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:41.394840  1240 consensus_queue.cc:237] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:41.402899   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 190705us
I20260709 12:13:41.380026  1316 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.440157  1316 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.404091   988 raft_consensus.cc:2368] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4.
I20260709 12:13:41.444197  1318 raft_consensus.cc:2804] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.446652  1209 consensus_queue.cc:1048] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:41.447468  1347 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:41.443135 32314 catalog_manager.cc:5697] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.451015  1267 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:41.455641  1267 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:41.456365 32637 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 5: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:41.462634 32603 leader_election.cc:400] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4.
I20260709 12:13:41.463066 32603 leader_election.cc:403] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:41.429661 32310 catalog_manager.cc:5697] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.434227 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:41.436728  1242 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.424234  1251 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.478060  1001 raft_consensus.cc:1275] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.438596 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:41.479750 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:41.439473 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:41.400051 32313 catalog_manager.cc:5697] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 2 to 3, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 3 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.481904 32560 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
W20260709 12:13:41.516065 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 53601.1us
W20260709 12:13:41.515537 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 90724.2us
W20260709 12:13:41.519735 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 48577.7us
I20260709 12:13:41.469640  1318 raft_consensus.cc:697] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:41.522661 32636 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.527166 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:41.534830 32635 raft_consensus.cc:1275] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.553707 32638 raft_consensus.cc:3060] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.536227 32562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:41.554476 32562 raft_consensus.cc:606] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
W20260709 12:13:41.533849 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 49403.4us
I20260709 12:13:41.524988 32561 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:41.483002 32559 raft_consensus.cc:3060] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.527385 32558 raft_consensus.cc:1275] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.577664 32489 raft_consensus.cc:1275] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.547257  1252 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:41.580727  1252 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:41.582639  1311 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.584652 32556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:41.585456 32556 raft_consensus.cc:606] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:41.586823 32638 raft_consensus.cc:2468] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:41.589119 32556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:41.594722 32556 raft_consensus.cc:606] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:41.595311 32556 raft_consensus.cc:614] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:41.598301 32488 raft_consensus.cc:1275] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.598330 32556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:41.599189 32556 raft_consensus.cc:606] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:41.603811  1250 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:41.604465  1250 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.605674  1321 consensus_queue.cc:1048] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.607121  1343 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:13:41.561395   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:41.534595  1346 consensus_queue.cc:1048] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:13:41.610126  1242 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.534163  1251 raft_consensus.cc:697] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:41.611356 32565 raft_consensus.cc:1275] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:41.527275  1347 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.589006 32490 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 5: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:41.618078  1311 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:41.620538  1357 log.cc:927] Time spent T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:13:41.622359   987 raft_consensus.cc:2368] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3.
I20260709 12:13:41.628360 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:41.645892 32636 raft_consensus.cc:1275] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.650621 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:41.586714  1309 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:41.678284 32638 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 5: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:41.655577 32457 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
W20260709 12:13:41.665426 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 73655.9us
W20260709 12:13:41.681777 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 70631us
I20260709 12:13:41.657313  1319 raft_consensus.cc:2749] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.689129 32565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:41.694473 32565 raft_consensus.cc:3060] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:41.695377 32560 raft_consensus.cc:3060] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.696049 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:41.696941 32562 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.686919 32457 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:41.661453  1007 raft_consensus.cc:2468] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:41.683142  1356 raft_consensus.cc:2749] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4.
I20260709 12:13:41.585500  1318 consensus_queue.cc:237] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:41.741084 32560 raft_consensus.cc:1275] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.735893 32565 raft_consensus.cc:2468] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 5.
I20260709 12:13:41.765069 32562 raft_consensus.cc:2468] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:41.693352 32485 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.721939 32529 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:41.773352 32638 raft_consensus.cc:1275] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.666131  1313 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:41.791247  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:41.799615  1002 raft_consensus.cc:1275] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:41.809132 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:41.837518 32490 raft_consensus.cc:1275] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:41.695524  1228 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:41.775897  1210 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.692407  1323 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
W20260709 12:13:41.874128 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 188966us
I20260709 12:13:41.713515  1253 consensus_queue.cc:1048] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:13:41.789692  1250 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:41.722322  1241 raft_consensus.cc:2804] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.687459  1336 consensus_queue.cc:1048] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 12:13:41.875118  1322 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.835558  1273 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.876762 32558 raft_consensus.cc:1275] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:41.875522  1325 consensus_meta.cc:287] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.005s
I20260709 12:13:41.896922  1329 raft_consensus.cc:2804] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.914561  1241 raft_consensus.cc:493] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.835548 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:41.985174   818 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:41.997387 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 275537us
I20260709 12:13:41.873731  1210 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:42.036114   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 51088us
W20260709 12:13:41.965843 32366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 47348.6us
I20260709 12:13:41.797293  1251 consensus_queue.cc:237] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:41.875890  1350 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.041642 32557 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.040848  1333 consensus_meta.cc:287] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.000s
I20260709 12:13:42.006825  1241 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.996536  1264 consensus_queue.cc:1048] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:13:41.994052  1322 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.116593 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.118814 32561 raft_consensus.cc:2393] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 5: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
W20260709 12:13:42.067348  1316 consensus_meta.cc:287] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.000s
I20260709 12:13:42.045884 32563 raft_consensus.cc:2368] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4.
I20260709 12:13:42.048163  1007 raft_consensus.cc:1275] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:42.038681  1329 raft_consensus.cc:697] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:42.092026  1005 raft_consensus.cc:2368] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3.
I20260709 12:13:42.083590  1210 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
W20260709 12:13:42.119910  1371 log.cc:927] Time spent T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:13:42.093464  1350 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:42.080893  1368 log.cc:927] Time spent T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:13:42.066603  1362 raft_consensus.cc:2804] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:42.062006  1244 consensus_meta.cc:287] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.002s
W20260709 12:13:42.125357   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 85434.8us
I20260709 12:13:42.004004  1325 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.103739  1242 consensus_queue.cc:1048] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.117s
W20260709 12:13:42.123034 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 87117.4us
W20260709 12:13:42.237582 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 190372us
I20260709 12:13:41.996837  1273 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.128373  1309 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.102473  1333 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.211501  1336 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.224172 32558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:42.128463  1316 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.276022  1316 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:42.236708 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 452727us
I20260709 12:13:42.276926 32639 raft_consensus.cc:2368] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3.
I20260709 12:13:42.278700 32639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52284 (request call id 507) took 1029 ms. Trace:
I20260709 12:13:42.279125 32639 rpcz_store.cc:276] 0709 12:13:41.249489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.249623 (+   134us) service_pool.cc:224] Handling call
0709 12:13:42.278426 (+1028803us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54005bac54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:42.278599 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235141504}
I20260709 12:13:42.280820  1345 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.281405  1345 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.282874 32558 raft_consensus.cc:606] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Received request to transfer leadership to TS b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:42.286932  1336 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:42.244748  1346 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.261346 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
W20260709 12:13:42.273875  1372 log.cc:927] Time spent T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
W20260709 12:13:42.278776  1366 log.cc:927] Time spent T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:13:42.247295  1313 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.306406 32491 raft_consensus.cc:1240] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.303323 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:42.309495 32631 raft_consensus.cc:3060] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.259222   986 raft_consensus.cc:1275] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:42.300664 32457 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.307147  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:42.265900  1228 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.290099  1336 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:42.304251 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:42.312563  1001 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.308563 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:42.322590 32635 raft_consensus.cc:3060] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.256289  1244 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:42.313436  1331 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:42.313632  1003 raft_consensus.cc:2368] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3.
I20260709 12:13:42.325016 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:42.270692  1309 raft_consensus.cc:493] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:42.311581  1226 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.315344  1377 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:13:42.264302  1362 raft_consensus.cc:697] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:42.300740 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:42.314224   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:42.367039 32483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33232 (request call id 132) took 1024 ms. Trace:
I20260709 12:13:42.367769 32483 rpcz_store.cc:276] 0709 12:13:41.343131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.345855 (+  2724us) service_pool.cc:224] Handling call
0709 12:13:41.346237 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:41.361140 (+ 14903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:41.361175 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:41.361888 (+   713us) log.cc:844] Serialized 52 byte log entry
0709 12:13:41.635942 (+274054us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:41.635987 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:41.636068 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:42.366734 (+730666us) raft_consensus.cc:1685] finished
0709 12:13:42.366768 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:42.366958 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14732,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":159,"thread_start_us":273630,"threads_started":1,"wal-append.queue_time_us":420978}
I20260709 12:13:42.342044  1226 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.371871  1226 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.373185  1311 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:42.373783  1311 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:42.376060  1382 raft_consensus.cc:2804] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:42.376303 32635 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
W20260709 12:13:42.316464 32559 consensus_meta.cc:287] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.003s
I20260709 12:13:42.337435 32633 raft_consensus.cc:2393] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 3: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:42.347467 32557 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:42.348268  1390 consensus_queue.cc:1048] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:42.375819 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.375829  1311 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:42.264043  1343 consensus_queue.cc:1048] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:13:42.326785 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:42.385576 32631 raft_consensus.cc:2468] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:42.377197  1362 consensus_queue.cc:237] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:42.392076 32485 consensus_meta.cc:287] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.002s
I20260709 12:13:42.392472 32485 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:42.310246  1346 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:42.399735   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 105734us
I20260709 12:13:42.382699   983 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:42.339713  1309 raft_consensus.cc:515] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.390514 32632 raft_consensus.cc:1275] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:42.382613 32559 raft_consensus.cc:2468] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:42.408892   988 raft_consensus.cc:2393] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 3: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:42.378700  1345 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.420482  1383 raft_consensus.cc:493] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:42.426676  1322 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.428046  1333 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.428479  1386 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 12:13:42.397440  1270 raft_consensus.cc:2764] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:13:42.429852  1273 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:42.430994  1003 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52080 (request call id 404) took 1394 ms (client timeout 1578 ms). Trace:
I20260709 12:13:42.431416   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:42.414764  1382 raft_consensus.cc:697] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 5 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:42.414180   987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52088 (request call id 559) took 1128 ms. Trace:
I20260709 12:13:42.342958  1331 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.297866  1329 consensus_queue.cc:237] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:42.437665 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 137098us
I20260709 12:13:42.418880  1001 raft_consensus.cc:2468] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
W20260709 12:13:42.448235  1003 rpcz_store.cc:269] 0709 12:13:41.036524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.040523 (+  3999us) service_pool.cc:224] Handling call
0709 12:13:42.430782 (+1390259us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001a0254. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:42.430934 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588709632}
I20260709 12:13:42.459086  1382 consensus_queue.cc:237] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.441057  1325 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.462198  1346 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.452596   987 rpcz_store.cc:276] 0709 12:13:41.275968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.277473 (+  1505us) service_pool.cc:224] Handling call
0709 12:13:42.395118 (+1117645us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54002e2554. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:42.404637 (+  9519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640035968}
I20260709 12:13:42.465152  1331 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.445616 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:42.469550  1309 leader_election.cc:290] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.451602  1345 consensus_queue.cc:1048] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:13:42.472501  1005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52100 (request call id 395) took 1245 ms. Trace:
I20260709 12:13:42.473104  1005 rpcz_store.cc:276] 0709 12:13:41.227540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.227750 (+   210us) service_pool.cc:224] Handling call
0709 12:13:42.472229 (+1244479us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54007120d4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:42.472421 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984054144}
I20260709 12:13:42.498397 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.488689  1333 consensus_queue.cc:1059] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:13:42.499500   817 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:42.483083  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:42.509492 32455 leader_election.cc:400] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3.
I20260709 12:13:42.512559 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.515084  1267 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:13:42.440498  1383 raft_consensus.cc:515] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.518157 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.517848 32529 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:42.521965 32631 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:42.520074  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:42.522624 32529 leader_election.cc:400] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3.
I20260709 12:13:42.502087 32563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56750 (request call id 777) took 1298 ms. Trace:
I20260709 12:13:42.522974 32529 leader_election.cc:403] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.526614 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.527323 32561 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:42.527611  1386 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.528447 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.530699  1344 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:42.531338  1344 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.536610 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.538539 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79e5da2812114608bc846e1630ec618e" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.538539 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:42.541529 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.541894 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:42.542865 32635 raft_consensus.cc:2393] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 3: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:42.543998 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.545441 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.519802  1322 raft_consensus.cc:3055] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:42.523234  1325 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.549633 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.524920  1268 raft_consensus.cc:2804] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:42.564874 32457 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.562542 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:42.559957 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.568964 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.535388 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:42.549670  1322 raft_consensus.cc:740] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:42.571161 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.576027 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.536391  1244 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:42.559975  1007 raft_consensus.cc:2393] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 3: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:42.573822 32457 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:42.573964  1331 consensus_queue.cc:1048] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:42.585593 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.585853  1395 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:42.565476 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.532763  1273 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:13:42.588152 32561 raft_consensus.cc:2393] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 3: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:42.590842 32457 leader_election.cc:304] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.587785 32605 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:42.576493  1345 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.587954  1325 raft_consensus.cc:697] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:42.586488  1395 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.621099  1325 consensus_queue.cc:237] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:42.621688 32557 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:42.623045  1344 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.623934  1395 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.603000  1309 raft_consensus.cc:2749] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.626375  1345 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.626847  1345 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.627653 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2b7dc13dad9450593f677a27d195620" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.632611 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.523530 32563 rpcz_store.cc:276] 0709 12:13:41.204018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.206218 (+  2200us) service_pool.cc:224] Handling call
0709 12:13:41.292154 (+ 85936us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b58003e3d98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36e9c 00007fbdafc36a5b 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:13:42.501821 (+1209667us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400401854. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:42.501992 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262194816}
I20260709 12:13:42.609609  1268 raft_consensus.cc:697] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:42.652598 32605 leader_election.cc:400] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379) with higher term. Message: Invalid argument: T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4.
I20260709 12:13:42.653178 32605 leader_election.cc:403] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:42.656194  1241 consensus_meta.cc:287] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.007s
I20260709 12:13:42.656822  1241 raft_consensus.cc:515] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:42.658408  1353 raft_consensus.cc:2749] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.658761 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.659047  1228 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:42.660056  1396 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.659850  1228 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.660988 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.661321 32603 leader_election.cc:400] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3.
I20260709 12:13:42.661701 32603 leader_election.cc:403] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.662823 32603 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:42.659898  1401 log.cc:927] Time spent T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:13:42.671092  1353 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 2. Current term is 3.
I20260709 12:13:42.672734  1228 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.688709 32529 leader_election.cc:400] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207) with higher term. Message: Invalid argument: T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3.
I20260709 12:13:42.673178  1328 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379) with higher term. Message: Invalid argument: T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4.
I20260709 12:13:42.676584  1331 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.682552  1215 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:13:42.701548  1268 consensus_queue.cc:237] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.704598  1386 raft_consensus.cc:2749] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497) with higher term. Message: Invalid argument: T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 2. Current term is 3.
I20260709 12:13:42.687049 32489 raft_consensus.cc:2368] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3.
I20260709 12:13:42.697840 32561 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:42.642990  1322 consensus_queue.cc:260] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:42.706168  1346 raft_consensus.cc:493] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:42.726083 32529 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:42.729421 32562 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
W20260709 12:13:42.733696  1411 log.cc:927] Time spent T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:42.739447  1002 raft_consensus.cc:1240] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:42.742432  1267 raft_consensus.cc:2804] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.746798 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.748273 32529 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:42.713951  1324 raft_consensus.cc:493] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:42.760885   816 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.761678 32529 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:42.762665 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:42.764581 32457 leader_election.cc:304] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.768013 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.774914   816 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:42.771037  1267 raft_consensus.cc:697] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:42.780324  1267 consensus_queue.cc:237] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.783540 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.783855   816 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:42.789712   816 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.766927  1395 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.797178  1333 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.797873  1333 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.798249  1333 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.770092  1386 raft_consensus.cc:2749] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:42.804340 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:42.805678 32631 raft_consensus.cc:2393] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 3: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:42.806325  1241 leader_election.cc:290] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:42.782116  1324 raft_consensus.cc:515] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:42.810894  1324 leader_election.cc:290] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:42.811120  1416 raft_consensus.cc:993] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:42.811714  1416 raft_consensus.cc:1081] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Signalling peer 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:42.788043  1362 raft_consensus.cc:2749] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:42.768589  1322 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.816394 32634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:52284
I20260709 12:13:42.831521 32634 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:42.832062 32634 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.767407  1318 raft_consensus.cc:2749] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:42.833489   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 43791.7us
I20260709 12:13:42.844234   816 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:42.757982  1346 raft_consensus.cc:515] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.861907 32634 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.871515 32634 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.839672  1292 raft_consensus.cc:2749] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:42.864183 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 98398.3us
I20260709 12:13:42.886581 32457 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:42.890094 32314 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34456 (request call id 154) took 1444 ms. Trace:
I20260709 12:13:42.878751  1264 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.890786 32314 rpcz_store.cc:276] 0709 12:13:41.430633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.434128 (+  3495us) service_pool.cc:224] Handling call
0709 12:13:42.875130 (+1441002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:41.782909 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.058520 (+275611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.061562 (+  3042us) write_op.cc:435] Acquired schema lock
0709 12:13:42.066965 (+  5403us) tablet.cc:662] Decoding operations
0709 12:13:42.227773 (+160808us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.237914 (+ 10141us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.241090 (+  3176us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:42.267683 (+ 26593us) tablet.cc:701] Row locks acquired
0709 12:13:42.267712 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:13:42.308175 (+ 40463us) write_op.cc:270] Start()
0709 12:13:42.316323 (+  8148us) write_op.cc:276] Timestamp: P: 1783599222304918 usec, L: 0
0709 12:13:42.318434 (+  2111us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.436473 (+118039us) log.cc:844] Serialized 543 byte log entry
0709 12:13:42.644979 (+208506us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.733618 (+ 88639us) write_op.cc:301] APPLY: starting
0709 12:13:42.733720 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.733862 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.734046 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.734371 (+   325us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.734553 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:42.734601 (+    48us) write_op.cc:312] APPLY: finished
0709 12:13:42.734821 (+   220us) log.cc:844] Serialized 22 byte log entry
0709 12:13:42.735024 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.735112 (+    88us) write_op.cc:454] Released schema lock
0709 12:13:42.735159 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.735567 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.735615 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":88359,"apply.run_cpu_time_us":1938,"apply.run_wall_time_us":1937,"num_ops":1,"prepare.queue_time_us":259264,"prepare.run_cpu_time_us":27208,"prepare.run_wall_time_us":822124,"raft.queue_time_us":72884,"raft.run_cpu_time_us":24663,"raft.run_wall_time_us":56064,"replication_time_us":318647,"thread_start_us":392384,"threads_started":4,"wal-append.queue_time_us":132066}]]}
I20260709 12:13:42.880180  1391 raft_consensus.cc:2749] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.897351 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe193066934411da2b11565c9080849" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:42.897879  1245 raft_consensus.cc:493] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:42.911335  1292 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
W20260709 12:13:42.926129  1422 log.cc:927] Time spent T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 12:13:42.950726  1265 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:42.952307 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:42.953088 32560 raft_consensus.cc:3055] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:42.953547 32560 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:42.954442 32560 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.955780 32560 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.958842  1316 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.958611  1245 raft_consensus.cc:515] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:42.961683  1316 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.963637  1245 leader_election.cc:290] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:42.964629  1345 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.966392 32490 raft_consensus.cc:1240] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:42.964056  1316 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.959983  1292 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:42.968041  1424 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:42.969429  1292 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:42.970621  1383 leader_election.cc:290] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.919732  1264 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:42.951416  1265 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:42.976796  1264 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:42.950827 32486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59918 (request call id 510) took 1356 ms. Trace:
I20260709 12:13:42.977682 32486 rpcz_store.cc:276] 0709 12:13:41.593901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.637586 (+ 43685us) service_pool.cc:224] Handling call
0709 12:13:42.888493 (+1250907us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b58000d3b98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:13:42.950730 (+ 62237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7647616}
I20260709 12:13:42.979930 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.983793   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:42.985173   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:42.986816 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:42.990787  1346 leader_election.cc:290] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.991415 32530 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:42.977183  1265 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:42.998153 32560 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:43.008880 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:42.955267  1416 raft_consensus.cc:493] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:43.012791  1312 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:43.013653  1312 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:43.014946   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.015234  1362 raft_consensus.cc:493] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:43.015934  1362 raft_consensus.cc:515] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.016360   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:42.991446  1346 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:43.003690  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.022106 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.021543 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6017d03fcc5c4811bf6139c2858334c1" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:43.023479  1380 raft_consensus.cc:2749] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.025854  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.026249 32560 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.030743 32637 raft_consensus.cc:1240] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.032100 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.032231 32604 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.032793 32634 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 5.
I20260709 12:13:43.041529   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.035122  1312 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:43.057519 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.057842 32560 raft_consensus.cc:2468] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:43.043352  1331 raft_consensus.cc:2749] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.021049  1416 raft_consensus.cc:515] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:43.070495 32529 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:43.071480   986 raft_consensus.cc:1275] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:43.071728  1416 leader_election.cc:290] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.072640 32457 leader_election.cc:304] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:43.073431  1416 raft_consensus.cc:2749] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.066326 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b2b95e9684decb8a771394db66391" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.076306 32529 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:43.051826  1345 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.081779 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:43.080431 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.063405  1398 raft_consensus.cc:2749] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:43.082850   983 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52088 (request call id 560) took 1806 ms (client timeout 2088 ms). Trace:
W20260709 12:13:43.083305   983 rpcz_store.cc:269] 0709 12:13:41.276298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.277876 (+  1578us) service_pool.cc:224] Handling call
0709 12:13:43.082679 (+1804803us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001f1dd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5f2fa 00007fbdb7d20b17 00007fbdb129b6d4 00007fbdb129b662 00007fbdb129b591 00007fbdb129b50c 00007fbdb129a7c2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:43.082787 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323454720}
I20260709 12:13:43.055706 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.085721  1333 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.088160  1333 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.081406  1331 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:43.089193 32558 raft_consensus.cc:1275] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:43.089747  1331 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.081570  1250 raft_consensus.cc:2804] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.034520  1346 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:43.092484 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:43.092890 32562 raft_consensus.cc:1240] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:43.096593 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:43.100798 32560 raft_consensus.cc:2393] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 4: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:43.057670  1362 leader_election.cc:290] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.107892   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:43.122319   987 raft_consensus.cc:2393] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 4: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
W20260709 12:13:43.123092  1429 log.cc:927] Time spent T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:13:43.124485  1331 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:43.129647  1311 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:43.108310  1250 raft_consensus.cc:697] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:43.132705   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.150401 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.156010 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.141345  1363 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:43.161652  1363 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.141376  1321 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:43.143010  1311 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.196005  1311 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:43.196679  1250 consensus_queue.cc:237] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.200848  1356 raft_consensus.cc:493] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:43.201475  1356 raft_consensus.cc:515] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:43.172907  1382 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:43.203770  1356 leader_election.cc:290] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:43.203797  1382 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:43.205834  1346 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.207690  1382 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.208531   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.211498 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.212128  1356 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:43.212678  1356 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:43.209457  1363 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:43.214146 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.188913  1321 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.216400   988 raft_consensus.cc:2468] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 3.
I20260709 12:13:43.216624  1321 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:43.218372 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d282ad4f6b644e9c8c6690342f7c3844" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.219339 32487 raft_consensus.cc:2393] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 3: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:43.221431 32604 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.222023   817 leader_election.cc:304] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.223356  1321 raft_consensus.cc:3060] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.224208  1363 raft_consensus.cc:2749] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.225919   817 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.228191  1311 raft_consensus.cc:2749] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.229365 32484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59918 (request call id 512) took 1634 ms. Trace:
I20260709 12:13:43.229897 32484 rpcz_store.cc:276] 0709 12:13:41.594678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.643154 (+ 48476us) service_pool.cc:224] Handling call
0709 12:13:42.981519 (+1338365us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b58000d3b98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:42.981803 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.982108 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:42.982472 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 12:13:43.061398 (+ 78926us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003ba820. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc50e07 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b 00007fbdb28fad23 00007fbdb28fb23a 00007fbdb2d65a2a
0709 12:13:43.228921 (+167523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:43.229002 (+    81us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:43.229062 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.229135 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:43.229279 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":252,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":15936,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7940,"spinlock_wait_cycles":37938304,"thread_start_us":90367,"threads_started":1,"wal-append.queue_time_us":136398}
I20260709 12:13:43.235843 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.237483  1398 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:43.237967 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.265470  1328 consensus_queue.cc:1059] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:43.266964  1389 raft_consensus.cc:3055] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.267335  1389 raft_consensus.cc:740] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:43.267458 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.267783 32605 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:43.268201  1389 consensus_queue.cc:260] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:43.269307  1316 consensus_queue.cc:1175] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "22a81a2a176240d78cb878810a3d56b5" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 3 index: 2 } }
I20260709 12:13:43.269404 32605 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:43.269593  1389 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.274503 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.275058 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.277230  1209 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.277860  1209 raft_consensus.cc:697] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:43.279171  1316 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.279716  1316 raft_consensus.cc:697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:43.280783  1316 consensus_queue.cc:237] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.284916 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:43.286985 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91b8d6a020d469ba3542974ba93b7a6" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.288233 32638 raft_consensus.cc:1275] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:43.268177 32490 raft_consensus.cc:2468] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:43.290563 32604 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:43.298710  1382 consensus_queue.cc:1059] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:43.299024  1353 raft_consensus.cc:2804] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:43.299674  1353 raft_consensus.cc:493] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:43.300089  1353 raft_consensus.cc:3060] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.278831  1209 consensus_queue.cc:237] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.300994  1398 raft_consensus.cc:493] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:43.301471  1398 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:43.303207  1356 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:43.308012 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.321455  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.309463  1283 raft_consensus.cc:493] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:43.324741  1283 raft_consensus.cc:515] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.326676 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.328235 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.330042 32605 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:43.334824 32605 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:43.349960 32455 leader_election.cc:304] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.355963 32605 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:43.362030   817 leader_election.cc:400] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Vote denied by peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389) with higher term. Message: Invalid argument: T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3.
I20260709 12:13:43.362670   817 leader_election.cc:403] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:43.367539 32558 raft_consensus.cc:1240] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:13:43.365770  1363 raft_consensus.cc:3060] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.365739  1331 raft_consensus.cc:2749] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.366003  1345 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:13:43.373107 32557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.348070  1356 raft_consensus.cc:2749] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:43.353919  1312 raft_consensus.cc:2749] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.363591  1390 raft_consensus.cc:2749] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.361479 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:43.361799  1321 raft_consensus.cc:2749] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.393570 32455 leader_election.cc:304] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.399737  1393 consensus_queue.cc:1059] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:43.400219  1283 leader_election.cc:290] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:43.400342 32631 raft_consensus.cc:1275] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:43.405479 32489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.408885  1393 consensus_queue.cc:1243] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer 51f23763442f4ea3a702c32e00616cb0 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:43.411219 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.412097 32310 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34468 (request call id 144) took 2304 ms. Trace:
I20260709 12:13:43.413333  1390 consensus_queue.cc:1059] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:43.414091  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.415144  1001 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52100 (request call id 404) took 1034 ms. Trace:
I20260709 12:13:43.415668  1001 rpcz_store.cc:276] 0709 12:13:42.381228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.456058 (+ 74830us) service_pool.cc:224] Handling call
0709 12:13:43.413893 (+957835us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800004598. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:13:43.415082 (+  1189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45755264}
I20260709 12:13:43.419322 32603 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.420913  1316 raft_consensus.cc:2749] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.402704  1318 raft_consensus.cc:2804] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.395510  1348 consensus_queue.cc:1048] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:13:43.412493 32310 rpcz_store.cc:276] 0709 12:13:41.106100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.106624 (+   524us) service_pool.cc:224] Handling call
0709 12:13:41.329042 (+222418us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b5400909cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:13:43.410199 (+2081157us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:42.586629 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.675890 (+ 89261us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.677696 (+  1806us) write_op.cc:435] Acquired schema lock
0709 12:13:42.677716 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:42.715487 (+ 37771us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.720098 (+  4611us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.720963 (+   865us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:42.763014 (+ 42051us) tablet.cc:701] Row locks acquired
0709 12:13:42.763043 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:13:42.787538 (+ 24495us) write_op.cc:270] Start()
0709 12:13:42.813855 (+ 26317us) write_op.cc:276] Timestamp: P: 1783599222784878 usec, L: 0
0709 12:13:42.831597 (+ 17742us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.919750 (+ 88153us) log.cc:844] Serialized 543 byte log entry
0709 12:13:42.989237 (+ 69487us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.989717 (+   480us) write_op.cc:301] APPLY: starting
0709 12:13:42.989804 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.989921 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.990028 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.990553 (+   525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.990747 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:42.990800 (+    53us) write_op.cc:312] APPLY: finished
0709 12:13:42.991036 (+   236us) log.cc:844] Serialized 22 byte log entry
0709 12:13:42.991373 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.991470 (+    97us) write_op.cc:454] Released schema lock
0709 12:13:42.991516 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.991945 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.991976 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":145948416,"child_traces":[["op",{"apply.queue_time_us":283,"apply.run_cpu_time_us":2092,"apply.run_wall_time_us":2185,"num_ops":1,"prepare.queue_time_us":1081860,"prepare.run_cpu_time_us":5246,"prepare.run_wall_time_us":368164,"replication_time_us":153817}]]}
I20260709 12:13:43.426895  1228 raft_consensus.cc:993] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:43.427675  1228 consensus_queue.cc:1048] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:43.433120  1318 raft_consensus.cc:697] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:43.434468  1318 consensus_queue.cc:237] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:43.429968  1433 raft_consensus.cc:1081] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Signalling peer 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:43.438649  1002 raft_consensus.cc:1275] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:43.445955 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:43.446765 32564 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:43.447679  1363 raft_consensus.cc:2749] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389) with higher term. Message: Invalid argument: T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 for earlier term 2. Current term is 3.
I20260709 12:13:43.449230 32560 raft_consensus.cc:1275] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:13:43.450399 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 53677.9us
I20260709 12:13:43.453958  1002 raft_consensus.cc:1275] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:43.453498 32457 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:43.459642 32632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:43.426033  1251 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.007s	sys 0.024s
I20260709 12:13:43.480151 32638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:52284
I20260709 12:13:43.481261 32638 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:43.481642 32638 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.486428 32632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52296 (request call id 763) took 1013 ms. Trace:
I20260709 12:13:43.486953 32632 rpcz_store.cc:276] 0709 12:13:42.473227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.475787 (+  2560us) service_pool.cc:224] Handling call
0709 12:13:43.454407 (+978620us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800010598. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d210a0 00007fbdb7d20984 00007fbdb129b6d4 00007fbdb129b662
0709 12:13:43.486349 (+ 31942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3537152}
I20260709 12:13:43.489400  1410 consensus_queue.cc:1048] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:43.482643  1251 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.007s	sys 0.025s
I20260709 12:13:43.501410  1382 raft_consensus.cc:3055] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:43.501829  1382 raft_consensus.cc:740] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:43.495821 32455 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.504848   818 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.506196   818 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.509116 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.516553   818 leader_election.cc:304] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.460981  1346 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:43.518675  1346 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:43.537166  1346 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.516346  1325 raft_consensus.cc:2749] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.515374  1283 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.543011  1325 consensus_queue.cc:1048] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:43.490933  1390 consensus_queue.cc:1048] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:13:43.548735  1398 raft_consensus.cc:515] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.550004  1350 raft_consensus.cc:2749] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.551170  1382 consensus_queue.cc:260] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.524610  1375 raft_consensus.cc:2749] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.558758 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.560702 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29f3259972241c7bafe8cef3a1a0acd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.564523 32636 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:43.564889 32530 leader_election.cc:304] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:43.565502 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 49353.7us
I20260709 12:13:43.566386  1380 raft_consensus.cc:2749] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.522119  1434 consensus_queue.cc:1048] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:13:43.560918 32634 raft_consensus.cc:2410] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:43.574831 32636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52864 (request call id 161) took 1060 ms. Trace:
I20260709 12:13:43.575258 32636 rpcz_store.cc:276] 0709 12:13:42.511143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.512138 (+   995us) service_pool.cc:224] Handling call
0709 12:13:43.563961 (+1051823us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b5800010598. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:43.564166 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.570939 (+  6773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.571181 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20972288}
I20260709 12:13:43.577390 32530 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.580143 32530 leader_election.cc:304] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.576261  1416 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:43.580084  1427 log.cc:927] Time spent T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:13:43.586704 32556 raft_consensus.cc:1275] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:43.586450  1416 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.587435 32556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56764 (request call id 842) took 1061 ms. Trace:
I20260709 12:13:43.581211  1324 raft_consensus.cc:2749] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.587812 32556 rpcz_store.cc:276] 0709 12:13:42.525855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.540722 (+ 14867us) service_pool.cc:224] Handling call
0709 12:13:43.586088 (+1045366us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b58003e3d98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36eee 000000000036eb39 00007fbdb7caa1e0 00007fbdb7d730c4 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:43.586274 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:43.587144 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.587350 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7723904}
I20260709 12:13:43.588858  1416 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:43.598404 32632 raft_consensus.cc:1275] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:43.598697 32638 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.615348 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:43.616108 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:43.645452 32638 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:43.649609 32632 raft_consensus.cc:1240] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:43.600055  1382 raft_consensus.cc:3060] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.607669  1416 raft_consensus.cc:2749] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.604009  1375 consensus_queue.cc:1048] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:13:43.681763  1268 raft_consensus.cc:993] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower b2729a5e5b834a958c61bb5487a0c22c to start an election
I20260709 12:13:43.669196  1387 consensus_queue.cc:1048] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:13:43.689633   986 raft_consensus.cc:1275] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:43.671802   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:43.711860 32561 raft_consensus.cc:3055] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:43.712525 32561 raft_consensus.cc:740] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:43.713429 32561 consensus_queue.cc:260] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:43.716168   985 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.718420  1267 raft_consensus.cc:1081] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Signalling peer b2729a5e5b834a958c61bb5487a0c22c to start an election
I20260709 12:13:43.723035 32483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
 from {username='slave'} at 127.0.0.1:59918
I20260709 12:13:43.725239 32483 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:43.725718 32483 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:43.729924   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 205629us
I20260709 12:13:43.734107   818 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.734962  1353 raft_consensus.cc:515] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:43.755921 32637 raft_consensus.cc:2393] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 2: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:43.757027  1353 leader_election.cc:290] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:43.759302   818 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.726109  1398 leader_election.cc:290] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 6 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:43.761412   818 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.708103  1318 consensus_queue.cc:1048] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:13:43.774497 32483 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.762598  1242 raft_consensus.cc:2749] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.759557  1322 raft_consensus.cc:2749] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.779120 32313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34474 (request call id 139) took 2565 ms. Trace:
I20260709 12:13:43.777823   985 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5.
I20260709 12:13:43.783389  1344 raft_consensus.cc:2749] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.805411   818 leader_election.cc:304] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:43.779546 32313 rpcz_store.cc:276] 0709 12:13:41.233429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.287052 (+ 53623us) service_pool.cc:224] Handling call
0709 12:13:43.779055 (+2492003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:42.982866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.983429 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.983494 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:13:42.983515 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:42.983889 (+   374us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.983939 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.983967 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:42.984239 (+   272us) tablet.cc:701] Row locks acquired
0709 12:13:42.984266 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:13:42.984476 (+   210us) write_op.cc:270] Start()
0709 12:13:42.984633 (+   157us) write_op.cc:276] Timestamp: P: 1783599222984401 usec, L: 0
0709 12:13:42.984672 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.985568 (+   896us) log.cc:844] Serialized 543 byte log entry
0709 12:13:42.992408 (+  6840us) op_driver.cc:464] REPLICATION: finished
0709 12:13:43.007665 (+ 15257us) write_op.cc:301] APPLY: starting
0709 12:13:43.009123 (+  1458us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:43.020289 (+ 11166us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:43.040896 (+ 20607us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:43.210155 (+169259us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5c00450b0c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8f4d331 00007fbdb8f4d221 00007fbdb8f47f6c 00007fbdb66a830b 00007fbdb66a7fd3 00007fbdb67a6e34 00007fbdb679297c 00007fbdb6796d61 00007fbdb6796d19 00007fbdb6796ca9 00007fbdb6796c71
0709 12:13:43.210404 (+   249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:43.210595 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:43.210638 (+    43us) write_op.cc:312] APPLY: finished
0709 12:13:43.210841 (+   203us) log.cc:844] Serialized 22 byte log entry
0709 12:13:43.215011 (+  4170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.215104 (+    93us) write_op.cc:454] Released schema lock
0709 12:13:43.215148 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:43.215658 (+   510us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:43.215691 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194557,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":8372,"apply.run_cpu_time_us":5057,"apply.run_wall_time_us":208897,"num_ops":1,"prepare.queue_time_us":1482675,"prepare.run_cpu_time_us":3048,"prepare.run_wall_time_us":3047,"replication_time_us":7596,"spinlock_wait_cycles":6798592}]]}
I20260709 12:13:43.810277  1005 raft_consensus.cc:1240] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:43.803493 32311 catalog_manager.cc:5697] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.814821 32311 catalog_manager.cc:5697] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 3 to 5, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 5 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.824536 32483 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:43.824966 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:43.825810 32482 raft_consensus.cc:3060] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:43.820483  1452 log.cc:927] Time spent T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
W20260709 12:13:43.849002   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 43690.5us
I20260709 12:13:43.848157 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:43.853333 32556 raft_consensus.cc:3055] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.853706 32556 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:43.855770 32556 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.856835 32556 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.858448  1389 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:43.859287   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:43.860293   985 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.859213  1389 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:43.868738  1389 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:43.869378 32561 raft_consensus.cc:3060] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.870167 32556 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:43.874536  1346 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:43.875514 32457 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:43.877118  1346 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:43.878746  1242 raft_consensus.cc:2749] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.885741 32603 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:43.907945  1001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:43.909173  1002 raft_consensus.cc:1275] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:43.911618 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:43.915045   986 raft_consensus.cc:1275] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:43.905145  1373 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.917210 32455 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.917763  1373 raft_consensus.cc:697] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:43.918890  1348 raft_consensus.cc:2749] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.918768  1373 consensus_queue.cc:237] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.920980 32564 raft_consensus.cc:1275] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:43.927688   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 77903us
W20260709 12:13:43.921991 32530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.932765 32561 raft_consensus.cc:2468] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5.
I20260709 12:13:43.912587  1316 raft_consensus.cc:2804] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:43.938597  1348 consensus_queue.cc:1048] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:43.918892 32455 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:43.959084 32482 raft_consensus.cc:2468] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:43.892676  1363 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:13:43.988709 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
W20260709 12:13:43.990442 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 71637.3us
I20260709 12:13:43.994597  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
W20260709 12:13:43.994827   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 80437.5us
I20260709 12:13:44.002545 32639 raft_consensus.cc:1240] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.003729 32637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d77a8828de54acbb915f5d831758a82" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:44.004395 32637 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:44.012400  1398 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.013162  1398 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:43.995833  1316 raft_consensus.cc:697] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:44.015549  1398 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:44.015468  1316 consensus_queue.cc:237] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:44.032505  1457 log.cc:927] Time spent T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:13:44.034047   988 raft_consensus.cc:1275] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:44.038779 32487 raft_consensus.cc:1240] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.039582  1005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52080 (request call id 429) took 1196 ms. Trace:
I20260709 12:13:44.040131  1005 rpcz_store.cc:276] 0709 12:13:42.842816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.072934 (+230118us) service_pool.cc:224] Handling call
0709 12:13:43.783613 (+710679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.813702 (+ 30089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.039327 (+225625us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400813dd0. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:44.039506 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633562496}
W20260709 12:13:44.055572 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 197599us
I20260709 12:13:43.992652  1356 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:44.081023 32637 raft_consensus.cc:2468] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 6.
I20260709 12:13:44.067358 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e414e6422547db852244112d5dd011" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:44.044243  1270 raft_consensus.cc:2749] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.094148 32529 leader_election.cc:304] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:44.090099  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:44.088287 32604 leader_election.cc:304] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:44.101594  1434 raft_consensus.cc:2804] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:44.102463  1434 raft_consensus.cc:697] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 6 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:44.103782  1434 consensus_queue.cc:237] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
W20260709 12:13:44.096984 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 77270.4us
I20260709 12:13:44.114531  1273 consensus_queue.cc:1048] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:44.068157  1374 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:44.152536  1232 consensus_queue.cc:1048] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:44.090421  1356 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:44.129741  1328 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:13:44.164474  1321 raft_consensus.cc:2804] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.164865 32485 raft_consensus.cc:1275] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:44.165063  1321 raft_consensus.cc:697] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:44.165328 32485 pending_rounds.cc:85] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: Aborting all ops after (but not including) 1
I20260709 12:13:44.165617 32485 pending_rounds.cc:107] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:44.165868 32485 raft_consensus.cc:2889] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:44.166069  1321 consensus_queue.cc:237] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:44.091382  1398 consensus_queue.cc:1059] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 12:13:44.169732  1374 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:44.245111 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 116289us
W20260709 12:13:44.253475 32530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.243077  1465 raft_consensus.cc:493] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.277731 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 189560us
I20260709 12:13:44.250377 32559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:44.283455 32559 raft_consensus.cc:1275] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:44.295171 32635 raft_consensus.cc:1275] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:44.306079 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 194004us
I20260709 12:13:44.307132 32455 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:44.229419  1380 consensus_queue.cc:1059] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:13:44.285095  1476 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:44.317668   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 216937us
I20260709 12:13:44.322937 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:44.323659 32482 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 3.
I20260709 12:13:44.268349  1465 raft_consensus.cc:515] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:44.310923   985 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:44.335110  1005 raft_consensus.cc:1240] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:44.332566 32530 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:44.332856 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:44.343297 32490 raft_consensus.cc:2393] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 4: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:44.344630 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f9e9a08efa4169b31414570a994868" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:44.358942 32491 raft_consensus.cc:1240] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:44.365389  1471 log.cc:927] Time spent T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:13:44.378841 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 56472.7us
W20260709 12:13:44.381078 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 48612.6us
W20260709 12:13:44.468405 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 127273us
I20260709 12:13:44.369699  1265 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.372725  1473 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.373174  1374 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:44.484190 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 104293us
I20260709 12:13:44.475152  1265 raft_consensus.cc:493] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.497234  1265 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:44.497430  1470 log.cc:927] Time spent T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:13:44.503764  1478 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.507879  1474 log.cc:927] Time spent T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:13:44.507688  1478 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:44.508731 32558 raft_consensus.cc:1275] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:44.513105 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:44.515762 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:44.516407 32634 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
I20260709 12:13:44.521364 32630 raft_consensus.cc:1240] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Rejecting Update request from peer 22a81a2a176240d78cb878810a3d56b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.494570  1240 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.510008  1478 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:44.484248  1483 raft_consensus.cc:2749] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.513825 32558 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:44.485021  1473 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:44.550325 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:44.513850  1389 consensus_queue.cc:1048] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:13:44.555298 32605 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:44.568357 32632 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 6 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:44.536170  1333 raft_consensus.cc:493] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:44.542544   985 raft_consensus.cc:1275] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:44.574636  1312 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:44.664461 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 84749.5us
I20260709 12:13:44.563176  1455 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.664620 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 90543.6us
I20260709 12:13:44.537107  1481 consensus_queue.cc:1048] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:13:44.534500  1240 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:44.583062  1312 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.581851  1333 raft_consensus.cc:515] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:44.701987 32530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.677081  1465 leader_election.cc:290] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:44.687997  1312 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:44.718993  1485 log.cc:927] Time spent T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:13:44.720445  1210 consensus_queue.cc:1048] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:44.698175  1232 raft_consensus.cc:493] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:44.708220   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81fcb8b26b8c4216b02b917f1868b9f6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:44.677448  1455 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:44.759959 32560 raft_consensus.cc:1275] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:13:44.736352 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 66803.5us
W20260709 12:13:44.761739 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 67301.9us
I20260709 12:13:44.762959  1501 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:44.762715 32529 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:44.783797  1240 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:44.786425  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:44.737681  1232 raft_consensus.cc:515] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
W20260709 12:13:44.800812  1453 log.cc:927] Time spent T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.992s	user 0.009s	sys 0.003s
I20260709 12:13:44.799633  1504 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:44.819262 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 65076.7us
I20260709 12:13:44.811851  1473 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:44.799719  1494 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:13:44.835865  1455 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:44.837324 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:44.837517  1333 leader_election.cc:290] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:44.842780 32558 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:44.838610 32638 raft_consensus.cc:1275] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:44.819903  1504 raft_consensus.cc:493] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:44.840018 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:44.841352  1232 leader_election.cc:290] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:44.841549 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:44.834897   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 56173.6us
I20260709 12:13:44.870596  1003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:44.872822 32633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52284 (request call id 549) took 1419 ms. Trace:
I20260709 12:13:44.864059  1504 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.878381 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:44.886585   818 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:44.862973  1265 raft_consensus.cc:515] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:44.893675  1265 leader_election.cc:290] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:44.897732 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:44.898754 32488 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.873337 32633 rpcz_store.cc:276] 0709 12:13:43.453224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.455112 (+  1888us) service_pool.cc:224] Handling call
0709 12:13:43.483308 (+ 28196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.484406 (+  1098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.484458 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.485314 (+   856us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.655554 (+170240us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:43.662215 (+  6661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.668214 (+  5999us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.710886 (+1042672us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdb28f686e 00007fbdb28f5bb6 00007fbdb28f57d8 00007fbdb28ff221 00007fbdb28ff1d9 00007fbdb28ff169
0709 12:13:44.872461 (+161575us) raft_consensus.cc:1685] finished
0709 12:13:44.872486 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.872743 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"spinlock_wait_cycles":9929472,"thread_start_us":125689,"threads_started":1,"wal-append.queue_time_us":323224}
I20260709 12:13:44.926403  1333 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:44.925782  1504 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:44.912740  1312 raft_consensus.cc:515] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:44.978194  1504 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:44.979081  1312 leader_election.cc:290] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:44.928490  1333 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:44.984491 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:44.985431 32561 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.986865 32562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56764 (request call id 865) took 1184 ms. Trace:
I20260709 12:13:44.987311 32562 rpcz_store.cc:276] 0709 12:13:43.802531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.804685 (+  2154us) service_pool.cc:224] Handling call
0709 12:13:43.805058 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.820119 (+ 15061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.820153 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.829936 (+  9783us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.127251 (+297315us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:44.193163 (+ 65912us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.199355 (+  6192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.199475 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.877789 (+678314us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b180020dc40. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e3f3 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:13:44.980260 (+102471us) raft_consensus.cc:1685] finished
0709 12:13:44.986646 (+  6386us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.986802 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5819,"prepare.queue_time_us":65260,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":25855,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":20295,"spinlock_wait_cycles":12934272,"thread_start_us":269435,"threads_started":1,"wal-append.queue_time_us":377883}
I20260709 12:13:44.996248 32561 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5.
I20260709 12:13:44.997525 32605 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:44.998569  1514 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:44.999368  1268 raft_consensus.cc:3055] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.999136  1514 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:44.999785  1268 raft_consensus.cc:740] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:45.001068  1333 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.001433  1514 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.001708  1390 raft_consensus.cc:493] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:45.002279  1333 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.002852 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:45.002794  1333 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.003763 32487 raft_consensus.cc:2393] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 4: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:45.002290  1390 raft_consensus.cc:515] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.000694  1268 consensus_queue.cc:260] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:45.007918  1390 leader_election.cc:290] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:45.008255 32488 raft_consensus.cc:2468] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
I20260709 12:13:45.009496  1501 raft_consensus.cc:2804] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.009763  1268 raft_consensus.cc:3060] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.016578 32636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52284 (request call id 556) took 1027 ms. Trace:
I20260709 12:13:45.016974  1333 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.019964  1337 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:45.009867  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.017270 32636 rpcz_store.cc:276] 0709 12:13:43.988935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.989948 (+  1013us) service_pool.cc:224] Handling call
0709 12:13:45.015560 (+1025612us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5800010598. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:45.015846 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.016134 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.016174 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.016235 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:45.016282 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.016357 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.016497 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50914176}
I20260709 12:13:45.029668 32530 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:45.038937  1504 raft_consensus.cc:2804] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.039577  1504 raft_consensus.cc:697] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:45.040518  1504 consensus_queue.cc:237] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.041499 32485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33232 (request call id 150) took 2226 ms. Trace:
I20260709 12:13:45.042034 32485 rpcz_store.cc:276] 0709 12:13:42.815426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.873701 (+ 58275us) service_pool.cc:224] Handling call
0709 12:13:43.429881 (+556180us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b58000d3b98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:43.430160 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.166440 (+736280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.041178 (+874738us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400473e54. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:13:45.041407 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722685568}
I20260709 12:13:45.021378  1337 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.054473  1270 raft_consensus.cc:493] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:45.047079  1501 raft_consensus.cc:697] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:45.061986  1270 raft_consensus.cc:515] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:45.064297  1501 consensus_queue.cc:237] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:45.069331  1270 leader_election.cc:290] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:45.080251 32634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:45.090942  1462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.003s	sys 0.009s
I20260709 12:13:45.102969  1501 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
W20260709 12:13:45.099807  1462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.003s	sys 0.009s
I20260709 12:13:45.111717  1501 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.116420  1325 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.117913  1501 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:45.119230  1524 log.cc:927] Time spent T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:13:45.146773 32603 leader_election.cc:304] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:45.150600  1501 raft_consensus.cc:2749] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.160679 32482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.172035 32604 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.172569 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.173599 32635 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 1.
I20260709 12:13:45.174628 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.176224 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:45.176878 32487 raft_consensus.cc:3060] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:45.179891  1476 raft_consensus.cc:2749] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.180989 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.182650 32636 raft_consensus.cc:1240] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 6 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:13:45.183598  1232 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.184149  1232 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.185343  1465 consensus_queue.cc:1059] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.186296 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.186784  1476 raft_consensus.cc:3055] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:45.186968 32631 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:45.187247  1476 raft_consensus.cc:740] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:45.188299 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.198997 32561 raft_consensus.cc:1275] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:45.168129  1324 raft_consensus.cc:493] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:45.220189  1476 consensus_queue.cc:260] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:45.194169  1433 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.221340  1433 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.223459  1433 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.215842  1232 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.224751  1232 consensus_queue.cc:1048] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.226471 32561 raft_consensus.cc:1240] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 6 LEADER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:45.223119  1324 raft_consensus.cc:515] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:45.230669 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:45.238246 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 48902.5us
W20260709 12:13:45.250239 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 45662us
I20260709 12:13:45.251796  1324 leader_election.cc:290] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:45.248859  1476 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.229764 32487 raft_consensus.cc:2468] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5.
I20260709 12:13:45.230355  1455 consensus_queue.cc:1059] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 12:13:45.268307 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 56008.9us
I20260709 12:13:45.269878 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.271929  1455 consensus_queue.cc:1243] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer 22a81a2a176240d78cb878810a3d56b5 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:13:45.272537  1455 raft_consensus.cc:3055] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:45.272898  1455 raft_consensus.cc:740] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:45.273873  1455 consensus_queue.cc:260] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:45.276146  1455 raft_consensus.cc:3060] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:45.277473 32486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13de05a5967f4ae1b37b49953488e4e0" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:45.278405 32530 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.293298 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.294374 32484 raft_consensus.cc:1275] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:45.296517   816 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:45.296977 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.297783 32488 raft_consensus.cc:2376] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5. Re-sending same reply.
I20260709 12:13:45.299118  1513 raft_consensus.cc:2804] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:45.299587  1513 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.299964  1513 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.301324  1356 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:45.301512 32604 leader_election.cc:304] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.302389  1356 raft_consensus.cc:2749] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.304844   816 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:45.306417   816 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:45.311828  1322 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.313897  1333 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.315806  1322 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
W20260709 12:13:45.332728 32531 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.313974  1356 consensus_queue.cc:1048] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:13:45.335986  1322 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.338425  1005 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52080 (request call id 448) took 1283 ms. Trace:
I20260709 12:13:45.338888  1005 rpcz_store.cc:276] 0709 12:13:44.055164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.055281 (+   117us) service_pool.cc:224] Handling call
0709 12:13:44.334931 (+279650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.335487 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.338152 (+1002665us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001bb550. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5a8ad 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6 00007fbdb109526f
0709 12:13:45.338333 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642369408}
I20260709 12:13:45.358549  1469 raft_consensus.cc:493] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:45.359257  1469 raft_consensus.cc:515] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.364646  1469 leader_election.cc:290] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:45.365060  1513 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.366466   986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52080 (request call id 441) took 1421 ms. Trace:
I20260709 12:13:45.367512  1513 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.372413 32488 raft_consensus.cc:1240] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.376792 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9e92d778004203bc647bbdae1a3e28" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.377117 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.378167 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.381526  1337 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.384023 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.387266  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.388963 32563 raft_consensus.cc:1240] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Rejecting Update request from peer 51f23763442f4ea3a702c32e00616cb0 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:45.384856  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a8671dc5b3469c99a2ac31a6c25e5c" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.392465 32563 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57010 (request call id 145) took 1460 ms. Trace:
I20260709 12:13:45.392972 32563 rpcz_store.cc:276] 0709 12:13:43.932152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.942633 (+ 10481us) service_pool.cc:224] Handling call
0709 12:13:44.247096 (+304463us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b58003e3d98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36eee 000000000036eb39 00007fbdb7caa1e0 00007fbdb7d730c4 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:45.388591 (+1141495us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b58003e3d98. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36f8c 00007fbdafc36ef6 000000000036eb39 00007fbdb7caa1e0 00007fbdb7d730c4 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:45.388763 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.392091 (+  3328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.392386 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102732928}
I20260709 12:13:45.395594 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:45.397238  1461 raft_consensus.cc:493] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.398092  1461 raft_consensus.cc:515] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.366927   986 rpcz_store.cc:276] 0709 12:13:43.945293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.949375 (+  4082us) service_pool.cc:224] Handling call
0709 12:13:45.270115 (+1320740us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800004598. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafc36b71 00007fbdafc36a22 00007fbdb8b4f8d9 00007fbdb7ca9ee0 00007fbdb7d730ab 00007fbdb7d73131 00007fbdb7d34fc0 00007fbdb7d1f929 00007fbdb7d1f3d2 00007fbdb1296bd4
0709 12:13:45.270686 (+   571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.272052 (+  1366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.272089 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:45.272701 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:13:45.284482 (+ 11781us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:45.287286 (+  2804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.290286 (+  3000us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.365937 (+ 75651us) raft_consensus.cc:1685] finished
0709 12:13:45.366113 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.366392 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":546,"raft.queue_time_us":2359,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":42601216,"thread_start_us":6782,"threads_started":1,"wal-append.queue_time_us":48884}
I20260709 12:13:45.401731  1461 leader_election.cc:290] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.403288 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.405104  1003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83f3ae065257465b93b73378b55d5cda" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.408526   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe1ca85c249841679ee6e347dcf446ea" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.418128   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.419253   985 raft_consensus.cc:2393] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 2: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:45.419059  1363 consensus_queue.cc:1059] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.425629 32603 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.428436 32603 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:45.430194 32603 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.436072 32603 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.420315  1469 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.429901  1539 raft_consensus.cc:2749] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.433153  1362 raft_consensus.cc:493] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.446911  1362 raft_consensus.cc:515] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.449332  1362 leader_election.cc:290] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.454392 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.426218  1363 consensus_queue.cc:1243] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer 22a81a2a176240d78cb878810a3d56b5 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:45.439572  1514 raft_consensus.cc:2749] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.454694 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.457335  1469 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.443005   985 raft_consensus.cc:1275] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:45.465360  1469 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:45.469460   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a593854682354a35bcbf4a59a26baa0f" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:45.473629  1498 raft_consensus.cc:493] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.474767  1334 consensus_queue.cc:1048] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.475258  1498 raft_consensus.cc:515] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.477212  1334 consensus_queue.cc:1059] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:45.477516  1498 leader_election.cc:290] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:45.480713   817 leader_election.cc:304] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.481748  1363 raft_consensus.cc:2749] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.359540 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:45.490319 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7044cb8c255c4809b2a90cfe5ab09f03" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.494038 32490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c944e1e0c34336964f60256dfc70ce" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.496011 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:45.481976 32311 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41836 (request call id 77) took 3497 ms. Trace:
I20260709 12:13:45.501595 32313 catalog_manager.cc:5697] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.507907 32313 catalog_manager.cc:5697] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 2 to 3, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 3 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.509619 32313 catalog_manager.cc:5697] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:45.511368 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15504aa6b6247adba3539950c1023f4" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.512612 32564 raft_consensus.cc:1275] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:45.514788  1395 raft_consensus.cc:493] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:45.515457  1395 raft_consensus.cc:515] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:45.516403  1312 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:45.517189 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.518390  1395 leader_election.cc:290] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:45.519490 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.497845 32311 rpcz_store.cc:276] 0709 12:13:41.985042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.985491 (+   449us) service_pool.cc:224] Handling call
0709 12:13:45.481903 (+3496412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:44.245596 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:44.283255 (+ 37659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:44.283295 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:13:44.283313 (+    18us) tablet.cc:662] Decoding operations
0709 12:13:44.283833 (+   520us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:44.283913 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:44.283953 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:44.284355 (+   402us) tablet.cc:701] Row locks acquired
0709 12:13:44.284375 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:13:44.284531 (+   156us) write_op.cc:270] Start()
0709 12:13:44.284651 (+   120us) write_op.cc:276] Timestamp: P: 1783599224284483 usec, L: 0
0709 12:13:44.284668 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:13:44.285421 (+   753us) log.cc:844] Serialized 930 byte log entry
0709 12:13:45.064884 (+779463us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdafaf6db1 00007fbdafb94c85 00007fbdafb956a2 00007fbdb29071db 00007fbdb2902aaf 00007fbdafc510ac 00007fbdb8aab9a9 00007fbdafc6d69b 00007fbdafc6b93f 00007fbdafc6dc02 00007fbdb28f520b
0709 12:13:45.176651 (+111767us) op_driver.cc:464] REPLICATION: finished
0709 12:13:45.251564 (+ 74913us) write_op.cc:301] APPLY: starting
0709 12:13:45.251667 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:45.251818 (+   151us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:45.251842 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:45.252250 (+   408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:45.252433 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:45.252481 (+    48us) write_op.cc:312] APPLY: finished
0709 12:13:45.252678 (+   197us) log.cc:844] Serialized 28 byte log entry
0709 12:13:45.252849 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:45.252956 (+   107us) write_op.cc:454] Released schema lock
0709 12:13:45.253003 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:45.253357 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:45.253383 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115312,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":74615,"apply.run_cpu_time_us":1807,"apply.run_wall_time_us":1813,"num_ops":2,"prepare.queue_time_us":404458,"prepare.run_cpu_time_us":13554,"prepare.run_wall_time_us":883734,"raft.queue_time_us":64191,"raft.run_cpu_time_us":25564,"raft.run_wall_time_us":66666,"replication_time_us":891814,"spinlock_wait_cycles":29156736,"thread_start_us":1184221,"threads_started":4,"wal-append.queue_time_us":819818}]]}
I20260709 12:13:45.523543 32630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52284 (request call id 571) took 1007 ms. Trace:
I20260709 12:13:45.420838  1322 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.511242 32313 catalog_manager.cc:5697] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:45.514846 32529 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.524027 32630 rpcz_store.cc:276] 0709 12:13:44.515666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.516750 (+  1084us) service_pool.cc:224] Handling call
0709 12:13:44.517134 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.527437 (+ 10303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.523318 (+995881us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b54000c1554. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc4571 00007fbdb2d5be01 00007fbdb2d5a83e 00007fbdb7d1f419 00007fbdb1296bd4 00007fbdb1296b62 00007fbdb1296a91 00007fbdb1296a0c 00007fbdb1295cc2 00007fbdb109648c 00007fbdb10958c6
0709 12:13:45.523479 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9046272}
W20260709 12:13:45.529000 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 93050.5us
I20260709 12:13:45.441491  1476 raft_consensus.cc:2749] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.511744  1512 raft_consensus.cc:493] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.531085 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.531260  1512 raft_consensus.cc:515] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.533838  1512 leader_election.cc:290] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.534946 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.540886 32313 catalog_manager.cc:5697] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 3 to 4, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 4 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } }
I20260709 12:13:45.542951   817 leader_election.cc:304] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.548313 32457 leader_election.cc:304] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:45.551774 32457 leader_election.cc:304] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:45.560642  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742b68eafd5b45f688f8cfcabc3fa421" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.565583   817 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.568336  1002 raft_consensus.cc:2393] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 4: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:45.549021  1461 raft_consensus.cc:2749] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.575784  1240 raft_consensus.cc:3055] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:45.548784  1331 raft_consensus.cc:493] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.576332  1240 raft_consensus.cc:740] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:45.580375 32457 leader_election.cc:304] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:45.549289  1321 raft_consensus.cc:493] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:45.590188 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.590487 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5316a99ba60a464aba3539ee4660a867" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.560484  1210 raft_consensus.cc:2749] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.563740  1375 raft_consensus.cc:2749] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.569579  1334 raft_consensus.cc:2749] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.576687  1331 raft_consensus.cc:515] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:45.571148  1325 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:45.607748 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe7ed2268914c5f801a07f22ed353c6" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:45.608156 32636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb4854351aa4a79bb253ee589d7f204" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:45.606596 32529 leader_election.cc:304] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.565442  1410 consensus_queue.cc:1048] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:13:45.590874  1252 raft_consensus.cc:2749] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:45.590826  1362 raft_consensus.cc:2749] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.636943   818 leader_election.cc:304] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:45.639459 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.623282  1498 raft_consensus.cc:493] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:45.617754  1325 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.643397   818 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.618903  1268 raft_consensus.cc:2749] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.612232  1312 raft_consensus.cc:2749] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.624514   983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b9cf0a93e546baaa54ea1b0262ced2" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.604132  1484 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:13:45.595326  1321 raft_consensus.cc:515] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:45.693641  1344 raft_consensus.cc:2749] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:45.711716  1321 leader_election.cc:290] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:45.712749  1331 leader_election.cc:290] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.592689  1240 consensus_queue.cc:260] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:45.714017  1322 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:45.714548  1240 raft_consensus.cc:3060] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:45.716729   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.717690  1007 raft_consensus.cc:1275] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:45.718657   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47c6ae8960954c14a3cb5f43eddaeab8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.635378  1476 consensus_queue.cc:1048] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:13:45.729204 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:45.704779  1333 raft_consensus.cc:2749] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:45.640965  1498 raft_consensus.cc:515] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:45.723312  1268 raft_consensus.cc:493] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:45.763993  1498 leader_election.cc:290] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:45.771589  1268 raft_consensus.cc:515] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:45.720654   986 raft_consensus.cc:1240] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:45.788548 32564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
W20260709 12:13:45.825989   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 127121us
I20260709 12:13:45.792883  1321 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:45.821398   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ca9ed28fe425ea8235a5d0d8dfe70" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
W20260709 12:13:45.923086  1524 log.cc:927] Time spent T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:13:45.846653  1268 leader_election.cc:290] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:45.941699  1548 log.cc:927] Time spent T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:13:45.787599 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 145643us
W20260709 12:13:45.986240 32530 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 192465us
I20260709 12:13:45.756062 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:45.988960 32529 leader_election.cc:304] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:45.992303 32560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:45.985746 32483 raft_consensus.cc:1275] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:13:45.994225 32563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.026s	sys 0.084s
W20260709 12:13:45.994966 32563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.026s	sys 0.084s
W20260709 12:13:45.998051 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 194029us
I20260709 12:13:46.005810  1210 raft_consensus.cc:493] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:46.007462  1210 raft_consensus.cc:515] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:46.008378   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca74c83e8b4439b6ce7442ee076351" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:45.851153   985 raft_consensus.cc:1275] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:45.922293  1321 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:46.014356  1251 raft_consensus.cc:493] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:46.049813  1251 raft_consensus.cc:515] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:46.051116  1210 leader_election.cc:290] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:46.053588  1251 leader_election.cc:290] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:46.054361  1321 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:46.062333  1268 raft_consensus.cc:2749] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.064293 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
W20260709 12:13:46.065770 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 77618.5us
I20260709 12:13:46.015069  1270 raft_consensus.cc:493] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:46.073298  1270 raft_consensus.cc:515] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:46.013234   987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0377240aa66c46c3ab6d99efb7e3bcd4" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.109155  1001 raft_consensus.cc:1240] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:46.115060 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 48002.7us
I20260709 12:13:46.116572 32529 leader_election.cc:304] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.121935  1270 leader_election.cc:290] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:46.117723  1350 raft_consensus.cc:493] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:46.133509  1268 raft_consensus.cc:2749] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.117733  1396 raft_consensus.cc:493] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
W20260709 12:13:46.159003 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 159289us
I20260709 12:13:46.180029  1002 raft_consensus.cc:1275] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:13:46.180773  1002 pending_rounds.cc:85] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Aborting all ops after (but not including) 1
I20260709 12:13:46.181190  1002 pending_rounds.cc:107] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:13:46.181581  1002 raft_consensus.cc:2889] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:46.194177  1512 raft_consensus.cc:493] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:46.199517  1312 raft_consensus.cc:493] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 22a81a2a176240d78cb878810a3d56b5)
I20260709 12:13:46.200699  1312 raft_consensus.cc:515] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:46.177698  1350 raft_consensus.cc:515] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:46.189567  1396 raft_consensus.cc:515] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:46.205338   986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.207331  1312 leader_election.cc:290] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:46.215037  1333 raft_consensus.cc:493] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:46.216216 32603 leader_election.cc:304] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.216010  1333 raft_consensus.cc:515] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:46.218503  1512 raft_consensus.cc:515] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:46.220260  1515 raft_consensus.cc:2749] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.222612  1512 leader_election.cc:290] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:46.226061 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02b4d51cd3f4b3295717f352f048a01" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.226114  1558 consensus_queue.cc:1048] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:46.227365  1396 leader_election.cc:290] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:46.241375  1556 log.cc:927] Time spent T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: Append to log took a long time: real 0.072s	user 0.004s	sys 0.001s
I20260709 12:13:46.248147 32603 leader_election.cc:304] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.263391  1560 raft_consensus.cc:2749] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.264487  1350 leader_election.cc:290] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:46.265676 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.261505 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.273422 32529 leader_election.cc:304] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.275749  1273 raft_consensus.cc:2749] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.281260  1333 leader_election.cc:290] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:46.282150  1551 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.282213 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.283015  1551 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:46.300467 32483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:46.304165 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:46.309767 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:46.314301 32484 raft_consensus.cc:1275] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:46.286149  1551 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:46.337105 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c938626ada4501bedecbdab942f204" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
W20260709 12:13:46.327885 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 60040us
I20260709 12:13:46.347325  1311 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.349184  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.352126  1396 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:46.350185  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.353164 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6668e0bc0681434bb7a16d07ca609ebd" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.354203  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.370455 32560 raft_consensus.cc:1275] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:46.372454  1311 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
W20260709 12:13:46.377702 32603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 129619us
I20260709 12:13:46.379208 32529 leader_election.cc:304] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.380622  1324 raft_consensus.cc:2749] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.379244 32603 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.387413  1396 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:46.382134   816 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.390499  1513 raft_consensus.cc:2749] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.390434  1396 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:46.391855  1561 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.397403 32603 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.381368 32455 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.404968 32488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
W20260709 12:13:46.412379  1325 consensus_meta.cc:287] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0: Time spent flushing consensus metadata: real 0.712s	user 0.024s	sys 0.004s
I20260709 12:13:46.415151  1325 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:46.416249  1433 consensus_queue.cc:1048] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:46.417449  1544 raft_consensus.cc:2749] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.431061  1311 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:46.408061  1396 raft_consensus.cc:2749] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.438560  1475 consensus_queue.cc:1048] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:46.435039 32455 leader_election.cc:304] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.443647  1461 consensus_queue.cc:1048] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:46.438436  1210 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.458964  1210 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:46.463245   988 raft_consensus.cc:1240] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Rejecting Update request from peer 2a4ac09eaeef4bcca6392c4bc6ea97bb for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:46.463769  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be4cc379dc24cf4aa09e4242241c03f" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.481834   816 leader_election.cc:304] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:46.484905   816 leader_election.cc:304] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:46.486441  1333 raft_consensus.cc:2749] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.487210  1333 raft_consensus.cc:2749] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.439677  1324 consensus_queue.cc:1048] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:13:46.493716 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4aab3c02fcc4c58932074e364ed6a3a" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.494544  1210 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:46.501591 32563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "952141f15b834977950b348862ca5603" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.478672  1396 raft_consensus.cc:2749] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.456380 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.514657   816 leader_election.cc:304] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:46.516840  1395 raft_consensus.cc:2749] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:46.517938  1209 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:46.518952  1568 log.cc:927] Time spent T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:13:46.518751  1209 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:46.523952   818 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.525792  1513 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:46.527055 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 119541us
I20260709 12:13:46.527279 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:46.529268  1325 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:46.529964  1210 consensus_queue.cc:1059] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:46.531590 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.532637 32558 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 1.
I20260709 12:13:46.537307 32605 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:46.534335  1209 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:46.539597  1475 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.540253  1475 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.540750  1475 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.542469 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6938102bc7ee4183b10405f4f5a64ea8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.542717 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c526ec290504c2cb183b2a374401881" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.550174 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.550413  1469 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:46.551241  1210 raft_consensus.cc:3055] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.551738  1210 raft_consensus.cc:740] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:46.552896  1210 consensus_queue.cc:260] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:46.550174 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:46.555502 32485 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 2.
I20260709 12:13:46.561339  1210 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:46.572468 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:46.573889  1561 raft_consensus.cc:2749] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.581626 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.583202   816 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:46.584012 32561 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 1.
I20260709 12:13:46.579547 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17317629dbe497ca572ad72ffb1249f" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:46.597848  1396 consensus_queue.cc:1059] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:46.602878  1005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.592798  1395 raft_consensus.cc:2749] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.605690  1005 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
I20260709 12:13:46.592052  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a112a8d877942bfb7ce438f35b505b4" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.631796 32529 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.636529  1461 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:46.637008  1461 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:46.637382  1461 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:46.645025 32455 leader_election.cc:304] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.651434  1484 raft_consensus.cc:2749] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.655032 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d9e9d432cb84622a564a7fcd6938824" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.667057 32457 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:46.686132 32529 leader_election.cc:304] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.654203  1475 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:46.712308  1250 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:46.715088  1552 raft_consensus.cc:2749] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.719168  1270 raft_consensus.cc:3055] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.719683  1270 raft_consensus.cc:740] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:46.715157  1250 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.734876  1250 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.710876  1007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:46.749363  1270 consensus_queue.cc:260] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:46.794533  1270 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.803807  1475 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:46.806943 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:46.809403  1331 consensus_queue.cc:1059] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:46.811703  1337 raft_consensus.cc:3055] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:46.812115  1337 raft_consensus.cc:740] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:46.809494 32603 leader_election.cc:304] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.818701 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:46.819392 32562 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.821481 32636 raft_consensus.cc:1240] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:46.822454  1209 raft_consensus.cc:2749] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:46.822690 32631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2433debd51544aefbf04917c84186bbd" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.824244 32635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:46.825136 32635 raft_consensus.cc:2393] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 3: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
W20260709 12:13:46.834515 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 43865.2us
I20260709 12:13:46.836033 32529 leader_election.cc:304] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:46.813026  1337 consensus_queue.cc:260] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:46.838945  1268 raft_consensus.cc:2749] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:46.825165 32638 raft_consensus.cc:1240] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:46.839603  1337 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.849403  1250 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:46.857744 32487 raft_consensus.cc:2393] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 3: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:46.862062  1250 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
W20260709 12:13:46.878592 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 170983us
I20260709 12:13:46.881934 32562 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:46.888404 32605 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:46.891767 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:46.892551 32310 catalog_manager.cc:5697] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:46.899746 32457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.900676 32313 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34456 (request call id 155) took 1811 ms. Trace:
I20260709 12:13:46.907397 32630 raft_consensus.cc:2393] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 3: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:46.897050 32310 catalog_manager.cc:5697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 4, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 4 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } }
I20260709 12:13:46.912240 32310 catalog_manager.cc:5697] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:46.916414  1539 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:46.917140  1539 raft_consensus.cc:697] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:46.888968  1461 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:46.922312 32455 leader_election.cc:304] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.938596 32455 leader_election.cc:304] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:46.941582 32455 leader_election.cc:304] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:46.936055 32310 catalog_manager.cc:5697] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.950567  1576 raft_consensus.cc:2749] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.943779  1270 raft_consensus.cc:2749] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:46.939100  1583 raft_consensus.cc:2749] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.941596 32558 raft_consensus.cc:1240] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Rejecting Update request from peer b2729a5e5b834a958c61bb5487a0c22c for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:46.964511  1461 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:46.971314 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:46.972500 32556 raft_consensus.cc:2393] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 3: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:46.975375 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:46.979382 32310 catalog_manager.cc:5697] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:46.948371  1539 consensus_queue.cc:237] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:46.901203 32313 rpcz_store.cc:276] 0709 12:13:45.089395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.089595 (+   200us) service_pool.cc:224] Handling call
0709 12:13:45.332149 (+242554us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b5400909cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:13:46.188943 (+856794us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5400909b28. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb7c84aa1 00007fbdb7cab9b4 00007fbdb678f3dc 00007fbdb6750e0b 00007fbdb6750be4 00007fbdb8c50fa1 00007fbdb8c517ff 00007fbdb8b10a1b 00007fbdb8c1890e 00007fbdb70d92a4 00007fbdb70d9232
0709 12:13:46.900420 (+711477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:46.389202 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:46.390061 (+   859us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:46.390127 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:13:46.390180 (+    53us) tablet.cc:662] Decoding operations
0709 12:13:46.391084 (+   904us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:46.391195 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:46.391236 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:46.427119 (+ 35883us) tablet.cc:701] Row locks acquired
0709 12:13:46.427175 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:13:46.427403 (+   228us) write_op.cc:270] Start()
0709 12:13:46.427643 (+   240us) write_op.cc:276] Timestamp: P: 1783599226427325 usec, L: 0
0709 12:13:46.427689 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:13:46.429009 (+  1320us) log.cc:844] Serialized 2108 byte log entry
0709 12:13:46.666097 (+237088us) op_driver.cc:464] REPLICATION: finished
0709 12:13:46.696667 (+ 30570us) write_op.cc:301] APPLY: starting
0709 12:13:46.696807 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:46.697062 (+   255us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:46.704098 (+  7036us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:46.705100 (+  1002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:46.744485 (+ 39385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:13:46.765280 (+ 20795us) write_op.cc:312] APPLY: finished
0709 12:13:46.786750 (+ 21470us) log.cc:844] Serialized 46 byte log entry
0709 12:13:46.786975 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:46.787127 (+   152us) write_op.cc:454] Released schema lock
0709 12:13:46.787197 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:46.804959 (+ 17762us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:46.805000 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":148261,"reported_tablets":10,"spinlock_wait_cycles":18284800,"child_traces":[["op",{"apply.queue_time_us":30196,"apply.run_cpu_time_us":3936,"apply.run_wall_time_us":91062,"num_ops":5,"prepare.queue_time_us":130951,"prepare.run_cpu_time_us":47105,"prepare.run_wall_time_us":146526,"raft.queue_time_us":111032,"raft.run_cpu_time_us":3484,"raft.run_wall_time_us":30465,"replication_time_us":238180,"thread_start_us":171689,"threads_started":4,"wal-append.queue_time_us":122596}]]}
W20260709 12:13:47.009769  1587 log.cc:927] Time spent T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:13:47.029400 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 104733us
W20260709 12:13:47.036110 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 57151.9us
I20260709 12:13:47.038286  1576 consensus_queue.cc:1059] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.039275  1576 raft_consensus.cc:3055] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:47.039646  1576 raft_consensus.cc:740] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:47.040632  1576 consensus_queue.cc:260] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:47.042060  1576 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.052620   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:47.062680 32455 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:47.063773  1585 raft_consensus.cc:2749] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.065418 32455 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:47.066428  1585 raft_consensus.cc:2749] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:47.086223 32529 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:47.087047  1552 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:47.096946 32561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:47.097911 32561 raft_consensus.cc:606] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:47.104111 32561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6ff9d1de2ed4684838a43a1803e9ccd"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:47.104959 32561 raft_consensus.cc:606] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:47.105736 32561 raft_consensus.cc:614] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:47.109268 32558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:47.109989 32558 raft_consensus.cc:606] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:47.110442 32558 raft_consensus.cc:614] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:47.110109 32313 catalog_manager.cc:5697] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 5, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 5 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } }
I20260709 12:13:47.117049 32313 catalog_manager.cc:5697] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 3, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } }
I20260709 12:13:47.116904 32558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
mode: GRACEFUL
new_leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:45024
I20260709 12:13:47.119745 32558 raft_consensus.cc:606] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Received request to transfer leadership to TS 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:47.119616 32313 catalog_manager.cc:5697] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 2 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } }
I20260709 12:13:47.121304 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:47.122015 32310 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34468 (request call id 145) took 2008 ms. Trace:
I20260709 12:13:47.121683 32313 catalog_manager.cc:5697] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 3, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 3 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.123605 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:47.123414 32313 catalog_manager.cc:5697] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 3 to 4, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 4 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.124791 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:47.122452 32310 rpcz_store.cc:276] 0709 12:13:45.113596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.113838 (+   242us) service_pool.cc:224] Handling call
0709 12:13:45.456500 (+342662us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b5400909cd4. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb2cc5090 00007fbdb2d63f3a 00007fbdb8b19e9c 00007fbdb8c1804e 00007fbdb70d92a4 00007fbdb70d9232 00007fbdb70d9161 00007fbdb70d90dc 00007fbdb70d8392 00007fbdb109648c 00007fbdb10958c6
0709 12:13:47.121917 (+1665417us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:47.026334 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:47.026904 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:47.026962 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:13:47.026978 (+    16us) tablet.cc:662] Decoding operations
0709 12:13:47.027688 (+   710us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:47.027752 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:47.027781 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:47.028349 (+   568us) tablet.cc:701] Row locks acquired
0709 12:13:47.028367 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:47.028527 (+   160us) write_op.cc:270] Start()
0709 12:13:47.028668 (+   141us) write_op.cc:276] Timestamp: P: 1783599227028477 usec, L: 0
0709 12:13:47.028689 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:13:47.029765 (+  1076us) log.cc:844] Serialized 2108 byte log entry
0709 12:13:47.032378 (+  2613us) op_driver.cc:464] REPLICATION: finished
0709 12:13:47.032907 (+   529us) write_op.cc:301] APPLY: starting
0709 12:13:47.032994 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:47.033173 (+   179us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:47.033262 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:47.034015 (+   753us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:47.034236 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:13:47.034305 (+    69us) write_op.cc:312] APPLY: finished
0709 12:13:47.034558 (+   253us) log.cc:844] Serialized 46 byte log entry
0709 12:13:47.034734 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:47.034859 (+   125us) write_op.cc:454] Released schema lock
0709 12:13:47.034911 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:47.042553 (+  7642us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800158f80. stack: 00007fbdafc3c343 00007fbdafc3c240 00007fbdaf5cb1d4 00007fbdb9309304 00007fbdb9309299 00007fbdb8b36ab1 00007fbdb8b43281 00007fbdafc6e522 00007fbdafc707c1 00007fbdafc70779 00007fbdafc70709 00007fbdafc706d1 00007fbdafc6f9cd 0000000000388634 0000000000388479 00007fbdafc5183a
0709 12:13:47.042694 (+   141us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:47.042724 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68243,"reported_tablets":15,"spinlock_wait_cycles":9271168,"child_traces":[["op",{"apply.queue_time_us":312,"apply.run_cpu_time_us":2394,"apply.run_wall_time_us":4325,"num_ops":5,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":3684,"prepare.run_wall_time_us":13620,"replication_time_us":3545,"spinlock_wait_cycles":7222528}]]}
I20260709 12:13:47.150692 32313 catalog_manager.cc:5697] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } }
I20260709 12:13:47.214537  1552 raft_consensus.cc:993] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:47.215240  1589 raft_consensus.cc:1081] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Signalling peer 51f23763442f4ea3a702c32e00616cb0 to start an election
I20260709 12:13:47.217365  1002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0"
dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
 from {username='slave'} at 127.0.0.1:52080
I20260709 12:13:47.218102  1002 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:47.218477  1002 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.255230  1002 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:47.256160  1395 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.256821  1395 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:47.257330  1002 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:47.259172  1395 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:47.264241 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:47.264961 32558 raft_consensus.cc:3055] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.265304 32558 raft_consensus.cc:740] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:47.269590 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:47.279181 32487 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:47.282460   817 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:47.284605  1553 raft_consensus.cc:2804] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.285022  1553 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.285355  1553 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.266228 32558 consensus_queue.cc:260] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:47.292657 32558 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.271366 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a5f824f56a4e53b1594064803caed0" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:47.300560 32633 raft_consensus.cc:3060] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.303148  1553 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:47.306214  1553 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:47.275524 32630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:47.307297 32630 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 2.
I20260709 12:13:47.269712 32314 catalog_manager.cc:5697] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 5, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 5 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } }
I20260709 12:13:47.309629 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:47.310309 32487 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.315968  1590 raft_consensus.cc:993] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: : Instructing follower 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:47.316540  1590 raft_consensus.cc:1081] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Signalling peer 2a4ac09eaeef4bcca6392c4bc6ea97bb to start an election
I20260709 12:13:47.318521 32638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
 from {username='slave'} at 127.0.0.1:52284
I20260709 12:13:47.319092 32638 raft_consensus.cc:493] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:47.324200 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d29e303af234432859c20b561429b5e" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:47.324822 32638 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.324895 32639 raft_consensus.cc:3060] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.327564 32558 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:47.329530 32487 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:47.330236   818 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:47.330927   817 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:47.331853  1395 raft_consensus.cc:2804] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.332317  1395 raft_consensus.cc:697] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:47.333350  1395 consensus_queue.cc:237] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:47.336056  1553 raft_consensus.cc:2804] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.336721  1553 raft_consensus.cc:697] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Becoming Leader. State: Replica: 51f23763442f4ea3a702c32e00616cb0, State: Running, Role: LEADER
I20260709 12:13:47.337747  1553 consensus_queue.cc:237] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:47.321079 32633 raft_consensus.cc:2468] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:47.358809 32639 raft_consensus.cc:2468] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 3.
I20260709 12:13:47.359862 32311 catalog_manager.cc:5697] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.378870 32638 raft_consensus.cc:515] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:47.383325 32638 leader_election.cc:290] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:47.388978 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:47.389782 32485 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.400563 32561 raft_consensus.cc:1275] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.402869 32558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb64ed4d5ede43d7a1a18158c71fa6e9" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:47.403596 32558 raft_consensus.cc:3055] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.408938 32558 raft_consensus.cc:740] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:47.408802  1560 consensus_queue.cc:1048] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:47.420974 32558 consensus_queue.cc:260] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:47.408824 32485 raft_consensus.cc:2468] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
I20260709 12:13:47.411379 32311 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34474 (request call id 140) took 1048 ms. Trace:
I20260709 12:13:47.401777 32310 catalog_manager.cc:5697] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 5 to 6, leader changed from 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 6 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.424166 32604 leader_election.cc:304] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:47.425335  1560 raft_consensus.cc:2804] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.425957  1560 raft_consensus.cc:697] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:47.445832 32311 rpcz_store.cc:276] 0709 12:13:46.363532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.363880 (+   348us) service_pool.cc:224] Handling call
0709 12:13:47.391178 (+1027298us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:47.391213 (+    35us) write_op.cc:454] Released schema lock
0709 12:13:47.411274 (+ 20061us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:47.384212 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:47.384773 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:47.384822 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:13:47.384838 (+    16us) tablet.cc:662] Decoding operations
0709 12:13:47.385203 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:47.385264 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:47.385288 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:47.385484 (+   196us) tablet.cc:701] Row locks acquired
0709 12:13:47.385496 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:13:47.385650 (+   154us) write_op.cc:270] Start()
0709 12:13:47.385765 (+   115us) write_op.cc:276] Timestamp: P: 1783599227385601 usec, L: 0
0709 12:13:47.385781 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:13:47.386460 (+   679us) log.cc:844] Serialized 543 byte log entry
0709 12:13:47.388458 (+  1998us) op_driver.cc:464] REPLICATION: finished
0709 12:13:47.388893 (+   435us) write_op.cc:301] APPLY: starting
0709 12:13:47.388983 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:47.389101 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:47.389220 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:47.389451 (+   231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:47.389631 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:47.389674 (+    43us) write_op.cc:312] APPLY: finished
0709 12:13:47.389869 (+   195us) log.cc:844] Serialized 22 byte log entry
0709 12:13:47.390042 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:47.390140 (+    98us) write_op.cc:454] Released schema lock
0709 12:13:47.390189 (+    49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":14886,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":1583,"apply.run_wall_time_us":1583,"num_ops":1,"prepare.queue_time_us":2562,"prepare.run_cpu_time_us":2538,"prepare.run_wall_time_us":2543,"replication_time_us":2562}]]}
I20260709 12:13:47.427492  1560 consensus_queue.cc:237] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:47.510227 32558 raft_consensus.cc:3060] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.518620 32314 catalog_manager.cc:5697] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 2 to 3, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:47.537154 32314 catalog_manager.cc:5697] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 reported cstate change: term changed from 1 to 3, leader changed from b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130) to 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129). New cstate: current_term: 3 leader_uuid: "51f23763442f4ea3a702c32e00616cb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.721158 32558 raft_consensus.cc:2468] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 3.
W20260709 12:13:47.754714 32605 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 55471.7us
W20260709 12:13:47.770309 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 71693.6us
I20260709 12:13:47.856490 32486 raft_consensus.cc:1275] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.857319 32314 catalog_manager.cc:5697] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } }
I20260709 12:13:47.865669  1597 consensus_queue.cc:1048] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:47.870433 32604 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 99298.8us
I20260709 12:13:47.884029 32484 raft_consensus.cc:1275] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.890380 32558 raft_consensus.cc:1275] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:47.919145 32639 raft_consensus.cc:1275] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.915652  1513 consensus_queue.cc:1048] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:47.921084 32638 raft_consensus.cc:1275] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Refusing update from remote peer 51f23763442f4ea3a702c32e00616cb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:47.922550 32311 catalog_manager.cc:5697] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 2 to 3, leader changed from 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131) to 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132). New cstate: current_term: 3 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.087811  1604 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.088555  1604 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.091032  1604 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:48.091135   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 159007us
I20260709 12:13:48.110774  1605 consensus_queue.cc:1048] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:48.113049 32562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:48.118947 32558 raft_consensus.cc:1275] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.124641   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:48.125787   988 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:48.128691  1513 consensus_queue.cc:1048] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:48.130416  1596 consensus_queue.cc:1048] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.136438 32603 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:48.136776  1609 consensus_queue.cc:1048] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:48.137410  1602 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.137838  1602 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.138185  1602 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.147274  1599 raft_consensus.cc:493] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a4ac09eaeef4bcca6392c4bc6ea97bb)
I20260709 12:13:48.148229  1599 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.151206  1599 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:48.172187 32457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 233515us
I20260709 12:13:48.175865 32486 raft_consensus.cc:1275] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.197403 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:48.205333  1609 consensus_queue.cc:1048] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:48.218641  1333 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:48.219401  1333 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:48.221897  1333 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:48.227560   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:48.228240 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:48.228551   988 raft_consensus.cc:2393] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 in current term 4: Already voted for candidate 51f23763442f4ea3a702c32e00616cb0 in this term.
I20260709 12:13:48.229130 32556 raft_consensus.cc:2393] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 5: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:48.236096  1602 raft_consensus.cc:515] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.239076 32639 raft_consensus.cc:2368] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:48.250854 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:48.251731 32484 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51f23763442f4ea3a702c32e00616cb0 in term 5.
I20260709 12:13:48.256494  1396 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.257030  1396 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:48.259452  1396 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:48.261174   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:48.262039   988 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:48.263289 32455 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:48.264163  1396 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:48.264688  1396 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.265146  1396 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.268456 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5" is_pre_election: true
I20260709 12:13:48.269419 32561 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 5.
I20260709 12:13:48.272652 32529 leader_election.cc:400] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207) with higher term. Message: Invalid argument: T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:48.273195 32529 leader_election.cc:403] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:48.289131 32561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:48.290030 32561 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.292403 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:48.293507   817 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:48.296062  1596 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.296661  1596 raft_consensus.cc:493] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:48.297286  1596 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.304636  1396 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:48.307855  1396 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 6 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:48.312376   988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:48.319506  1596 raft_consensus.cc:515] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:48.320763   988 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.339752  1602 leader_election.cc:290] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Requested vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:48.343176   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ab32935e4b45bbba4aad698d4ec782" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
W20260709 12:13:48.350654 32529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 78300.2us
I20260709 12:13:48.356599   985 raft_consensus.cc:3060] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.354060 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:48.357429 32556 raft_consensus.cc:2393] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 51f23763442f4ea3a702c32e00616cb0 in current term 5: Already voted for candidate 22a81a2a176240d78cb878810a3d56b5 in this term.
I20260709 12:13:48.350046   988 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 6.
I20260709 12:13:48.360749 32455 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:48.361680  1583 raft_consensus.cc:2804] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:48.362289  1583 raft_consensus.cc:697] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 6 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:48.353631 32487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "51f23763442f4ea3a702c32e00616cb0" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:48.363150  1583 consensus_queue.cc:237] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:48.367583 32556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d33572d24cb94b1593a46886bf0bbee9" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
I20260709 12:13:48.368423 32556 raft_consensus.cc:3060] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:48.373925   985 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5.
W20260709 12:13:48.380389  1619 log.cc:927] Time spent T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:13:48.381584 32603 leader_election.cc:304] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:48.382709  1602 raft_consensus.cc:2804] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.386593  1602 raft_consensus.cc:697] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 LEADER]: Becoming Leader. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:48.387621   817 leader_election.cc:304] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0; no voters: 22a81a2a176240d78cb878810a3d56b5, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:48.388450  1602 consensus_queue.cc:237] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.376435  1596 leader_election.cc:290] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [CANDIDATE]: Term 5 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379)
I20260709 12:13:48.389746  1596 raft_consensus.cc:2749] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:48.333776 32561 raft_consensus.cc:2468] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 5.
I20260709 12:13:48.391780  1589 raft_consensus.cc:2749] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207) with higher term. Message: Invalid argument: T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22a81a2a176240d78cb878810a3d56b5 for earlier term 4. Current term is 5.
I20260709 12:13:48.396394  1396 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.397264  1396 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:48.400151  1396 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:48.401571  1605 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.402334 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" is_pre_election: true
I20260709 12:13:48.402477  1605 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:48.404048 32639 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:48.406776   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:48.407820   985 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in term 4.
I20260709 12:13:48.409807 32603 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, 51f23763442f4ea3a702c32e00616cb0; no voters: 
I20260709 12:13:48.410894  1601 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.411317  1601 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.411890  1601 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.411216 32455 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:48.416466  1396 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.417265  1396 raft_consensus.cc:493] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.419409  1396 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:48.445256   817 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:43389, user_credentials={real_user=slave}} blocked reactor thread for 57730.2us
I20260709 12:13:48.458475 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c" is_pre_election: true
I20260709 12:13:48.457036  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0" is_pre_election: true
I20260709 12:13:48.463579  1002 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 4.
I20260709 12:13:48.468675  1396 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:48.470125 32484 raft_consensus.cc:2393] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 5: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:48.480629 32639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:48.481139   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:48.481801   985 raft_consensus.cc:3060] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.452000  1605 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:48.479328  1396 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:48.452332  1601 raft_consensus.cc:515] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:48.499168  1002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:48.499429 32639 raft_consensus.cc:2393] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2729a5e5b834a958c61bb5487a0c22c in current term 5: Already voted for candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in this term.
I20260709 12:13:48.503153 32556 raft_consensus.cc:2468] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 6.
I20260709 12:13:48.506770 32484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c0c583bb864a7c91ac49bf45615523" candidate_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:48.507010 32639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:48.514954 32484 raft_consensus.cc:2393] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a4ac09eaeef4bcca6392c4bc6ea97bb in current term 5: Already voted for candidate b2729a5e5b834a958c61bb5487a0c22c in this term.
I20260709 12:13:48.506987 32314 catalog_manager.cc:5697] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.515426 32639 raft_consensus.cc:606] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Received request to transfer leadership to TS b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:48.510186   985 raft_consensus.cc:2468] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 5.
I20260709 12:13:48.518154 32455 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb
I20260709 12:13:48.519963 32633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:48.520723 32633 raft_consensus.cc:606] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Received request to transfer leadership to TS 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:48.523752 32633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
mode: GRACEFUL
new_leader_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:50488
I20260709 12:13:48.524328 32633 raft_consensus.cc:606] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Received request to transfer leadership to TS 22a81a2a176240d78cb878810a3d56b5
I20260709 12:13:48.525152  1583 raft_consensus.cc:2804] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.525700 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:48.526182  1583 raft_consensus.cc:697] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:48.527221  1583 consensus_queue.cc:237] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:48.528216 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:48.529529 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:48.521562 32311 catalog_manager.cc:5697] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.558701 32604 leader_election.cc:304] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:48.560892  1602 raft_consensus.cc:2749] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:48.508814  1601 leader_election.cc:290] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 election: Requested vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:48.567953 32311 catalog_manager.cc:5697] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.633598  1609 raft_consensus.cc:993] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:48.634171  1609 raft_consensus.cc:1081] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Signalling peer 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:48.636132 32556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:48.636881 32556 raft_consensus.cc:493] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:48.637282 32556 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.663151 32556 raft_consensus.cc:515] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.667681 32556 leader_election.cc:290] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:48.669416 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:48.670037 32633 raft_consensus.cc:3055] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:48.670370 32633 raft_consensus.cc:740] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:48.671185 32633 consensus_queue.cc:260] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.672580 32633 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.712600   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3105a924eb24b24ad8e380d6d3d0ce8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:48.713387   985 raft_consensus.cc:3060] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.750483 32633 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 5.
I20260709 12:13:48.766626   985 raft_consensus.cc:2468] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 5.
I20260709 12:13:48.777822 32529 leader_election.cc:304] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:48.779633  1589 raft_consensus.cc:2804] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.780326  1589 raft_consensus.cc:697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 5 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:48.782007  1589 consensus_queue.cc:237] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:48.797590   985 raft_consensus.cc:1275] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:48.809180  1609 consensus_queue.cc:1048] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:48.837632 32311 catalog_manager.cc:5697] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 4 to 5, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 5 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.870227  1609 raft_consensus.cc:993] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower b2729a5e5b834a958c61bb5487a0c22c to start an election
I20260709 12:13:48.870859  1609 raft_consensus.cc:1081] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Signalling peer b2729a5e5b834a958c61bb5487a0c22c to start an election
I20260709 12:13:48.874207 32556 raft_consensus.cc:1275] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:48.877213 32484 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c"
dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
 from {username='slave'} at 127.0.0.1:59928
I20260709 12:13:48.877707  1396 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.878412 32484 raft_consensus.cc:493] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:48.878907 32484 raft_consensus.cc:3060] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.889285 32556 raft_consensus.cc:1275] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Refusing update from remote peer 2a4ac09eaeef4bcca6392c4bc6ea97bb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:48.891624  1604 consensus_queue.cc:1048] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.909883 32638 raft_consensus.cc:1275] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:48.911405  1396 consensus_queue.cc:1048] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:48.923592   988 raft_consensus.cc:1275] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:13:48.936395  1618 consensus_queue.cc:1048] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:48.969408 32484 raft_consensus.cc:515] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:49.000998 32484 leader_election.cc:290] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Requested vote from peers 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:49.003820 32638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:49.007839   985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a4a0eeeeed495daa87b1a26cd67b0c" candidate_uuid: "b2729a5e5b834a958c61bb5487a0c22c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51f23763442f4ea3a702c32e00616cb0"
I20260709 12:13:49.032963 32638 raft_consensus.cc:3055] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.033584 32638 raft_consensus.cc:740] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:49.034394   985 raft_consensus.cc:3060] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.045385   985 raft_consensus.cc:2468] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:49.047302 32455 leader_election.cc:304] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c; no voters: 
I20260709 12:13:49.061915  1618 raft_consensus.cc:2804] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:49.066075  1605 raft_consensus.cc:993] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: : Instructing follower 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:49.066656  1605 raft_consensus.cc:1081] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Signalling peer 22a81a2a176240d78cb878810a3d56b5 to start an election
I20260709 12:13:49.067741 32638 consensus_queue.cc:260] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:49.069648 32638 raft_consensus.cc:3060] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.075803  1618 raft_consensus.cc:697] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Becoming Leader. State: Replica: b2729a5e5b834a958c61bb5487a0c22c, State: Running, Role: LEADER
I20260709 12:13:49.076458   985 raft_consensus.cc:1275] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:49.076956  1618 consensus_queue.cc:237] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:49.087458  1585 consensus_queue.cc:1048] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:49.090413 32560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8"
dest_uuid: "22a81a2a176240d78cb878810a3d56b5"
 from {username='slave'} at 127.0.0.1:56750
I20260709 12:13:49.091146 32560 raft_consensus.cc:493] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:49.091526 32560 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.108371 32638 raft_consensus.cc:2468] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2729a5e5b834a958c61bb5487a0c22c in term 2.
I20260709 12:13:49.126145 32560 raft_consensus.cc:515] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:49.133008 32560 leader_election.cc:290] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Requested vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132:36207)
I20260709 12:13:49.133550 32633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb"
I20260709 12:13:49.134281 32633 raft_consensus.cc:3055] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.134581 32633 raft_consensus.cc:740] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a4ac09eaeef4bcca6392c4bc6ea97bb, State: Running, Role: LEADER
I20260709 12:13:49.135104 32485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfc9fe93f5a498db41f61396d176cc8" candidate_uuid: "22a81a2a176240d78cb878810a3d56b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b2729a5e5b834a958c61bb5487a0c22c"
I20260709 12:13:49.135350 32633 consensus_queue.cc:260] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:49.135707 32485 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.136426 32633 raft_consensus.cc:3060] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:49.232990   816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.132:36207, user_credentials={real_user=slave}} blocked reactor thread for 97866.4us
I20260709 12:13:49.236577 32633 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
I20260709 12:13:49.238083 32311 catalog_manager.cc:5697] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c reported cstate change: term changed from 1 to 2, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130). New cstate: current_term: 2 leader_uuid: "b2729a5e5b834a958c61bb5487a0c22c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:49.244674   818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:33379, user_credentials={real_user=slave}} blocked reactor thread for 108140us
I20260709 12:13:49.246785   985 raft_consensus.cc:1275] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:49.261221 32529 leader_election.cc:304] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5, 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 
I20260709 12:13:49.265523  1640 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:49.266463 32639 raft_consensus.cc:1275] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:49.277586  1589 raft_consensus.cc:2804] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.278151  1589 raft_consensus.cc:697] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Becoming Leader. State: Replica: 22a81a2a176240d78cb878810a3d56b5, State: Running, Role: LEADER
I20260709 12:13:49.289265  1589 consensus_queue.cc:237] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } }
I20260709 12:13:49.289292  1603 consensus_queue.cc:1048] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:49.330762 32485 raft_consensus.cc:2468] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22a81a2a176240d78cb878810a3d56b5 in term 4.
I20260709 12:13:49.475625 32314 catalog_manager.cc:5697] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 reported cstate change: term changed from 3 to 4, leader changed from 2a4ac09eaeef4bcca6392c4bc6ea97bb (127.23.222.132) to 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131). New cstate: current_term: 4 leader_uuid: "22a81a2a176240d78cb878810a3d56b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:49.512567 32455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:40497, user_credentials={real_user=slave}} blocked reactor thread for 45751.1us
I20260709 12:13:49.603252 32639 raft_consensus.cc:1275] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:49.605021  1585 consensus_queue.cc:1048] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:49.625516  1002 raft_consensus.cc:1275] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Refusing update from remote peer b2729a5e5b834a958c61bb5487a0c22c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:49.639580 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:49.641690  1655 consensus_queue.cc:1048] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:49.705575 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:49.707185 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:49.708374 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:49.756444 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:49.769743 32485 raft_consensus.cc:1275] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:49.774797  1589 consensus_queue.cc:1048] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:49.846334 24442 tablet_server.cc:179] TabletServer@127.23.222.129:40497 shutting down...
I20260709 12:13:49.862025 32638 raft_consensus.cc:1275] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Refusing update from remote peer 22a81a2a176240d78cb878810a3d56b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:49.866101  1646 consensus_queue.cc:1048] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:49.867285 32529 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 96 similar messages]
W20260709 12:13:49.887102 32529 consensus_peers.cc:597] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.913242 32529 consensus_peers.cc:597] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.927533 32455 consensus_peers.cc:597] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.933131 32603 consensus_peers.cc:597] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.938334 32529 consensus_peers.cc:597] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.965891 32529 consensus_peers.cc:597] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.991037 32455 consensus_peers.cc:597] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:49.991928 32455 consensus_peers.cc:597] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:49.994840 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:49.996112 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:49.997368 24442 raft_consensus.cc:2243] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:49.998099 24442 raft_consensus.cc:2272] T 6017d03fcc5c4811bf6139c2858334c1 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.003728 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.004909 24442 raft_consensus.cc:2243] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.005602 24442 raft_consensus.cc:2272] T a4aab3c02fcc4c58932074e364ed6a3a P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.009289 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.010376 24442 raft_consensus.cc:2243] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.011111 24442 raft_consensus.cc:2272] T d282ad4f6b644e9c8c6690342f7c3844 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.014690 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.015746 24442 raft_consensus.cc:2243] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.016295 24442 raft_consensus.cc:2272] T 742b68eafd5b45f688f8cfcabc3fa421 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.019641 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.021068 24442 raft_consensus.cc:2243] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.021780 24442 raft_consensus.cc:2272] T 5be4cc379dc24cf4aa09e4242241c03f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.025558 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.026585 24442 raft_consensus.cc:2243] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.027215 24442 raft_consensus.cc:2272] T f2c0c583bb864a7c91ac49bf45615523 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.031101 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.032204 24442 raft_consensus.cc:2243] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.033488 24442 raft_consensus.cc:2272] T 0db16bbcbab34732ad62610122fd4ddd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.037173 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.038210 24442 raft_consensus.cc:2243] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.039012 24442 raft_consensus.cc:2272] T 58c938626ada4501bedecbdab942f204 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.042862 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.043856 24442 raft_consensus.cc:2243] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.045029 24442 raft_consensus.cc:2272] T 11a8671dc5b3469c99a2ac31a6c25e5c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.048662 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.049690 24442 raft_consensus.cc:2243] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.050951 24442 raft_consensus.cc:2272] T ffe193066934411da2b11565c9080849 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.055063 32603 consensus_peers.cc:597] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.055341 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.056456 24442 raft_consensus.cc:2243] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.057706 24442 raft_consensus.cc:2272] T a9a0efab86054946bbce18dc6e29c467 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.061443 32455 consensus_peers.cc:597] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.065060 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.066138 24442 raft_consensus.cc:2243] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.066891 24442 raft_consensus.cc:2272] T fe1ca85c249841679ee6e347dcf446ea P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.070444 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.071683 24442 raft_consensus.cc:2243] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.072362 24442 raft_consensus.cc:2272] T b9c944e1e0c34336964f60256dfc70ce P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.076182 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.077210 24442 raft_consensus.cc:2243] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.077899 24442 raft_consensus.cc:2272] T 7a112a8d877942bfb7ce438f35b505b4 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.081579 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.082546 24442 raft_consensus.cc:2243] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.083727 24442 raft_consensus.cc:2272] T 7044cb8c255c4809b2a90cfe5ab09f03 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.087405 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.088486 24442 raft_consensus.cc:2243] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.089211 24442 raft_consensus.cc:2272] T 0b9e92d778004203bc647bbdae1a3e28 P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.093509 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.094473 24442 raft_consensus.cc:2243] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.095129 24442 raft_consensus.cc:2272] T c3105a924eb24b24ad8e380d6d3d0ce8 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.100462 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.101501 24442 raft_consensus.cc:2243] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:13:50.101743 32455 consensus_peers.cc:597] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.102759 24442 raft_consensus.cc:2272] T b6ff9d1de2ed4684838a43a1803e9ccd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.106273 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.107211 24442 raft_consensus.cc:2243] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.107836 24442 raft_consensus.cc:2272] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.108429 32529 consensus_peers.cc:597] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.112157 32603 consensus_peers.cc:597] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.113063 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.114033 24442 raft_consensus.cc:2243] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.114746 24442 raft_consensus.cc:2272] T 23a3d4e0554c4f00956aa265c66fe82c P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.118273 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.119273 24442 raft_consensus.cc:2243] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.120364 24442 raft_consensus.cc:2272] T 70f9e9a08efa4169b31414570a994868 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.124055 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.125006 24442 raft_consensus.cc:2243] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.125694 24442 raft_consensus.cc:2272] T 81fcb8b26b8c4216b02b917f1868b9f6 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.127331 32455 consensus_peers.cc:597] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.129220 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.130250 24442 raft_consensus.cc:2243] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.130923 24442 raft_consensus.cc:2272] T 5316a99ba60a464aba3539ee4660a867 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.134132 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.135079 24442 raft_consensus.cc:2243] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.136139 24442 raft_consensus.cc:2272] T 2d29e303af234432859c20b561429b5e P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.138799 32529 consensus_peers.cc:597] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.139415 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.140400 24442 raft_consensus.cc:2243] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.141003 24442 raft_consensus.cc:2272] T b37b1dfe917c4fe7bcb6254184f6b369 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.144322 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.145164 24442 raft_consensus.cc:2243] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.146327 24442 raft_consensus.cc:2272] T d02b4d51cd3f4b3295717f352f048a01 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.149544 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.150367 24442 raft_consensus.cc:2243] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.150966 24442 raft_consensus.cc:2272] T 04ab32935e4b45bbba4aad698d4ec782 P 51f23763442f4ea3a702c32e00616cb0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.154189 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.155125 24442 raft_consensus.cc:2243] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.155756 24442 raft_consensus.cc:2272] T 6938102bc7ee4183b10405f4f5a64ea8 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.158841 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.159641 24442 raft_consensus.cc:2243] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.160226 24442 raft_consensus.cc:2272] T 4fca74c83e8b4439b6ce7442ee076351 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.164610 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.165469 24442 raft_consensus.cc:2243] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.166152 24442 raft_consensus.cc:2272] T 0d77a8828de54acbb915f5d831758a82 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.167676 32529 consensus_peers.cc:597] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.169377 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.170290 24442 raft_consensus.cc:2243] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.170785 24442 raft_consensus.cc:2272] T 5c526ec290504c2cb183b2a374401881 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.173979 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.175113 24442 raft_consensus.cc:2243] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.176352 24442 raft_consensus.cc:2272] T a4179064b9784670ae3b11664ecb7205 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.179566 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.180478 24442 raft_consensus.cc:2243] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.181057 24442 raft_consensus.cc:2272] T 685b2b95e9684decb8a771394db66391 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.183391 32603 consensus_peers.cc:597] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.184185 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.185078 24442 raft_consensus.cc:2243] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.185632 24442 raft_consensus.cc:2272] T 06b9cf0a93e546baaa54ea1b0262ced2 P 51f23763442f4ea3a702c32e00616cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.188633 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.189435 24442 raft_consensus.cc:2243] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.190027 24442 raft_consensus.cc:2272] T d33572d24cb94b1593a46886bf0bbee9 P 51f23763442f4ea3a702c32e00616cb0 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.193296 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.194077 24442 raft_consensus.cc:2243] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.195075 24442 raft_consensus.cc:2272] T 47c6ae8960954c14a3cb5f43eddaeab8 P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.197692 32529 consensus_peers.cc:597] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.198523 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.199419 24442 raft_consensus.cc:2243] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.200560 24442 raft_consensus.cc:2272] T 2433debd51544aefbf04917c84186bbd P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.203514 32603 consensus_peers.cc:597] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.203984 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.204905 24442 raft_consensus.cc:2243] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.205431 24442 raft_consensus.cc:2272] T 952141f15b834977950b348862ca5603 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.208614 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.209414 24442 raft_consensus.cc:2243] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.210619 24442 raft_consensus.cc:2272] T 83f3ae065257465b93b73378b55d5cda P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.213763 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.214614 24442 raft_consensus.cc:2243] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.215197 24442 raft_consensus.cc:2272] T a593854682354a35bcbf4a59a26baa0f P 51f23763442f4ea3a702c32e00616cb0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.217639 32529 consensus_peers.cc:597] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.218540 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.219746 24442 raft_consensus.cc:2243] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.220815 24442 raft_consensus.cc:2272] T 77a5f824f56a4e53b1594064803caed0 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.223682 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.224316 24442 raft_consensus.cc:2243] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.224776 24442 raft_consensus.cc:2272] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.227471 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.228085 24442 raft_consensus.cc:2243] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.228574 24442 raft_consensus.cc:2272] T 44a4a0eeeeed495daa87b1a26cd67b0c P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.231935 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.232676 24442 raft_consensus.cc:2243] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.233254 24442 raft_consensus.cc:2272] T 6668e0bc0681434bb7a16d07ca609ebd P 51f23763442f4ea3a702c32e00616cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.236389 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:50.237069 24442 raft_consensus.cc:2243] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.238183 24442 raft_consensus.cc:2272] T 7f8288c4510048649fa8421e99bbcdb5 P 51f23763442f4ea3a702c32e00616cb0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.246383 32455 consensus_peers.cc:597] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.247488 32455 consensus_peers.cc:597] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.248162 32455 consensus_peers.cc:597] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.254977 32455 consensus_peers.cc:597] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.258282 32603 consensus_peers.cc:597] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.279872 32455 consensus_peers.cc:597] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.303896 32455 consensus_peers.cc:597] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.333837 24442 tablet_server.cc:196] TabletServer@127.23.222.129:40497 shutdown complete.
W20260709 12:13:50.385196 32529 consensus_peers.cc:597] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.385532 32455 consensus_peers.cc:597] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.404397 32455 consensus_peers.cc:597] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c -> Peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Couldn't send request to peer 51f23763442f4ea3a702c32e00616cb0. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.519758 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
W20260709 12:13:50.536554 32530 consensus_peers.cc:597] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.544811 32530 consensus_peers.cc:597] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.559137 32530 consensus_peers.cc:597] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.605830 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:50.621680 24442 tablet_replica.cc:333] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
W20260709 12:13:50.623303 32604 consensus_peers.cc:597] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.626776 24442 raft_consensus.cc:2243] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.627599 24442 raft_consensus.cc:2272] T 47c6ae8960954c14a3cb5f43eddaeab8 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.631541 24442 tablet_replica.cc:333] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.632670 24442 raft_consensus.cc:2243] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.633848 24442 raft_consensus.cc:2272] T d282ad4f6b644e9c8c6690342f7c3844 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.640823 24442 tablet_replica.cc:333] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.641732 24442 raft_consensus.cc:2243] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.642330 24442 raft_consensus.cc:2272] T a593854682354a35bcbf4a59a26baa0f P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.645454 24442 tablet_replica.cc:333] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.647073 24442 raft_consensus.cc:2243] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.647624 24442 raft_consensus.cc:2272] T b2b7dc13dad9450593f677a27d195620 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.650002 24442 tablet_replica.cc:333] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.650848 24442 raft_consensus.cc:2243] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.651674 24442 raft_consensus.cc:2272] T b37b1dfe917c4fe7bcb6254184f6b369 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.654682 24442 tablet_replica.cc:333] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.655468 24442 raft_consensus.cc:2243] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.655978 24442 raft_consensus.cc:2272] T 2d29e303af234432859c20b561429b5e P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.658928 24442 tablet_replica.cc:333] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.659839 24442 raft_consensus.cc:2243] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:50.659927 32604 consensus_peers.cc:597] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.660519 24442 raft_consensus.cc:2272] T a9a0efab86054946bbce18dc6e29c467 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.663887 24442 tablet_replica.cc:333] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.664794 24442 raft_consensus.cc:2243] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.665858 24442 raft_consensus.cc:2272] T fe1ca85c249841679ee6e347dcf446ea P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.668109 32604 consensus_peers.cc:597] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.668883 24442 tablet_replica.cc:333] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.669929 24442 raft_consensus.cc:2243] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.671094 24442 raft_consensus.cc:2272] T b9c944e1e0c34336964f60256dfc70ce P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.674338 24442 tablet_replica.cc:333] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.675216 24442 raft_consensus.cc:2243] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.676349 24442 raft_consensus.cc:2272] T 6d9e9d432cb84622a564a7fcd6938824 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.679575 32604 consensus_peers.cc:597] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.679894 24442 tablet_replica.cc:333] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.680884 24442 raft_consensus.cc:2243] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.682050 24442 raft_consensus.cc:2272] T 7a112a8d877942bfb7ce438f35b505b4 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.685168 24442 tablet_replica.cc:333] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.685910 24442 raft_consensus.cc:2243] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.687081 24442 raft_consensus.cc:2272] T d33572d24cb94b1593a46886bf0bbee9 P b2729a5e5b834a958c61bb5487a0c22c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.689628 24442 tablet_replica.cc:333] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.690330 24442 raft_consensus.cc:2243] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.690825 24442 raft_consensus.cc:2272] T 83e414e6422547db852244112d5dd011 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.693236 24442 tablet_replica.cc:333] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.693965 24442 raft_consensus.cc:2243] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.694516 24442 raft_consensus.cc:2272] T 7044cb8c255c4809b2a90cfe5ab09f03 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.697911 24442 tablet_replica.cc:333] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
W20260709 12:13:50.698392 32604 consensus_peers.cc:597] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.699026 24442 raft_consensus.cc:2243] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.700392 24442 raft_consensus.cc:2272] T 0b9e92d778004203bc647bbdae1a3e28 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.703850 24442 tablet_replica.cc:333] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.704887 24442 raft_consensus.cc:2243] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.705509 24442 raft_consensus.cc:2272] T 13de05a5967f4ae1b37b49953488e4e0 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.708469 24442 tablet_replica.cc:333] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.709396 24442 raft_consensus.cc:2243] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.710081 24442 raft_consensus.cc:2272] T 11a8671dc5b3469c99a2ac31a6c25e5c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.713898 24442 tablet_replica.cc:333] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.714807 24442 raft_consensus.cc:2243] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.715303 24442 raft_consensus.cc:2272] T 2433debd51544aefbf04917c84186bbd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.717927 24442 tablet_replica.cc:333] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.718582 24442 raft_consensus.cc:2243] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.719048 24442 raft_consensus.cc:2272] T f17317629dbe497ca572ad72ffb1249f P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.721202 24442 tablet_replica.cc:333] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.721807 24442 raft_consensus.cc:2243] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.722342 24442 raft_consensus.cc:2272] T 952141f15b834977950b348862ca5603 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.724773 24442 tablet_replica.cc:333] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.725517 24442 raft_consensus.cc:2243] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.726046 24442 raft_consensus.cc:2272] T bbfc9fe93f5a498db41f61396d176cc8 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.729611 24442 tablet_replica.cc:333] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.730518 24442 raft_consensus.cc:2243] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.731096 24442 raft_consensus.cc:2272] T 70f9e9a08efa4169b31414570a994868 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.734095 24442 tablet_replica.cc:333] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.734989 24442 raft_consensus.cc:2243] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.735654 24442 raft_consensus.cc:2272] T d15504aa6b6247adba3539950c1023f4 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.738606 24442 tablet_replica.cc:333] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.739470 24442 raft_consensus.cc:2243] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.740556 24442 raft_consensus.cc:2272] T 6938102bc7ee4183b10405f4f5a64ea8 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.743578 24442 tablet_replica.cc:333] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.744505 24442 raft_consensus.cc:2243] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.745105 24442 raft_consensus.cc:2272] T 5c526ec290504c2cb183b2a374401881 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.748272 24442 tablet_replica.cc:333] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
W20260709 12:13:50.753248 32604 consensus_peers.cc:597] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.754103 24442 raft_consensus.cc:2243] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.755515 24442 raft_consensus.cc:2272] T 4fca74c83e8b4439b6ce7442ee076351 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.759164 24442 tablet_replica.cc:333] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.760054 24442 raft_consensus.cc:2243] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.760983 24442 raft_consensus.cc:2272] T 23a3d4e0554c4f00956aa265c66fe82c P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.767479 24442 tablet_replica.cc:333] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.768374 24442 raft_consensus.cc:2243] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:50.768632 32530 consensus_peers.cc:597] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.769550 24442 raft_consensus.cc:2272] T c52ca9ed28fe425ea8235a5d0d8dfe70 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.773464 24442 tablet_replica.cc:333] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.774657 24442 raft_consensus.cc:2243] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.775504 24442 raft_consensus.cc:2272] T b6ff9d1de2ed4684838a43a1803e9ccd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.778703 24442 tablet_replica.cc:333] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.779383 24442 raft_consensus.cc:2243] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.780344 24442 raft_consensus.cc:2272] T f2c0c583bb864a7c91ac49bf45615523 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.782804 24442 tablet_replica.cc:333] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.783447 24442 raft_consensus.cc:2243] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.784132 24442 raft_consensus.cc:2272] T 0db16bbcbab34732ad62610122fd4ddd P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.786695 24442 tablet_replica.cc:333] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.787376 24442 raft_consensus.cc:2243] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.787838 24442 raft_consensus.cc:2272] T 849d745295ee45abb8a522d542819654 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.790995 24442 tablet_replica.cc:333] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.791944 24442 raft_consensus.cc:2243] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.792527 24442 raft_consensus.cc:2272] T a4179064b9784670ae3b11664ecb7205 P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.795297 24442 tablet_replica.cc:333] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.795924 24442 raft_consensus.cc:2243] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.796365 24442 raft_consensus.cc:2272] T b91b8d6a020d469ba3542974ba93b7a6 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.798908 24442 tablet_replica.cc:333] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.799485 24442 raft_consensus.cc:2243] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.800452 24442 raft_consensus.cc:2272] T 6017d03fcc5c4811bf6139c2858334c1 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.808475 24442 tablet_replica.cc:333] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.809345 24442 raft_consensus.cc:2243] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.809955 24442 raft_consensus.cc:2272] T 6fb4854351aa4a79bb253ee589d7f204 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.812777 24442 tablet_replica.cc:333] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.813581 24442 raft_consensus.cc:2243] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.814380 24442 raft_consensus.cc:2272] T c29f3259972241c7bafe8cef3a1a0acd P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.818470 24442 tablet_replica.cc:333] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.819339 24442 raft_consensus.cc:2243] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.820559 24442 raft_consensus.cc:2272] T 742b68eafd5b45f688f8cfcabc3fa421 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.823766 24442 tablet_replica.cc:333] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
W20260709 12:13:50.823823 32604 consensus_peers.cc:597] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.824713 24442 raft_consensus.cc:2243] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.825387 24442 raft_consensus.cc:2272] T efe7ed2268914c5f801a07f22ed353c6 P b2729a5e5b834a958c61bb5487a0c22c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.828603 24442 tablet_replica.cc:333] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.829342 24442 raft_consensus.cc:2243] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.829823 24442 raft_consensus.cc:2272] T cb64ed4d5ede43d7a1a18158c71fa6e9 P b2729a5e5b834a958c61bb5487a0c22c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.832221 24442 tablet_replica.cc:333] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.832842 24442 raft_consensus.cc:2243] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.833848 24442 raft_consensus.cc:2272] T 06b9cf0a93e546baaa54ea1b0262ced2 P b2729a5e5b834a958c61bb5487a0c22c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.836580 32604 consensus_peers.cc:597] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.836977 24442 tablet_replica.cc:333] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.837815 24442 raft_consensus.cc:2243] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.838487 24442 raft_consensus.cc:2272] T ffe193066934411da2b11565c9080849 P b2729a5e5b834a958c61bb5487a0c22c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.841457 24442 tablet_replica.cc:333] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.842058 24442 raft_consensus.cc:2243] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:50.842643 24442 raft_consensus.cc:2272] T 79e5da2812114608bc846e1630ec618e P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:50.844987 24442 tablet_replica.cc:333] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c: stopping tablet replica
I20260709 12:13:50.845603 24442 raft_consensus.cc:2243] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:50.846959 24442 raft_consensus.cc:2272] T 44a4a0eeeeed495daa87b1a26cd67b0c P b2729a5e5b834a958c61bb5487a0c22c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:50.855994 32604 consensus_peers.cc:597] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.864631 32604 consensus_peers.cc:597] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.867532 32604 consensus_peers.cc:597] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.942919 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
W20260709 12:13:50.945989 32530 consensus_peers.cc:597] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:50.991345 32530 consensus_peers.cc:597] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.993851  1643 raft_consensus.cc:493] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:50.994746  1643 raft_consensus.cc:515] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:50.997581  1643 leader_election.cc:290] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:51.003940 32604 consensus_peers.cc:597] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Couldn't send request to peer b2729a5e5b834a958c61bb5487a0c22c. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:51.012727 32530 leader_election.cc:336] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
W20260709 12:13:51.013896 32529 leader_election.cc:336] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.014356 32529 leader_election.cc:304] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.015129  1643 raft_consensus.cc:2749] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.068929  1602 raft_consensus.cc:493] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.069729  1602 raft_consensus.cc:515] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:51.070703 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
I20260709 12:13:51.072630  1602 leader_election.cc:290] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:51.084923 32604 leader_election.cc:336] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.081903  1643 raft_consensus.cc:493] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
W20260709 12:13:51.085630 32603 leader_election.cc:336] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.086292 32603 leader_election.cc:304] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.086199  1643 raft_consensus.cc:515] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:51.087407  1602 raft_consensus.cc:2749] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.092825  1643 leader_election.cc:290] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:51.097136 32529 leader_election.cc:336] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:51.101626 32530 leader_election.cc:336] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.102140 32530 leader_election.cc:304] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.102936  1589 raft_consensus.cc:2749] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.138669  1602 raft_consensus.cc:493] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.139433  1602 raft_consensus.cc:515] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:51.141978  1602 leader_election.cc:290] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:51.150451 32604 leader_election.cc:336] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
W20260709 12:13:51.158039 32603 leader_election.cc:336] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.158792 32603 leader_election.cc:304] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.159479  1602 raft_consensus.cc:2749] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.165555 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:51.166822 24442 tablet_replica.cc:333] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.167969 24442 raft_consensus.cc:2243] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.168562 24442 raft_consensus.cc:2272] T 47c6ae8960954c14a3cb5f43eddaeab8 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.171571 24442 tablet_replica.cc:333] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.172569 24442 raft_consensus.cc:2243] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.173257 24442 raft_consensus.cc:2272] T 83f3ae065257465b93b73378b55d5cda P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.177572 24442 tablet_replica.cc:333] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.178761 24442 raft_consensus.cc:2243] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.180186 24442 raft_consensus.cc:2272] T b2b7dc13dad9450593f677a27d195620 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.183525 24442 tablet_replica.cc:333] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.184468 24442 raft_consensus.cc:2243] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.185551 24442 raft_consensus.cc:2272] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.188514 24442 tablet_replica.cc:333] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.192734  1589 raft_consensus.cc:493] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.193229 24442 raft_consensus.cc:2243] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.193547  1589 raft_consensus.cc:515] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } }
I20260709 12:13:51.194532 24442 raft_consensus.cc:2272] T 79e5da2812114608bc846e1630ec618e P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.198033 24442 tablet_replica.cc:333] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.198956 24442 raft_consensus.cc:2243] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.199390  1589 leader_election.cc:290] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:51.200124 24442 raft_consensus.cc:2272] T 6668e0bc0681434bb7a16d07ca609ebd P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.203162 24442 tablet_replica.cc:333] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
W20260709 12:13:51.203531 32529 leader_election.cc:336] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.203852 24442 raft_consensus.cc:2243] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.204614 24442 raft_consensus.cc:2272] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.204593 32530 leader_election.cc:336] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.205236 32530 leader_election.cc:304] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22a81a2a176240d78cb878810a3d56b5; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:51.205922 32530 raft_consensus.cc:2686] T a9a0efab86054946bbce18dc6e29c467 P 22a81a2a176240d78cb878810a3d56b5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:51.207993 24442 tablet_replica.cc:333] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.208779 24442 raft_consensus.cc:2243] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.209369 24442 raft_consensus.cc:2272] T 7f8288c4510048649fa8421e99bbcdb5 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.212622 24442 tablet_replica.cc:333] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.213511 24442 raft_consensus.cc:2243] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.214154 24442 raft_consensus.cc:2272] T 7a112a8d877942bfb7ce438f35b505b4 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.216675 24442 tablet_replica.cc:333] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.217286 24442 raft_consensus.cc:2243] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.217777 24442 raft_consensus.cc:2272] T 6d9e9d432cb84622a564a7fcd6938824 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.220269 24442 tablet_replica.cc:333] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.221055 24442 raft_consensus.cc:2243] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.222093 24442 raft_consensus.cc:2272] T 13de05a5967f4ae1b37b49953488e4e0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.229063 24442 tablet_replica.cc:333] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.230217 24442 raft_consensus.cc:2243] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.231460 24442 raft_consensus.cc:2272] T 58c938626ada4501bedecbdab942f204 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.235018 24442 tablet_replica.cc:333] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
W20260709 12:13:51.240092 32605 consensus_peers.cc:597] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.236078 24442 raft_consensus.cc:2243] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.243358 24442 raft_consensus.cc:2272] T d33572d24cb94b1593a46886bf0bbee9 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.249750 24442 tablet_replica.cc:333] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.250720 24442 raft_consensus.cc:2243] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.251359 24442 raft_consensus.cc:2272] T f17317629dbe497ca572ad72ffb1249f P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.254787 24442 tablet_replica.cc:333] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.255643 24442 raft_consensus.cc:2243] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.257150 24442 raft_consensus.cc:2272] T 952141f15b834977950b348862ca5603 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.260308 24442 tablet_replica.cc:333] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.261866 24442 raft_consensus.cc:2243] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.262987 24442 raft_consensus.cc:2272] T 5316a99ba60a464aba3539ee4660a867 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.266122 24442 tablet_replica.cc:333] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.267071 24442 raft_consensus.cc:2243] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.267710 24442 raft_consensus.cc:2272] T 6fb4854351aa4a79bb253ee589d7f204 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.270742 24442 tablet_replica.cc:333] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.271589 24442 raft_consensus.cc:2243] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.272686 24442 raft_consensus.cc:2272] T 81fcb8b26b8c4216b02b917f1868b9f6 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.277017 24442 tablet_replica.cc:333] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.277886 24442 raft_consensus.cc:2243] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.278482 24442 raft_consensus.cc:2272] T 7044cb8c255c4809b2a90cfe5ab09f03 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.281450 24442 tablet_replica.cc:333] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.282294 24442 raft_consensus.cc:2243] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.282939 24442 raft_consensus.cc:2272] T 0b9e92d778004203bc647bbdae1a3e28 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.286072 24442 tablet_replica.cc:333] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.286860 24442 raft_consensus.cc:2243] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:51.294576 32605 consensus_peers.cc:597] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:51.295275 32605 consensus_peers.cc:597] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.301669  1656 raft_consensus.cc:493] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.302309  1656 raft_consensus.cc:515] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:51.287351 24442 raft_consensus.cc:2272] T 849d745295ee45abb8a522d542819654 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.306951 24442 tablet_replica.cc:333] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.310062 24442 raft_consensus.cc:2243] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.310809 24442 raft_consensus.cc:2272] T 83e414e6422547db852244112d5dd011 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.304817  1656 leader_election.cc:290] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:51.312753 32603 leader_election.cc:336] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.314175 24442 tablet_replica.cc:333] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.315115 24442 raft_consensus.cc:2243] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.315683 24442 raft_consensus.cc:2272] T 23a3d4e0554c4f00956aa265c66fe82c P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.318248 24442 tablet_replica.cc:333] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.319185 24442 raft_consensus.cc:2243] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.319741 24442 raft_consensus.cc:2272] T c52ca9ed28fe425ea8235a5d0d8dfe70 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.320597 32605 leader_election.cc:336] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:51.321187 32605 leader_election.cc:304] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:51.322053  1656 raft_consensus.cc:2749] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.322886 24442 tablet_replica.cc:333] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
W20260709 12:13:51.323415 32605 consensus_peers.cc:597] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.323796 24442 raft_consensus.cc:2243] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.324431 24442 raft_consensus.cc:2272] T b6ff9d1de2ed4684838a43a1803e9ccd P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.327543 24442 tablet_replica.cc:333] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.328408 24442 raft_consensus.cc:2243] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.329576 24442 raft_consensus.cc:2272] T c3105a924eb24b24ad8e380d6d3d0ce8 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.330693  1601 raft_consensus.cc:493] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.331384  1601 raft_consensus.cc:515] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:51.332857 24442 tablet_replica.cc:333] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.333770 24442 raft_consensus.cc:2243] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.333948  1601 leader_election.cc:290] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:51.334358 24442 raft_consensus.cc:2272] T b91b8d6a020d469ba3542974ba93b7a6 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.336656  1601 raft_consensus.cc:493] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.337566 24442 tablet_replica.cc:333] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.338723  1601 raft_consensus.cc:515] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:51.339133 24442 raft_consensus.cc:2243] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.339973 24442 raft_consensus.cc:2272] T 6017d03fcc5c4811bf6139c2858334c1 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.342234  1601 leader_election.cc:290] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:51.343082 24442 tablet_replica.cc:333] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
W20260709 12:13:51.343623 32603 leader_election.cc:336] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.344121 24442 raft_consensus.cc:2243] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.345252 24442 raft_consensus.cc:2272] T 5be4cc379dc24cf4aa09e4242241c03f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.347213 32604 leader_election.cc:336] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.348311 24442 tablet_replica.cc:333] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.348920  1602 raft_consensus.cc:493] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.349448 24442 raft_consensus.cc:2243] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.349490  1602 raft_consensus.cc:515] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:51.350349 24442 raft_consensus.cc:2272] T a4aab3c02fcc4c58932074e364ed6a3a P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.352581  1602 leader_election.cc:290] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
I20260709 12:13:51.353680 24442 tablet_replica.cc:333] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
W20260709 12:13:51.356582 32605 consensus_peers.cc:597] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:51.357163 32605 leader_election.cc:336] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:51.357524 32605 leader_election.cc:304] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:51.358300  1656 raft_consensus.cc:2749] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.359982 24442 raft_consensus.cc:2243] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:13:51.361166 32604 leader_election.cc:336] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.362042 24442 raft_consensus.cc:2272] T a593854682354a35bcbf4a59a26baa0f P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.362749 32603 leader_election.cc:336] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.364184 32603 leader_election.cc:304] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.365343 24442 tablet_replica.cc:333] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.366204 24442 raft_consensus.cc:2243] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.366755 24442 raft_consensus.cc:2272] T 77a5f824f56a4e53b1594064803caed0 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.369848 24442 tablet_replica.cc:333] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.370738 24442 raft_consensus.cc:2243] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.371173  1601 raft_consensus.cc:2749] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.371933 24442 raft_consensus.cc:2272] T 0d77a8828de54acbb915f5d831758a82 P 22a81a2a176240d78cb878810a3d56b5 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.375626 32603 leader_election.cc:336] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.376189 32603 leader_election.cc:304] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.376788 24442 tablet_replica.cc:333] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.377045  1656 raft_consensus.cc:2749] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.377152  1602 raft_consensus.cc:493] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.377897 24442 raft_consensus.cc:2243] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.377766  1602 raft_consensus.cc:515] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:51.378584 24442 raft_consensus.cc:2272] T efe7ed2268914c5f801a07f22ed353c6 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.381893 24442 tablet_replica.cc:333] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.382783 24442 raft_consensus.cc:2243] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.383404 24442 raft_consensus.cc:2272] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 22a81a2a176240d78cb878810a3d56b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.384300  1602 leader_election.cc:290] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:51.384836 32605 consensus_peers.cc:597] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.386790 24442 tablet_replica.cc:333] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.387699 24442 raft_consensus.cc:2243] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.388356 24442 raft_consensus.cc:2272] T 742b68eafd5b45f688f8cfcabc3fa421 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.387728 32605 leader_election.cc:336] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:51.390622 32603 leader_election.cc:336] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.391093 32603 leader_election.cc:304] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
I20260709 12:13:51.391319 24442 tablet_replica.cc:333] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.392017  1602 raft_consensus.cc:2749] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.392124 24442 raft_consensus.cc:2243] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.392877 24442 raft_consensus.cc:2272] T ffe193066934411da2b11565c9080849 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.395247 24442 tablet_replica.cc:333] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.395973 24442 raft_consensus.cc:2243] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.396849 24442 raft_consensus.cc:2272] T bbfc9fe93f5a498db41f61396d176cc8 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.399173 24442 tablet_replica.cc:333] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.399740 24442 raft_consensus.cc:2243] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.400193 24442 raft_consensus.cc:2272] T d02b4d51cd3f4b3295717f352f048a01 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.402594 24442 tablet_replica.cc:333] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.403154 24442 raft_consensus.cc:2243] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.403656 24442 raft_consensus.cc:2272] T d15504aa6b6247adba3539950c1023f4 P 22a81a2a176240d78cb878810a3d56b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.406283 24442 tablet_replica.cc:333] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.407016 24442 raft_consensus.cc:2243] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.407593 24442 raft_consensus.cc:2272] T 04ab32935e4b45bbba4aad698d4ec782 P 22a81a2a176240d78cb878810a3d56b5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.410367 24442 tablet_replica.cc:333] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.411104 24442 raft_consensus.cc:2243] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.411644 24442 raft_consensus.cc:2272] T 685b2b95e9684decb8a771394db66391 P 22a81a2a176240d78cb878810a3d56b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.414492 24442 tablet_replica.cc:333] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.415156 24442 raft_consensus.cc:2243] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.415702 24442 raft_consensus.cc:2272] T 06b9cf0a93e546baaa54ea1b0262ced2 P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.418534 24442 tablet_replica.cc:333] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5: stopping tablet replica
I20260709 12:13:51.419039 24442 raft_consensus.cc:2243] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.419512 24442 raft_consensus.cc:2272] T c29f3259972241c7bafe8cef3a1a0acd P 22a81a2a176240d78cb878810a3d56b5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.468001 32605 consensus_peers.cc:597] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:51.492750 32605 consensus_peers.cc:597] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:51.513929 32605 consensus_peers.cc:597] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.131:33379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.515844 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:13:51.537376  1602 raft_consensus.cc:493] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.538622  1602 raft_consensus.cc:515] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:51.541826  1602 leader_election.cc:290] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
W20260709 12:13:51.547894 32604 leader_election.cc:336] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
W20260709 12:13:51.553611 32603 leader_election.cc:336] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:51.553992 32605 consensus_peers.cc:597] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.131:33379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.554284 32603 leader_election.cc:304] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.555371  1602 raft_consensus.cc:2749] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:51.584297 32605 consensus_peers.cc:597] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.131:33379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:51.602838 32605 consensus_peers.cc:597] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb -> Peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Couldn't send request to peer 22a81a2a176240d78cb878810a3d56b5. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.131:33379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:51.617611 24442 tablet_server.cc:179] TabletServer@127.23.222.132:0 shutting down...
I20260709 12:13:51.659334  1602 raft_consensus.cc:493] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.660058  1602 raft_consensus.cc:515] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:51.661988  1656 raft_consensus.cc:493] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 51f23763442f4ea3a702c32e00616cb0)
I20260709 12:13:51.662746  1602 leader_election.cc:290] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:51.662806  1656 raft_consensus.cc:515] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22a81a2a176240d78cb878810a3d56b5" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 33379 } } peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } }
I20260709 12:13:51.665704  1656 leader_election.cc:290] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379), 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497)
W20260709 12:13:51.676007 32605 leader_election.cc:336] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 22a81a2a176240d78cb878810a3d56b5 (127.23.222.131:33379): Network error: Client connection negotiation failed: client connection to 127.23.222.131:33379: connect: Connection refused (error 111)
W20260709 12:13:51.681418 32603 leader_election.cc:336] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:51.682029 32603 leader_election.cc:336] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
I20260709 12:13:51.682485 32603 leader_election.cc:304] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 22a81a2a176240d78cb878810a3d56b5, 51f23763442f4ea3a702c32e00616cb0
W20260709 12:13:51.682585 32604 leader_election.cc:336] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.683138 32604 leader_election.cc:304] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
I20260709 12:13:51.683957  1656 raft_consensus.cc:2749] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.684732  1602 raft_consensus.cc:2749] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.698220 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:51.699396 24442 tablet_replica.cc:333] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.700199 24442 raft_consensus.cc:2243] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.700851 24442 raft_consensus.cc:2272] T 83f3ae065257465b93b73378b55d5cda P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.703642 24442 tablet_replica.cc:333] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.704489 24442 raft_consensus.cc:2243] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.705103 24442 raft_consensus.cc:2272] T b2b7dc13dad9450593f677a27d195620 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.707619 24442 tablet_replica.cc:333] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.708348 24442 raft_consensus.cc:2243] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.708880 24442 raft_consensus.cc:2272] T d282ad4f6b644e9c8c6690342f7c3844 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.711323 24442 tablet_replica.cc:333] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.712064 24442 raft_consensus.cc:2243] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.712721 24442 raft_consensus.cc:2272] T 0377240aa66c46c3ab6d99efb7e3bcd4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.716334 24442 tablet_replica.cc:333] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.717235 24442 raft_consensus.cc:2243] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.718310 24442 raft_consensus.cc:2272] T b37b1dfe917c4fe7bcb6254184f6b369 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.721000 24442 tablet_replica.cc:333] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.721845 24442 raft_consensus.cc:2243] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.722455 24442 raft_consensus.cc:2272] T 6668e0bc0681434bb7a16d07ca609ebd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.724732 24442 tablet_replica.cc:333] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.725287  1656 raft_consensus.cc:493] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2729a5e5b834a958c61bb5487a0c22c)
I20260709 12:13:51.725988  1656 raft_consensus.cc:515] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a4ac09eaeef4bcca6392c4bc6ea97bb" member_type: VOTER last_known_addr { host: "127.23.222.132" port: 36207 } } peers { permanent_uuid: "51f23763442f4ea3a702c32e00616cb0" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 40497 } } peers { permanent_uuid: "b2729a5e5b834a958c61bb5487a0c22c" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 43389 } }
I20260709 12:13:51.727067 24442 raft_consensus.cc:2243] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.728530  1656 leader_election.cc:290] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497), b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389)
I20260709 12:13:51.729434 24442 raft_consensus.cc:2272] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.732853 24442 tablet_replica.cc:333] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.733863 24442 raft_consensus.cc:2243] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.734464 24442 raft_consensus.cc:2272] T b9c944e1e0c34336964f60256dfc70ce P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:51.734786 32603 leader_election.cc:336] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 51f23763442f4ea3a702c32e00616cb0 (127.23.222.129:40497): Network error: Client connection negotiation failed: client connection to 127.23.222.129:40497: connect: Connection refused (error 111)
W20260709 12:13:51.736065 32604 leader_election.cc:336] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b2729a5e5b834a958c61bb5487a0c22c (127.23.222.130:43389): Network error: Client connection negotiation failed: client connection to 127.23.222.130:43389: connect: Connection refused (error 111)
I20260709 12:13:51.736506 32604 leader_election.cc:304] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a4ac09eaeef4bcca6392c4bc6ea97bb; no voters: 51f23763442f4ea3a702c32e00616cb0, b2729a5e5b834a958c61bb5487a0c22c
W20260709 12:13:51.737134 32604 raft_consensus.cc:2686] T fe1ca85c249841679ee6e347dcf446ea P 2a4ac09eaeef4bcca6392c4bc6ea97bb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:13:51.737641 24442 tablet_replica.cc:333] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.738636 24442 raft_consensus.cc:2243] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.739753 24442 raft_consensus.cc:2272] T 685b2b95e9684decb8a771394db66391 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.742244 24442 tablet_replica.cc:333] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.742961 24442 raft_consensus.cc:2243] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.743481 24442 raft_consensus.cc:2272] T 7f8288c4510048649fa8421e99bbcdb5 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.745689 24442 tablet_replica.cc:333] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.746379 24442 raft_consensus.cc:2243] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.746886 24442 raft_consensus.cc:2272] T 6d9e9d432cb84622a564a7fcd6938824 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.749135 24442 tablet_replica.cc:333] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.749758 24442 raft_consensus.cc:2243] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.750689 24442 raft_consensus.cc:2272] T b91b8d6a020d469ba3542974ba93b7a6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.752919 24442 tablet_replica.cc:333] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.753655 24442 raft_consensus.cc:2243] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.754196 24442 raft_consensus.cc:2272] T 13de05a5967f4ae1b37b49953488e4e0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.756587 24442 tablet_replica.cc:333] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.757246 24442 raft_consensus.cc:2243] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.757836 24442 raft_consensus.cc:2272] T 58c938626ada4501bedecbdab942f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.760301 24442 tablet_replica.cc:333] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.760926 24442 raft_consensus.cc:2243] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.761415 24442 raft_consensus.cc:2272] T 11a8671dc5b3469c99a2ac31a6c25e5c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.763738 24442 tablet_replica.cc:333] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.764379 24442 raft_consensus.cc:2243] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.764851 24442 raft_consensus.cc:2272] T 2433debd51544aefbf04917c84186bbd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.767339 24442 tablet_replica.cc:333] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.768018 24442 raft_consensus.cc:2243] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.768918 24442 raft_consensus.cc:2272] T f17317629dbe497ca572ad72ffb1249f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.771356 24442 tablet_replica.cc:333] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.772043 24442 raft_consensus.cc:2243] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.772504 24442 raft_consensus.cc:2272] T bbfc9fe93f5a498db41f61396d176cc8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.774760 24442 tablet_replica.cc:333] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.775373 24442 raft_consensus.cc:2243] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.775846 24442 raft_consensus.cc:2272] T 70f9e9a08efa4169b31414570a994868 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.778858 24442 tablet_replica.cc:333] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.779680 24442 raft_consensus.cc:2243] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.780761 24442 raft_consensus.cc:2272] T 6fb4854351aa4a79bb253ee589d7f204 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.783885 24442 tablet_replica.cc:333] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.784890 24442 raft_consensus.cc:2243] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.785535 24442 raft_consensus.cc:2272] T 81fcb8b26b8c4216b02b917f1868b9f6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.788190 24442 tablet_replica.cc:333] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.788980 24442 raft_consensus.cc:2243] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.789594 24442 raft_consensus.cc:2272] T 2d29e303af234432859c20b561429b5e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.792421 24442 tablet_replica.cc:333] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.793099 24442 raft_consensus.cc:2243] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.793624 24442 raft_consensus.cc:2272] T 5316a99ba60a464aba3539ee4660a867 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.795805 24442 tablet_replica.cc:333] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.796511 24442 raft_consensus.cc:2243] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.797112 24442 raft_consensus.cc:2272] T d02b4d51cd3f4b3295717f352f048a01 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.800109 24442 tablet_replica.cc:333] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.800750 24442 raft_consensus.cc:2243] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.801985 24442 raft_consensus.cc:2272] T d15504aa6b6247adba3539950c1023f4 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.804860 24442 tablet_replica.cc:333] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.805675 24442 raft_consensus.cc:2243] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.806751 24442 raft_consensus.cc:2272] T 04ab32935e4b45bbba4aad698d4ec782 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.809592 24442 tablet_replica.cc:333] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.810546 24442 raft_consensus.cc:2243] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.811560 24442 raft_consensus.cc:2272] T 6938102bc7ee4183b10405f4f5a64ea8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.814640 24442 tablet_replica.cc:333] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.815447 24442 raft_consensus.cc:2243] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.816533 24442 raft_consensus.cc:2272] T 83e414e6422547db852244112d5dd011 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.819216 24442 tablet_replica.cc:333] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.820405 24442 raft_consensus.cc:2243] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.820922 24442 raft_consensus.cc:2272] T 0d77a8828de54acbb915f5d831758a82 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.823208 24442 tablet_replica.cc:333] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.823812 24442 raft_consensus.cc:2243] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.824664 24442 raft_consensus.cc:2272] T 5c526ec290504c2cb183b2a374401881 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.827044 24442 tablet_replica.cc:333] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.827663 24442 raft_consensus.cc:2243] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.828125 24442 raft_consensus.cc:2272] T 4fca74c83e8b4439b6ce7442ee076351 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.830312 24442 tablet_replica.cc:333] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.830924 24442 raft_consensus.cc:2243] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.831391 24442 raft_consensus.cc:2272] T c3105a924eb24b24ad8e380d6d3d0ce8 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.833469 24442 tablet_replica.cc:333] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.834074 24442 raft_consensus.cc:2243] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.835041 24442 raft_consensus.cc:2272] T 849d745295ee45abb8a522d542819654 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.837092 24442 tablet_replica.cc:333] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.837711 24442 raft_consensus.cc:2243] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.838191 24442 raft_consensus.cc:2272] T f2c0c583bb864a7c91ac49bf45615523 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.840561 24442 tablet_replica.cc:333] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.841172 24442 raft_consensus.cc:2243] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.841645 24442 raft_consensus.cc:2272] T 0db16bbcbab34732ad62610122fd4ddd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.843907 24442 tablet_replica.cc:333] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.844482 24442 raft_consensus.cc:2243] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.844931 24442 raft_consensus.cc:2272] T a4179064b9784670ae3b11664ecb7205 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.847172 24442 tablet_replica.cc:333] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.847759 24442 raft_consensus.cc:2243] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.848251 24442 raft_consensus.cc:2272] T 5be4cc379dc24cf4aa09e4242241c03f P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.850479 24442 tablet_replica.cc:333] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.851320 24442 raft_consensus.cc:2243] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.852463 24442 raft_consensus.cc:2272] T a4aab3c02fcc4c58932074e364ed6a3a P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.855271 24442 tablet_replica.cc:333] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.855958 24442 raft_consensus.cc:2243] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.856813 24442 raft_consensus.cc:2272] T efe7ed2268914c5f801a07f22ed353c6 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.859079 24442 tablet_replica.cc:333] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.859643 24442 raft_consensus.cc:2243] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.860504 24442 raft_consensus.cc:2272] T cb64ed4d5ede43d7a1a18158c71fa6e9 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.862818 24442 tablet_replica.cc:333] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.863444 24442 raft_consensus.cc:2243] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:51.864352 24442 raft_consensus.cc:2272] T c29f3259972241c7bafe8cef3a1a0acd P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.866674 24442 tablet_replica.cc:333] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.867225 24442 raft_consensus.cc:2243] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.867687 24442 raft_consensus.cc:2272] T 79e5da2812114608bc846e1630ec618e P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.869854 24442 tablet_replica.cc:333] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.870456 24442 raft_consensus.cc:2243] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.870905 24442 raft_consensus.cc:2272] T 44a4a0eeeeed495daa87b1a26cd67b0c P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:51.873409 24442 tablet_replica.cc:333] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb: stopping tablet replica
I20260709 12:13:51.874086 24442 raft_consensus.cc:2243] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:51.874603 24442 raft_consensus.cc:2272] T 77a5f824f56a4e53b1594064803caed0 P 2a4ac09eaeef4bcca6392c4bc6ea97bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:52.942943 24442 tablet_server.cc:196] TabletServer@127.23.222.132:0 shutdown complete.
I20260709 12:13:53.024219 24442 master.cc:562] Master@127.23.222.190:41543 shutting down...
I20260709 12:13:53.061352 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:53.062052 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:53.062515 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P 468c04fd684147d397b43a0e496059ff: stopping tablet replica
I20260709 12:13:53.122035 24442 master.cc:584] Master@127.23.222.190:41543 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (52164 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:13:53.230720 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:36795
I20260709 12:13:53.235282 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:53.242204  1673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:53.243196  1676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:53.242355  1674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:53.246598 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:53.248237 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:53.248473 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:53.248679 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599233248661 us; error 0 us; skew 500 ppm
I20260709 12:13:53.249363 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:53.252512 24442 webserver.cc:533] Webserver started at http://127.23.222.190:34805/ using document root <none> and password file <none>
I20260709 12:13:53.253134 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:53.253360 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:53.253712 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:53.255172 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "228a8728f0f6477b84dd512826e77f38"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.260800 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:13:53.265223  1681 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.266361 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:53.266690 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "228a8728f0f6477b84dd512826e77f38"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.266952 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:53.287835 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:53.289211 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:53.340591 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:36795
I20260709 12:13:53.340831  1732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:36795 every 8 connection(s)
I20260709 12:13:53.345362  1733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:53.358245  1733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38: Bootstrap starting.
I20260709 12:13:53.364348  1733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.369581  1733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38: No bootstrap required, opened a new log
I20260709 12:13:53.372218  1733 raft_consensus.cc:359] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228a8728f0f6477b84dd512826e77f38" member_type: VOTER }
I20260709 12:13:53.372701  1733 raft_consensus.cc:385] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.372937  1733 raft_consensus.cc:740] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 228a8728f0f6477b84dd512826e77f38, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.373626  1733 consensus_queue.cc:260] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228a8728f0f6477b84dd512826e77f38" member_type: VOTER }
I20260709 12:13:53.374109  1733 raft_consensus.cc:399] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:53.374368  1733 raft_consensus.cc:493] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:53.374619  1733 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.380108  1733 raft_consensus.cc:515] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228a8728f0f6477b84dd512826e77f38" member_type: VOTER }
I20260709 12:13:53.380803  1733 leader_election.cc:304] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 228a8728f0f6477b84dd512826e77f38; no voters: 
I20260709 12:13:53.382205  1733 leader_election.cc:290] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:53.382761  1736 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.384575  1736 raft_consensus.cc:697] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 1 LEADER]: Becoming Leader. State: Replica: 228a8728f0f6477b84dd512826e77f38, State: Running, Role: LEADER
I20260709 12:13:53.385529  1736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228a8728f0f6477b84dd512826e77f38" member_type: VOTER }
I20260709 12:13:53.386076  1733 sys_catalog.cc:565] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:53.390676  1737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "228a8728f0f6477b84dd512826e77f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228a8728f0f6477b84dd512826e77f38" member_type: VOTER } }
I20260709 12:13:53.391501  1737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:53.392747  1738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 228a8728f0f6477b84dd512826e77f38. Latest consensus state: current_term: 1 leader_uuid: "228a8728f0f6477b84dd512826e77f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "228a8728f0f6477b84dd512826e77f38" member_type: VOTER } }
I20260709 12:13:53.393805  1738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:53.398448  1742 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:53.408241  1742 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:53.409745 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:53.419518  1742 catalog_manager.cc:1383] Generated new cluster ID: 36419fdee0ff4a87beeb909ae1b2b0c5
I20260709 12:13:53.419898  1742 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:53.434890  1742 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:53.436332  1742 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:53.453125  1742 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38: Generated new TSK 0
I20260709 12:13:53.453835  1742 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:53.477214 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:53.485145  1754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:53.486430  1755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:53.488758 24442 server_base.cc:1061] running on GCE node
W20260709 12:13:53.489243  1757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:53.490628 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:53.490839 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:53.490979 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599233490966 us; error 0 us; skew 500 ppm
I20260709 12:13:53.491484 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:53.494055 24442 webserver.cc:533] Webserver started at http://127.23.222.129:40271/ using document root <none> and password file <none>
I20260709 12:13:53.494670 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:53.494845 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:53.495086 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:53.496271 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "bdf0faa663d04c03950da23ddde05a88"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.501371 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:53.505149  1762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.506037 24442 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:53.506389 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "bdf0faa663d04c03950da23ddde05a88"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.506677 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:53.523872 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:53.525307 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:53.527231 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:53.529875 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:53.530063 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.530443 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:53.530612 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.583290 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:45693
I20260709 12:13:53.583417  1824 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:45693 every 8 connection(s)
I20260709 12:13:53.590224 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:53.598610  1829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:53.599298  1830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:53.601495  1832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:53.602720 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:53.604311 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:53.604588 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:53.604844 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599233604817 us; error 0 us; skew 500 ppm
I20260709 12:13:53.605516 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:53.608789 24442 webserver.cc:533] Webserver started at http://127.23.222.130:33201/ using document root <none> and password file <none>
I20260709 12:13:53.608942  1825 heartbeater.cc:344] Connected to a master server at 127.23.222.190:36795
I20260709 12:13:53.609377 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:53.609462  1825 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:53.609696 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:53.610031 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:53.610518  1825 heartbeater.cc:507] Master 127.23.222.190:36795 requested a full tablet report, sending...
I20260709 12:13:53.611313 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "dcf96fbcdce849398dc58b51bf465f80"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.612942  1698 ts_manager.cc:194] Registered new tserver with Master: bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693)
I20260709 12:13:53.614956  1698 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47864
I20260709 12:13:53.616618 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:53.620703  1837 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.621588 24442 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:53.621901 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "dcf96fbcdce849398dc58b51bf465f80"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.622218 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:53.662916 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:53.664343 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:53.666096 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:53.668949 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:53.669209 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.669476 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:53.669875 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.721541 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:41469
I20260709 12:13:53.721658  1899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:41469 every 8 connection(s)
I20260709 12:13:53.727623 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:53.736001  1903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:53.737686  1904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:53.740561  1900 heartbeater.cc:344] Connected to a master server at 127.23.222.190:36795
W20260709 12:13:53.741091  1906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:53.741125  1900 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:53.741369 24442 server_base.cc:1061] running on GCE node
I20260709 12:13:53.742515  1900 heartbeater.cc:507] Master 127.23.222.190:36795 requested a full tablet report, sending...
I20260709 12:13:53.742564 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:53.742920 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:53.743105 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599233743082 us; error 0 us; skew 500 ppm
I20260709 12:13:53.743747 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:53.745395  1698 ts_manager.cc:194] Registered new tserver with Master: dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:53.747191 24442 webserver.cc:533] Webserver started at http://127.23.222.131:42531/ using document root <none> and password file <none>
I20260709 12:13:53.747596  1698 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47870
I20260709 12:13:53.748024 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:53.748335 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:53.748694 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:53.749987 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "48a928d50d654321be894a5711d78745"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.755203 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:53.759299  1911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.760202 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:53.760564 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "48a928d50d654321be894a5711d78745"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:13:53.760931 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:53.778110 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:53.779677 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:53.781603 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:53.784252 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:53.784492 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.784893 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:53.785212 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:53.841974 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:44807
I20260709 12:13:53.842100  1973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:44807 every 8 connection(s)
I20260709 12:13:53.857615  1974 heartbeater.cc:344] Connected to a master server at 127.23.222.190:36795
I20260709 12:13:53.858109  1974 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:53.859026  1974 heartbeater.cc:507] Master 127.23.222.190:36795 requested a full tablet report, sending...
I20260709 12:13:53.861179  1698 ts_manager.cc:194] Registered new tserver with Master: 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:53.861788 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016285095s
I20260709 12:13:53.863126  1698 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47874
I20260709 12:13:53.891553  1698 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47886:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:53.895748  1698 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:53.975131  1788 tablet_service.cc:1511] Processing CreateTablet for tablet b72da64abf4940c391510a9e40849e85 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:53.976279  1789 tablet_service.cc:1511] Processing CreateTablet for tablet a31e9a1136a74e89b1053c9dd342796e (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:53.976902  1788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72da64abf4940c391510a9e40849e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:53.977823  1789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31e9a1136a74e89b1053c9dd342796e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:53.975131  1790 tablet_service.cc:1511] Processing CreateTablet for tablet 1260092d29724ffab1df5fdcb71479a2 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:53.980268  1790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1260092d29724ffab1df5fdcb71479a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:53.986953  1865 tablet_service.cc:1511] Processing CreateTablet for tablet 1260092d29724ffab1df5fdcb71479a2 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:53.988626  1865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1260092d29724ffab1df5fdcb71479a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:53.991401  1864 tablet_service.cc:1511] Processing CreateTablet for tablet a31e9a1136a74e89b1053c9dd342796e (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:53.993032  1864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31e9a1136a74e89b1053c9dd342796e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:53.995568  1863 tablet_service.cc:1511] Processing CreateTablet for tablet b72da64abf4940c391510a9e40849e85 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:53.997102  1863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72da64abf4940c391510a9e40849e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.003209  1785 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4197bc62624595bd86dd25f6c9d81e (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:54.003547  1786 tablet_service.cc:1511] Processing CreateTablet for tablet 8565d616a35a4e52b227776e3173d454 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:54.005096  1785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4197bc62624595bd86dd25f6c9d81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.006503  1862 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3d7cf2e06c4228a325cbfc6344342a (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:54.007071  1787 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3d7cf2e06c4228a325cbfc6344342a (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:54.008481  1787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3d7cf2e06c4228a325cbfc6344342a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.009210  1861 tablet_service.cc:1511] Processing CreateTablet for tablet 8565d616a35a4e52b227776e3173d454 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:54.010782  1786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8565d616a35a4e52b227776e3173d454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.011328  1784 tablet_service.cc:1511] Processing CreateTablet for tablet 08dfbefc82774d65a3ccc2b967664b55 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:54.012813  1784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dfbefc82774d65a3ccc2b967664b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.012634  1859 tablet_service.cc:1511] Processing CreateTablet for tablet 08dfbefc82774d65a3ccc2b967664b55 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:54.014190  1862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3d7cf2e06c4228a325cbfc6344342a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.011441  1860 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4197bc62624595bd86dd25f6c9d81e (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:54.019340  1860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4197bc62624595bd86dd25f6c9d81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.022059  1859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dfbefc82774d65a3ccc2b967664b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.023532  1861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8565d616a35a4e52b227776e3173d454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.053830  1936 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3d7cf2e06c4228a325cbfc6344342a (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:13:54.052554  1939 tablet_service.cc:1511] Processing CreateTablet for tablet 1260092d29724ffab1df5fdcb71479a2 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:13:54.055574  1936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3d7cf2e06c4228a325cbfc6344342a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.052554  1937 tablet_service.cc:1511] Processing CreateTablet for tablet b72da64abf4940c391510a9e40849e85 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:13:54.057119  1937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72da64abf4940c391510a9e40849e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.053716  1935 tablet_service.cc:1511] Processing CreateTablet for tablet 8565d616a35a4e52b227776e3173d454 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:13:54.050143  1938 tablet_service.cc:1511] Processing CreateTablet for tablet a31e9a1136a74e89b1053c9dd342796e (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:13:54.063235  1934 tablet_service.cc:1511] Processing CreateTablet for tablet 6c4197bc62624595bd86dd25f6c9d81e (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:13:54.066201  1935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8565d616a35a4e52b227776e3173d454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.069380  1938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a31e9a1136a74e89b1053c9dd342796e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.073554  1934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c4197bc62624595bd86dd25f6c9d81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.076046  1939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1260092d29724ffab1df5fdcb71479a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.078068  1989 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.085069  1989 tablet_bootstrap.cc:654] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.107503  1933 tablet_service.cc:1511] Processing CreateTablet for tablet 08dfbefc82774d65a3ccc2b967664b55 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:13:54.109303  1933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08dfbefc82774d65a3ccc2b967664b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.116194  1783 tablet_service.cc:1511] Processing CreateTablet for tablet 272b509bc8b84e2d96aaeadd2efcdc36 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:54.117857  1783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272b509bc8b84e2d96aaeadd2efcdc36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.132366  1863 tablet_service.cc:1511] Processing CreateTablet for tablet 272b509bc8b84e2d96aaeadd2efcdc36 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:54.134048  1863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272b509bc8b84e2d96aaeadd2efcdc36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.140890  1932 tablet_service.cc:1511] Processing CreateTablet for tablet 272b509bc8b84e2d96aaeadd2efcdc36 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:13:54.142601  1932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272b509bc8b84e2d96aaeadd2efcdc36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.163484  1786 tablet_service.cc:1511] Processing CreateTablet for tablet 93b3ecb00b7349c4bed7d7533161c1d4 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:54.168666  1865 tablet_service.cc:1511] Processing CreateTablet for tablet 93b3ecb00b7349c4bed7d7533161c1d4 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:54.170657  1786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b3ecb00b7349c4bed7d7533161c1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.173062  1931 tablet_service.cc:1511] Processing CreateTablet for tablet 93b3ecb00b7349c4bed7d7533161c1d4 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:13:54.175072  1931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b3ecb00b7349c4bed7d7533161c1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.175519  1865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b3ecb00b7349c4bed7d7533161c1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.182780  1789 tablet_service.cc:1511] Processing CreateTablet for tablet e026292bdd6e4a3bada4da4c4376b496 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:54.184391  1789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e026292bdd6e4a3bada4da4c4376b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.190055  1989 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.206063  1989 ts_tablet_manager.cc:1403] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.128s	user 0.023s	sys 0.007s
I20260709 12:13:54.198926  1991 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.203542  1930 tablet_service.cc:1511] Processing CreateTablet for tablet e026292bdd6e4a3bada4da4c4376b496 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:54.207805  1861 tablet_service.cc:1511] Processing CreateTablet for tablet e026292bdd6e4a3bada4da4c4376b496 (DEFAULT_TABLE table=test-workload [id=a36746cfc7014d9dac83fb413a6fea13]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:13:54.211660  1930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e026292bdd6e4a3bada4da4c4376b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.212484  1861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e026292bdd6e4a3bada4da4c4376b496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:54.222836  1992 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.238885  1989 raft_consensus.cc:359] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.250484  1989 raft_consensus.cc:385] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.250988  1989 raft_consensus.cc:740] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.252893  1992 tablet_bootstrap.cc:654] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.260910  1989 consensus_queue.cc:260] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.268683  1991 tablet_bootstrap.cc:654] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.277129  1989 ts_tablet_manager.cc:1434] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 12:13:54.278523  1900 heartbeater.cc:499] Master 127.23.222.190:36795 was elected leader, sending a full tablet report...
I20260709 12:13:54.280604  1989 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.283067  1992 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.283708  1992 ts_tablet_manager.cc:1403] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.020s
I20260709 12:13:54.285733  1991 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.286549  1991 ts_tablet_manager.cc:1403] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.007s
I20260709 12:13:54.286965  1992 raft_consensus.cc:359] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.287894  1992 raft_consensus.cc:385] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.288106  1989 tablet_bootstrap.cc:654] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.288208  1992 raft_consensus.cc:740] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.289410  1992 consensus_queue.cc:260] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.289906  1991 raft_consensus.cc:359] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.290789  1991 raft_consensus.cc:385] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.291121  1991 raft_consensus.cc:740] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.292196  1991 consensus_queue.cc:260] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.304282  1991 ts_tablet_manager.cc:1434] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 12:13:54.305382  1825 heartbeater.cc:499] Master 127.23.222.190:36795 was elected leader, sending a full tablet report...
I20260709 12:13:54.306180  1991 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.322654  1991 tablet_bootstrap.cc:654] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.338176  1974 heartbeater.cc:499] Master 127.23.222.190:36795 was elected leader, sending a full tablet report...
W20260709 12:13:54.339408  1826 tablet.cc:2406] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:54.339984  1992 ts_tablet_manager.cc:1434] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.056s	user 0.046s	sys 0.008s
I20260709 12:13:54.341441  1992 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.349205  1989 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.350025  1989 ts_tablet_manager.cc:1403] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.070s	user 0.030s	sys 0.030s
I20260709 12:13:54.350203  1992 tablet_bootstrap.cc:654] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.352749  1991 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.353374  1991 ts_tablet_manager.cc:1403] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.014s
I20260709 12:13:54.354031  1989 raft_consensus.cc:359] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.355002  1989 raft_consensus.cc:385] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.355348  1989 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.356930  1991 raft_consensus.cc:359] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.356787  1989 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.357841  1991 raft_consensus.cc:385] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.359771  1989 ts_tablet_manager.cc:1434] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:13:54.363474  1989 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.358170  1991 raft_consensus.cc:740] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.366598  1991 consensus_queue.cc:260] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.369887  1991 ts_tablet_manager.cc:1434] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 12:13:54.371475  1991 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.379578  1991 tablet_bootstrap.cc:654] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.385998  1989 tablet_bootstrap.cc:654] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.395457  1991 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.396178  1991 ts_tablet_manager.cc:1403] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 12:13:54.399042  1991 raft_consensus.cc:359] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.399679  1991 raft_consensus.cc:385] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.399941  1991 raft_consensus.cc:740] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.395457  1992 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.401160  1992 ts_tablet_manager.cc:1403] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.028s
W20260709 12:13:54.402033  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:54.402536  1991 consensus_queue.cc:260] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.404100  1992 raft_consensus.cc:359] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.404903  1992 raft_consensus.cc:385] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.405230  1992 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.406383  1991 ts_tablet_manager.cc:1434] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:54.406180  1992 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.407666  1991 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.408654  1992 ts_tablet_manager.cc:1434] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:54.411103  1992 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.414637  1989 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.415319  1989 ts_tablet_manager.cc:1403] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.013s
I20260709 12:13:54.420977  1991 tablet_bootstrap.cc:654] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.421577  1992 tablet_bootstrap.cc:654] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.422245  1989 raft_consensus.cc:359] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.423110  1989 raft_consensus.cc:385] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.423525  1989 raft_consensus.cc:740] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.424467  1989 consensus_queue.cc:260] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.426898  1989 ts_tablet_manager.cc:1434] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:13:54.428325  1989 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.429495  1992 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.430061  1991 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.430131  1992 ts_tablet_manager.cc:1403] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 12:13:54.430790  1991 ts_tablet_manager.cc:1403] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 12:13:54.434367  1992 raft_consensus.cc:359] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.435359  1992 raft_consensus.cc:385] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.434993  1991 raft_consensus.cc:359] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.435760  1992 raft_consensus.cc:740] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.435873  1991 raft_consensus.cc:385] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.436308  1991 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.436789  1989 tablet_bootstrap.cc:654] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.436848  1992 consensus_queue.cc:260] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.437327  1991 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.439807  1992 ts_tablet_manager.cc:1434] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:54.441273  1992 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.447166  1991 ts_tablet_manager.cc:1434] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:13:54.449342  1991 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.450508  1992 tablet_bootstrap.cc:654] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.459592  1991 tablet_bootstrap.cc:654] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.463452  1992 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.464054  1992 ts_tablet_manager.cc:1403] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 12:13:54.468309  1992 raft_consensus.cc:359] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.469129  1992 raft_consensus.cc:385] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.469439  1992 raft_consensus.cc:740] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.470371  1992 consensus_queue.cc:260] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.472936  1992 ts_tablet_manager.cc:1434] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:13:54.474059  1991 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.474423  1992 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.474992  1991 ts_tablet_manager.cc:1403] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.006s
I20260709 12:13:54.479923  1991 raft_consensus.cc:359] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.481221  1991 raft_consensus.cc:385] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.481765  1991 raft_consensus.cc:740] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.483028  1991 consensus_queue.cc:260] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.483631  1996 raft_consensus.cc:493] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.484537  1996 raft_consensus.cc:515] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.485247  1991 ts_tablet_manager.cc:1434] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:54.486429  1991 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.490594  1996 leader_election.cc:290] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:54.494459  1991 tablet_bootstrap.cc:654] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.496513  1993 raft_consensus.cc:493] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.497313  1993 raft_consensus.cc:515] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.498027  1989 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.498835  1989 ts_tablet_manager.cc:1403] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.023s
I20260709 12:13:54.500037  1992 tablet_bootstrap.cc:654] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.505609  1989 raft_consensus.cc:359] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.507009  1989 raft_consensus.cc:385] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.507478  1989 raft_consensus.cc:740] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.508950  1989 consensus_queue.cc:260] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.509585  1993 leader_election.cc:290] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.513343  1991 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.514176  1991 ts_tablet_manager.cc:1403] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 12:13:54.518304  1991 raft_consensus.cc:359] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.519109  1991 raft_consensus.cc:385] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.519421  1991 raft_consensus.cc:740] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.519596  1989 ts_tablet_manager.cc:1434] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.009s
I20260709 12:13:54.520350  1991 consensus_queue.cc:260] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.520967  1989 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.523279  1991 ts_tablet_manager.cc:1434] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:13:54.524663  1991 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.529788  1989 tablet_bootstrap.cc:654] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.532084  1991 tablet_bootstrap.cc:654] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.547942  1989 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.548627  1989 ts_tablet_manager.cc:1403] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.001s
I20260709 12:13:54.560319  1991 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.561076  1991 ts_tablet_manager.cc:1403] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.000s
I20260709 12:13:54.564584  1991 raft_consensus.cc:359] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.565328  1991 raft_consensus.cc:385] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.565681  1991 raft_consensus.cc:740] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.566205  1989 raft_consensus.cc:359] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.568104  2015 raft_consensus.cc:493] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.568688  2015 raft_consensus.cc:515] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.571348  2015 leader_election.cc:290] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.567082  1989 raft_consensus.cc:385] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.573762  1989 raft_consensus.cc:740] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.573688  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:54.574424  1799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:54.574844  1800 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:54.575150  1799 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:54.575038  1989 consensus_queue.cc:260] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.576625  1799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:54.577275  1799 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 0.
I20260709 12:13:54.578109  1989 ts_tablet_manager.cc:1434] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 12:13:54.579279  1913 leader_election.cc:304] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:13:54.579145  1991 consensus_queue.cc:260] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.579310  1989 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.582754  1992 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.583146  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:54.583952  1996 raft_consensus.cc:2804] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.584033  1875 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 0.
I20260709 12:13:54.584244  1991 ts_tablet_manager.cc:1434] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:13:54.584592  1996 raft_consensus.cc:493] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.585229  1996 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.586351  1991 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.589936  1989 tablet_bootstrap.cc:654] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.583415  1992 ts_tablet_manager.cc:1403] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.024s
I20260709 12:13:54.580859  1839 leader_election.cc:304] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.593611  2015 raft_consensus.cc:2804] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.593833  1839 leader_election.cc:304] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.594226  2015 raft_consensus.cc:493] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.594733  2015 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.593566  1992 raft_consensus.cc:359] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.595417  1998 raft_consensus.cc:493] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.597823  1991 tablet_bootstrap.cc:654] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.599632  1998 raft_consensus.cc:515] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.601887  1993 raft_consensus.cc:2804] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.602540  1993 raft_consensus.cc:493] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.602944  1993 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.608978  1998 leader_election.cc:290] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.609869  2015 raft_consensus.cc:515] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.620923  1992 raft_consensus.cc:385] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.621397  1992 raft_consensus.cc:740] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.622607  1992 consensus_queue.cc:260] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.623709  2015 leader_election.cc:290] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.623477  1799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:54.624552  1799 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.628111  1996 raft_consensus.cc:515] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.632063  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:54.632752  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:54.633945  1875 raft_consensus.cc:2393] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48a928d50d654321be894a5711d78745 in current term 1: Already voted for candidate dcf96fbcdce849398dc58b51bf465f80 in this term.
I20260709 12:13:54.639799  1913 leader_election.cc:304] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48a928d50d654321be894a5711d78745; no voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:54.644593  1996 leader_election.cc:290] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:54.650300  1996 raft_consensus.cc:2749] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.652683  1993 raft_consensus.cc:515] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.657142  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:54.658154  1800 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.664830  1993 leader_election.cc:290] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.666082  1992 ts_tablet_manager.cc:1434] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.002s
I20260709 12:13:54.666801  1799 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:54.667644  1992 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.668349  1839 leader_election.cc:304] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.669812  1993 raft_consensus.cc:2804] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.671267  1993 raft_consensus.cc:697] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:54.672186  1993 consensus_queue.cc:237] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.678809  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.680267  1949 raft_consensus.cc:2393] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcf96fbcdce849398dc58b51bf465f80 in current term 1: Already voted for candidate 48a928d50d654321be894a5711d78745 in this term.
I20260709 12:13:54.685201  1948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.686560  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:54.686789  1947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:54.689411  1947 raft_consensus.cc:2393] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dcf96fbcdce849398dc58b51bf465f80 in current term 1: Already voted for candidate 48a928d50d654321be894a5711d78745 in this term.
I20260709 12:13:54.687441  1946 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:54.691022  1765 leader_election.cc:343] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a928d50d654321be894a5711d78745 (127.23.222.131:44807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.698403  1800 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:54.700205  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.700544  1839 leader_election.cc:304] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.701817  1989 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.704070  1989 ts_tablet_manager.cc:1403] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.009s
I20260709 12:13:54.705140  1992 tablet_bootstrap.cc:654] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.706456  2015 raft_consensus.cc:493] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.707145  2015 raft_consensus.cc:515] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.709179  1991 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.709818  1991 ts_tablet_manager.cc:1403] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.124s	user 0.031s	sys 0.075s
I20260709 12:13:54.711169  1695 catalog_manager.cc:5697] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.712946  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:54.713325  1991 raft_consensus.cc:359] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.714097  1991 raft_consensus.cc:385] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.713904  1875 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 0.
I20260709 12:13:54.714449  1991 raft_consensus.cc:740] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.715265  1991 consensus_queue.cc:260] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.716233  1763 leader_election.cc:304] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 48a928d50d654321be894a5711d78745
I20260709 12:13:54.715262  1993 raft_consensus.cc:2804] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.718024  1991 ts_tablet_manager.cc:1434] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:13:54.719334  1991 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.719481  1998 raft_consensus.cc:2804] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.720224  2015 leader_election.cc:290] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.720363  1998 raft_consensus.cc:493] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.721010  1998 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.720808  1989 raft_consensus.cc:359] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.721632  1989 raft_consensus.cc:385] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.721949  1989 raft_consensus.cc:740] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.723398  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.723729  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:54.725092  1989 consensus_queue.cc:260] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.728579  1989 ts_tablet_manager.cc:1434] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:13:54.730072  1992 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
W20260709 12:13:54.730945  1840 leader_election.cc:343] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a928d50d654321be894a5711d78745 (127.23.222.131:44807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.732872  1992 ts_tablet_manager.cc:1403] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.011s
I20260709 12:13:54.735333  1991 tablet_bootstrap.cc:654] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.737144  1992 raft_consensus.cc:359] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.737965  1992 raft_consensus.cc:385] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.747548  1991 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.748942  1998 raft_consensus.cc:515] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.749114  1989 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.751983  1991 ts_tablet_manager.cc:1403] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 12:13:54.755630  1800 raft_consensus.cc:2393] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcf96fbcdce849398dc58b51bf465f80 in current term 1: Already voted for candidate bdf0faa663d04c03950da23ddde05a88 in this term.
I20260709 12:13:54.755350  1991 raft_consensus.cc:359] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.756119  1991 raft_consensus.cc:385] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.756423  1991 raft_consensus.cc:740] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.757256  1998 leader_election.cc:290] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Requested vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.757978  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:54.757791  1991 consensus_queue.cc:260] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.758770  1875 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.759027  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:54.760697  1991 ts_tablet_manager.cc:1434] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:54.750995  1946 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:54.760190  1839 leader_election.cc:304] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcf96fbcdce849398dc58b51bf465f80; no voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:54.762699  1989 tablet_bootstrap.cc:654] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.750083  1993 raft_consensus.cc:697] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:54.766386  1993 consensus_queue.cc:237] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.767417  1991 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:13:54.751582  1992 raft_consensus.cc:740] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.769006  1992 consensus_queue.cc:260] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.769960  1949 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.771611  1875 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 1.
I20260709 12:13:54.772400  2029 raft_consensus.cc:2749] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.777293  1763 leader_election.cc:304] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.778707  1998 raft_consensus.cc:2804] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.780403  1998 raft_consensus.cc:697] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 LEADER]: Becoming Leader. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Running, Role: LEADER
I20260709 12:13:54.780617  1991 tablet_bootstrap.cc:654] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.782406  1998 consensus_queue.cc:237] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.783605  1949 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 1.
I20260709 12:13:54.790946  2033 raft_consensus.cc:493] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.791703  2033 raft_consensus.cc:515] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.795274  2033 leader_election.cc:290] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.796151  2033 raft_consensus.cc:493] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.796356  1992 ts_tablet_manager.cc:1434] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.006s
I20260709 12:13:54.796670  2033 raft_consensus.cc:515] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.798913  2033 leader_election.cc:290] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.799921  1874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dfbefc82774d65a3ccc2b967664b55" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:54.800601  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dfbefc82774d65a3ccc2b967664b55" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.802454  1992 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
W20260709 12:13:54.802534  1765 leader_election.cc:343] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a928d50d654321be894a5711d78745 (127.23.222.131:44807): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:54.803396  1763 leader_election.cc:343] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.803884  1763 leader_election.cc:304] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88; no voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:54.806133  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
W20260709 12:13:54.809267  1763 leader_election.cc:343] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.810490  2033 raft_consensus.cc:2749] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.811159  1992 tablet_bootstrap.cc:654] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.813618  1989 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:54.814289  1989 ts_tablet_manager.cc:1403] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.000s
I20260709 12:13:54.817914  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.824463  1949 raft_consensus.cc:2468] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 0.
I20260709 12:13:54.826570  1765 leader_election.cc:304] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:54.828819  2037 raft_consensus.cc:2804] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.829516  2037 raft_consensus.cc:493] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.830065  2037 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.833711  1695 catalog_manager.cc:5697] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.839079  1989 raft_consensus.cc:359] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.840541  1989 raft_consensus.cc:385] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.844712  1991 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: No bootstrap required, opened a new log
I20260709 12:13:54.845327  1991 ts_tablet_manager.cc:1403] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.078s	user 0.051s	sys 0.013s
I20260709 12:13:54.844537  1696 catalog_manager.cc:5697] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf0faa663d04c03950da23ddde05a88 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "bdf0faa663d04c03950da23ddde05a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.848562  1991 raft_consensus.cc:359] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.849318  1991 raft_consensus.cc:385] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.849604  1991 raft_consensus.cc:740] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.850589  1991 consensus_queue.cc:260] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.841003  1989 raft_consensus.cc:740] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.852811  1991 ts_tablet_manager.cc:1434] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 12:13:54.852811  2037 raft_consensus.cc:515] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.852463  1989 consensus_queue.cc:260] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.856995  2037 leader_election.cc:290] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Requested vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.857028  1992 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.857950  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:54.858188  1992 ts_tablet_manager.cc:1403] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.020s
I20260709 12:13:54.859620  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:54.860327  1949 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.861903  1992 raft_consensus.cc:359] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.862891  1992 raft_consensus.cc:385] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.863204  1992 raft_consensus.cc:740] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
W20260709 12:13:54.863742  1763 leader_election.cc:343] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.864092  1992 consensus_queue.cc:260] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.865078  1993 raft_consensus.cc:493] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.865613  1993 raft_consensus.cc:515] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.866732  1992 ts_tablet_manager.cc:1434] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:54.867930  1992 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.869583  1993 leader_election.cc:290] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.869840  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:54.870671  1800 raft_consensus.cc:2468] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:54.871112  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.872138  1946 raft_consensus.cc:2468] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:54.873795  1840 leader_election.cc:304] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.875344  1992 tablet_bootstrap.cc:654] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.875826  1993 raft_consensus.cc:2804] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.876317  1993 raft_consensus.cc:493] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.876703  1993 raft_consensus.cc:3060] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.882019  1949 raft_consensus.cc:2468] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 1.
I20260709 12:13:54.883625  1765 leader_election.cc:304] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:54.884172  1989 ts_tablet_manager.cc:1434] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 12:13:54.885006  2037 raft_consensus.cc:2804] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.885589  2037 raft_consensus.cc:697] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 LEADER]: Becoming Leader. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Running, Role: LEADER
I20260709 12:13:54.885931  1989 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:54.886544  2037 consensus_queue.cc:237] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.887981  1998 raft_consensus.cc:493] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.894805  1998 raft_consensus.cc:515] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.896576  1992 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.897193  1992 ts_tablet_manager.cc:1403] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.017s
I20260709 12:13:54.898310  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b3ecb00b7349c4bed7d7533161c1d4" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
W20260709 12:13:54.899943  1763 leader_election.cc:343] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.900184  1992 raft_consensus.cc:359] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.900485  1998 leader_election.cc:290] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.891917  1993 raft_consensus.cc:515] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.901033  2024 raft_consensus.cc:493] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.901332  1992 raft_consensus.cc:385] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.901667  1992 raft_consensus.cc:740] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.901664  2024 raft_consensus.cc:515] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.902788  1992 consensus_queue.cc:260] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.900009  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b3ecb00b7349c4bed7d7533161c1d4" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.904678  1998 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.905220  1998 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
W20260709 12:13:54.905380  1765 leader_election.cc:343] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a928d50d654321be894a5711d78745 (127.23.222.131:44807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.905417  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:54.906037  1765 leader_election.cc:304] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88; no voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:54.906289  1875 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 0.
I20260709 12:13:54.906306  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:54.907203  1800 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 0.
I20260709 12:13:54.907338  2033 raft_consensus.cc:2749] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.907495  1998 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.907858  1993 leader_election.cc:290] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.909015  1799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:54.909610  1992 ts_tablet_manager.cc:1434] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:13:54.909329  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:54.910466  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:54.911046  1992 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.911579  1912 leader_election.cc:304] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.912721  2025 raft_consensus.cc:2804] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.913130  2025 raft_consensus.cc:493] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.913440  2025 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.911072  1946 raft_consensus.cc:3060] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.919255  1992 tablet_bootstrap.cc:654] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.909623  1799 raft_consensus.cc:3060] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.923678  1989 tablet_bootstrap.cc:654] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.924300  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:54.925222  1875 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 0.
I20260709 12:13:54.926119  2024 leader_election.cc:290] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:54.910965  1949 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 0.
I20260709 12:13:54.936780  1992 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.937695  1992 ts_tablet_manager.cc:1403] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 12:13:54.939679  2025 raft_consensus.cc:515] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.930521  1763 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.941172  2033 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.941633  2033 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.942010  2033 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.942351  1992 raft_consensus.cc:359] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.943192  1992 raft_consensus.cc:385] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.943490  1992 raft_consensus.cc:740] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.943607  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:54.944253  1992 consensus_queue.cc:260] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.944273  1875 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.946758  1992 ts_tablet_manager.cc:1434] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:13:54.947908  1992 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: Bootstrap starting.
I20260709 12:13:54.951349  2033 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.955323  1992 tablet_bootstrap.cc:654] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.955711  1874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:54.956544  1874 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.963099  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:54.963984  1800 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.964924  1799 raft_consensus.cc:2468] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:54.966984  1946 raft_consensus.cc:2468] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:54.969964  1874 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 1.
I20260709 12:13:54.970218  1840 leader_election.cc:304] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.971666  1993 raft_consensus.cc:2804] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.971858  1763 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:54.972402  1993 raft_consensus.cc:697] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:54.973309  1998 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.973731  1993 consensus_queue.cc:237] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:54.987210  1998 raft_consensus.cc:697] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 LEADER]: Becoming Leader. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Running, Role: LEADER
I20260709 12:13:54.988478  1992 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: No bootstrap required, opened a new log
I20260709 12:13:54.989321  1992 ts_tablet_manager.cc:1403] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.012s
I20260709 12:13:54.987248  2025 leader_election.cc:290] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:54.988349  1875 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 1.
I20260709 12:13:54.994184  2033 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 election: Requested vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:54.995548  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:54.996984  1946 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.998752  1696 catalog_manager.cc:5697] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf0faa663d04c03950da23ddde05a88 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "bdf0faa663d04c03950da23ddde05a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.988469  1998 consensus_queue.cc:237] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.000556  1695 catalog_manager.cc:5697] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.018074  2033 raft_consensus.cc:493] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.018921  2033 raft_consensus.cc:515] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.022503  1912 leader_election.cc:304] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:55.024008  2025 raft_consensus.cc:2804] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.024731  2025 raft_consensus.cc:697] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:13:55.026573  2033 leader_election.cc:290] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:55.028986  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:55.026046  2025 consensus_queue.cc:237] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.029840  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "bdf0faa663d04c03950da23ddde05a88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:55.033730  1946 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf0faa663d04c03950da23ddde05a88 in term 1.
I20260709 12:13:55.035763  1800 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 1.
W20260709 12:13:55.036628  1765 leader_election.cc:343] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a928d50d654321be894a5711d78745 (127.23.222.131:44807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.039498  1992 raft_consensus.cc:359] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.040313  1992 raft_consensus.cc:385] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.040601  1992 raft_consensus.cc:740] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Initialized, Role: FOLLOWER
W20260709 12:13:55.041571  1763 leader_election.cc:343] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.041352  1992 consensus_queue.cc:260] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.042153  1763 leader_election.cc:304] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88; no voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:55.043691  1992 ts_tablet_manager.cc:1434] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.002s
I20260709 12:13:55.043649  1998 raft_consensus.cc:2749] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.046806  1989 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:55.047384  1989 ts_tablet_manager.cc:1403] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.162s	user 0.036s	sys 0.037s
I20260709 12:13:55.046535  1696 catalog_manager.cc:5697] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf0faa663d04c03950da23ddde05a88 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "bdf0faa663d04c03950da23ddde05a88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.048079  1697 catalog_manager.cc:5697] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.050540  1989 raft_consensus.cc:359] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.051280  1989 raft_consensus.cc:385] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.051554  1989 raft_consensus.cc:740] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.052314  1989 consensus_queue.cc:260] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.054701  1989 ts_tablet_manager.cc:1434] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:55.055927  1989 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:55.063520  1989 tablet_bootstrap.cc:654] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.068797  1989 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:55.069464  1989 ts_tablet_manager.cc:1403] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:13:55.072397  1989 raft_consensus.cc:359] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.073136  1989 raft_consensus.cc:385] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.073421  1989 raft_consensus.cc:740] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.074187  1989 consensus_queue.cc:260] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.076483  1989 ts_tablet_manager.cc:1434] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:55.077606  1989 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80: Bootstrap starting.
I20260709 12:13:55.082969  1989 tablet_bootstrap.cc:654] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.087440  1989 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80: No bootstrap required, opened a new log
I20260709 12:13:55.087904  1989 ts_tablet_manager.cc:1403] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:55.089960  1989 raft_consensus.cc:359] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.090515  1989 raft_consensus.cc:385] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.090705  1989 raft_consensus.cc:740] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.091189  1989 consensus_queue.cc:260] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.093140  1989 ts_tablet_manager.cc:1434] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:13:55.107137  2025 raft_consensus.cc:493] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.107930  2025 raft_consensus.cc:515] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.110734  2025 leader_election.cc:290] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:55.110500  1993 consensus_queue.cc:1048] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.111124  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b3ecb00b7349c4bed7d7533161c1d4" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:55.111375  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b3ecb00b7349c4bed7d7533161c1d4" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:55.111943  1800 raft_consensus.cc:2468] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 0.
I20260709 12:13:55.112007  1875 raft_consensus.cc:2468] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 0.
I20260709 12:13:55.113402  1913 leader_election.cc:304] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:55.114279  2025 raft_consensus.cc:2804] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.114670  2025 raft_consensus.cc:493] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.115181  2025 raft_consensus.cc:3060] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.123720  2025 raft_consensus.cc:515] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.128449  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b3ecb00b7349c4bed7d7533161c1d4" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:55.128651  2025 leader_election.cc:290] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:55.130281  1993 raft_consensus.cc:493] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.129129  1800 raft_consensus.cc:3060] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.130831  1993 raft_consensus.cc:515] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.133242  1993 leader_election.cc:290] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:55.130856  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b3ecb00b7349c4bed7d7533161c1d4" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:55.134728  1875 raft_consensus.cc:3060] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.135919  1799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dfbefc82774d65a3ccc2b967664b55" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:55.136650  1799 raft_consensus.cc:2468] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:55.137990  1839 leader_election.cc:304] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:55.138666  2029 consensus_queue.cc:1048] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.139654  2015 raft_consensus.cc:2804] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.139906  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dfbefc82774d65a3ccc2b967664b55" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:55.140159  2015 raft_consensus.cc:493] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.140583  2015 raft_consensus.cc:3060] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.140672  1946 raft_consensus.cc:2468] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:55.141961  1800 raft_consensus.cc:2468] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 1.
I20260709 12:13:55.143342  1913 leader_election.cc:304] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:13:55.147699  1875 raft_consensus.cc:2468] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 1.
I20260709 12:13:55.150635  2025 raft_consensus.cc:2804] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.151157  2015 raft_consensus.cc:515] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.152750  2025 raft_consensus.cc:697] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:13:55.153769  2025 consensus_queue.cc:237] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.156177  1799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dfbefc82774d65a3ccc2b967664b55" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:55.157279  1799 raft_consensus.cc:3060] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.159710  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08dfbefc82774d65a3ccc2b967664b55" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:55.160485  1946 raft_consensus.cc:3060] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.165578  1696 catalog_manager.cc:5697] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.168519  1799 raft_consensus.cc:2468] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:55.169304  1946 raft_consensus.cc:2468] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:55.169126  2015 leader_election.cc:290] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:55.170500  1840 leader_election.cc:304] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:55.172047  2015 raft_consensus.cc:2804] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.172554  2029 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.173322  2015 raft_consensus.cc:697] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:55.174775  2015 consensus_queue.cc:237] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.188012  2015 raft_consensus.cc:493] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.188763  2015 raft_consensus.cc:515] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.188871  1697 catalog_manager.cc:5697] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.192842  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:55.193840  1993 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.194633  2015 leader_election.cc:290] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:55.196545  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:55.197490  1946 raft_consensus.cc:2393] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcf96fbcdce849398dc58b51bf465f80 in current term 1: Already voted for candidate bdf0faa663d04c03950da23ddde05a88 in this term.
I20260709 12:13:55.198679  1840 leader_election.cc:304] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcf96fbcdce849398dc58b51bf465f80; no voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:55.200688  2015 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.213068  2015 raft_consensus.cc:2749] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.276000  1993 raft_consensus.cc:493] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.276614  1993 raft_consensus.cc:515] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.278669  1993 leader_election.cc:290] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:55.279651  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88" is_pre_election: true
I20260709 12:13:55.279934  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:55.280385  1800 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:55.280628  1949 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 0.
I20260709 12:13:55.281512  1839 leader_election.cc:304] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:55.282444  1993 raft_consensus.cc:2804] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.282861  1993 raft_consensus.cc:493] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.283128  1993 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.289546  1993 raft_consensus.cc:515] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.291433  1993 leader_election.cc:290] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:55.292819  1800 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:13:55.292805  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:55.293781  1800 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.293817  1949 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.303205  1800 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:55.303205  1949 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:55.304857  1840 leader_election.cc:304] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:55.305701  1993 raft_consensus.cc:2804] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.306309  1993 raft_consensus.cc:697] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:55.307425  1993 consensus_queue.cc:237] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:55.310585  1998 consensus_queue.cc:1048] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.317823  1697 catalog_manager.cc:5697] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.321697  2033 consensus_queue.cc:1048] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.328339  2037 consensus_queue.cc:1048] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.340482  2045 consensus_queue.cc:1048] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.383975  2045 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.396783  2045 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.426980 24442 ts_manager.cc:295] Set tserver state for bdf0faa663d04c03950da23ddde05a88 to MAINTENANCE_MODE
I20260709 12:13:55.427901 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
I20260709 12:13:55.451864 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:55.452667 24442 tablet_replica.cc:333] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.453532 24442 raft_consensus.cc:2243] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.453981 24442 raft_consensus.cc:2272] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.454975  2025 consensus_queue.cc:1048] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.456197 24442 tablet_replica.cc:333] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.457072 24442 raft_consensus.cc:2243] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.457479 24442 raft_consensus.cc:2272] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.459892 24442 tablet_replica.cc:333] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.460716 24442 raft_consensus.cc:2243] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.461220 24442 raft_consensus.cc:2272] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.464210 24442 tablet_replica.cc:333] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.465063 24442 raft_consensus.cc:2243] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:55.465523  1913 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 159 similar messages]
I20260709 12:13:55.466238 24442 raft_consensus.cc:2272] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.471241 24442 tablet_replica.cc:333] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.472144 24442 raft_consensus.cc:2243] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.473358 24442 raft_consensus.cc:2272] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.477933 24442 tablet_replica.cc:333] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.479027 24442 raft_consensus.cc:2243] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:55.480335 24442 raft_consensus.cc:2272] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.482527  1913 consensus_peers.cc:597] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.483733 24442 tablet_replica.cc:333] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.484527 24442 raft_consensus.cc:2243] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.485110 24442 raft_consensus.cc:2272] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.487066  1993 consensus_queue.cc:1048] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.488628 24442 tablet_replica.cc:333] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.489403 24442 raft_consensus.cc:2243] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.489877 24442 raft_consensus.cc:2272] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.493327 24442 tablet_replica.cc:333] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.494009 24442 raft_consensus.cc:2243] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.494841 24442 raft_consensus.cc:2272] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:55.497509 24442 tablet_replica.cc:333] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: stopping tablet replica
I20260709 12:13:55.498296 24442 raft_consensus.cc:2243] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:55.498837 24442 raft_consensus.cc:2272] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:55.509449  1839 consensus_peers.cc:597] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.531153 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
I20260709 12:13:55.589316  2070 consensus_queue.cc:1048] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:55.603686  1839 consensus_peers.cc:597] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.611091  1913 consensus_peers.cc:597] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.669605  2015 consensus_queue.cc:1048] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:55.699154  1839 consensus_peers.cc:597] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.758906  2015 consensus_queue.cc:1048] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:55.765780  1839 consensus_peers.cc:597] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:55.774132  1839 consensus_peers.cc:597] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:56.420794  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:56.826190  2059 raft_consensus.cc:493] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.827236  2059 raft_consensus.cc:515] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.829612  2059 leader_election.cc:290] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:56.831379  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:56.832584  1949 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
W20260709 12:13:56.834111  1839 leader_election.cc:336] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.834928  1840 leader_election.cc:304] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:56.835649  2059 raft_consensus.cc:2804] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.835986  2059 raft_consensus.cc:493] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.836254  2059 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.841481  1993 raft_consensus.cc:493] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.842305  1993 raft_consensus.cc:515] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.844535  1993 leader_election.cc:290] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:56.845906  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:56.846410  2059 raft_consensus.cc:515] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.846982  1949 raft_consensus.cc:2468] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:56.848287  1840 leader_election.cc:304] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:56.848711  2059 leader_election.cc:290] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:56.849104  1993 raft_consensus.cc:2804] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:13:56.849192  1839 leader_election.cc:336] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.849891  1993 raft_consensus.cc:493] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.850366  1993 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.850244  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:56.850996  1949 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:56.851938  1839 leader_election.cc:336] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.862591  1949 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 2.
I20260709 12:13:56.862591  1993 raft_consensus.cc:515] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.864598  1840 leader_election.cc:304] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:56.865360  1993 leader_election.cc:290] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:56.865957  2059 raft_consensus.cc:2804] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.867314  2059 raft_consensus.cc:697] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:56.868438  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:56.868611  2059 consensus_queue.cc:237] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.869225  1949 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:56.871532  1839 leader_election.cc:336] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.877612  1949 raft_consensus.cc:2468] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 2.
I20260709 12:13:56.878888  1840 leader_election.cc:304] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:56.879671  2059 raft_consensus.cc:2804] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:56.879202  1697 catalog_manager.cc:5697] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 1 to 2, leader changed from bdf0faa663d04c03950da23ddde05a88 (127.23.222.129) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.880240  2059 raft_consensus.cc:697] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:13:56.881249  2059 consensus_queue.cc:237] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.897284  2059 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.898115  2059 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.900249  2059 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:56.901183  1996 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.902070  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:56.902060  1996 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.902063  1697 catalog_manager.cc:5697] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 1 to 2, leader changed from bdf0faa663d04c03950da23ddde05a88 (127.23.222.129) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:56.905966  1839 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.907665  1949 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 1.
I20260709 12:13:56.908059  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:56.908514  1996 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:56.908816  1875 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 1.
I20260709 12:13:56.909941  1840 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:56.911005  2059 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.911384  2059 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.911617  1912 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:56.912047  2059 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:56.912451  1913 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.912631  1996 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:56.913051  1996 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdf0faa663d04c03950da23ddde05a88)
I20260709 12:13:56.913406  1996 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:56.922220  1996 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.922416  2059 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:56.924822  1996 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:56.925486  2059 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:13:56.925824  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:56.926525  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:13:56.926833  1875 raft_consensus.cc:2393] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48a928d50d654321be894a5711d78745 in current term 2: Already voted for candidate dcf96fbcdce849398dc58b51bf465f80 in this term.
I20260709 12:13:56.927392  1949 raft_consensus.cc:2393] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dcf96fbcdce849398dc58b51bf465f80 in current term 2: Already voted for candidate 48a928d50d654321be894a5711d78745 in this term.
W20260709 12:13:56.929466  1839 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.929863  1839 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcf96fbcdce849398dc58b51bf465f80; no voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88
W20260709 12:13:56.929948  1913 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:56.930477  1913 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48a928d50d654321be894a5711d78745; no voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80
I20260709 12:13:56.930652  2059 raft_consensus.cc:2749] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.931205  1996 raft_consensus.cc:2749] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:57.395466  1949 raft_consensus.cc:1275] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.397433  2059 consensus_queue.cc:1048] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:57.402415  1839 consensus_peers.cc:597] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:57.422004  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:57.428156  1839 consensus_peers.cc:597] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.478032  1949 raft_consensus.cc:1275] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:57.479668  2059 consensus_queue.cc:1048] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:57.797628  1913 consensus_peers.cc:597] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.874838  1913 consensus_peers.cc:597] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:57.977432  1839 consensus_peers.cc:597] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.036274  1839 consensus_peers.cc:597] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.089174  1839 consensus_peers.cc:597] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.325884  1839 consensus_peers.cc:597] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:58.423159  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:58.470532  1839 consensus_peers.cc:597] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:58.659844  1996 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.660372  1996 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:58.662247  1996 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:58.662349  2059 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.663658  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80" is_pre_election: true
I20260709 12:13:58.663081  2059 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:58.664749  1875 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:13:58.666040  1912 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:13:58.665975  2059 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
W20260709 12:13:58.666779  1913 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:58.667204  1996 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:58.667670  1996 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.668597  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48a928d50d654321be894a5711d78745" is_pre_election: true
I20260709 12:13:58.668598  1996 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:58.669898  1839 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:58.675449  1996 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:58.676808  1949 raft_consensus.cc:2393] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dcf96fbcdce849398dc58b51bf465f80 in current term 3: Already voted for candidate 48a928d50d654321be894a5711d78745 in this term.
I20260709 12:13:58.677842  1996 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:13:58.679258  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:13:58.679987  1875 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.680174  1840 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dcf96fbcdce849398dc58b51bf465f80; no voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88
W20260709 12:13:58.682720  1913 leader_election.cc:336] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111)
I20260709 12:13:58.688926  1875 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:13:58.689546  2059 raft_consensus.cc:2749] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.690934  1912 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: bdf0faa663d04c03950da23ddde05a88
I20260709 12:13:58.691757  1996 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:58.692816  1996 raft_consensus.cc:697] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:13:58.693974  1996 consensus_queue.cc:237] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:13:58.703256  1697 catalog_manager.cc:5697] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 1 to 3, leader changed from bdf0faa663d04c03950da23ddde05a88 (127.23.222.129) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.161659  1875 raft_consensus.cc:1275] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:59.163268  1996 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:59.183327  1913 consensus_peers.cc:597] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.424372  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:59.773131  1839 consensus_peers.cc:597] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:59.918243  1839 consensus_peers.cc:597] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:00.074689  1913 consensus_peers.cc:597] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:00.129949  1839 consensus_peers.cc:597] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:00.305958  1913 consensus_peers.cc:597] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:00.376852  1839 consensus_peers.cc:597] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:00.386626  1839 consensus_peers.cc:597] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:00.425346  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:00.547987  1839 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111) [suppressed 102 similar messages]
I20260709 12:14:00.562757 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:00.571717  2104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:00.571997  2105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:00.573949  2107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:00.578579 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:00.580618 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:00.580833 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:00.580965 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599240580954 us; error 0 us; skew 500 ppm
I20260709 12:14:00.581507 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:00.584904 24442 webserver.cc:533] Webserver started at http://127.23.222.129:40271/ using document root <none> and password file <none>
I20260709 12:14:00.585443 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:00.585630 24442 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:00.590236 24442 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:14:00.595834  2112 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:00.596890 24442 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:00.597271 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "bdf0faa663d04c03950da23ddde05a88"
format_stamp: "Formatted at 2026-07-09 12:13:53 on dist-test-slave-90bm"
I20260709 12:14:00.597829 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:00.617826 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:00.619369 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:00.621049 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:00.625640  2119 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:14:00.693427 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:14:00.693805 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.069s	user 0.003s	sys 0.001s
I20260709 12:14:00.694262 24442 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:14:00.702747  2119 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.720469  2119 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.721504  2119 tablet_bootstrap.cc:492] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.722368  2119 ts_tablet_manager.cc:1403] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:14:00.725529  2119 raft_consensus.cc:359] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.726279  2119 raft_consensus.cc:740] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.727089  2119 consensus_queue.cc:260] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.730353  2119 ts_tablet_manager.cc:1434] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:00.731487  2119 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.752173  2119 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.753329  2119 tablet_bootstrap.cc:492] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.754153  2119 ts_tablet_manager.cc:1403] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:14:00.757699  2119 raft_consensus.cc:359] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.758471  2119 raft_consensus.cc:740] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.759236  2119 consensus_queue.cc:260] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.762348  2119 ts_tablet_manager.cc:1434] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:00.763444  2119 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.778606 24442 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:14:00.779273 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.085s	user 0.080s	sys 0.003s
I20260709 12:14:00.791572  2119 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.792629  2119 tablet_bootstrap.cc:492] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.793298  2119 ts_tablet_manager.cc:1403] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 12:14:00.796017  2119 raft_consensus.cc:359] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.796888  2119 raft_consensus.cc:740] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.798135  2119 consensus_queue.cc:260] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.801939  2119 ts_tablet_manager.cc:1434] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
W20260709 12:14:00.802974  1839 consensus_peers.cc:597] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:00.803345  2119 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
W20260709 12:14:00.813969  1839 consensus_peers.cc:597] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:00.827617  2119 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.828873  2119 tablet_bootstrap.cc:492] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.829536  2119 ts_tablet_manager.cc:1403] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 12:14:00.832850  2119 raft_consensus.cc:359] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.833492  2119 raft_consensus.cc:740] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.834368  2119 consensus_queue.cc:260] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.837049  2119 ts_tablet_manager.cc:1434] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:00.837837  2119 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.855772  2119 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.856580  2119 tablet_bootstrap.cc:492] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.857254  2119 ts_tablet_manager.cc:1403] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:14:00.860386  2119 raft_consensus.cc:359] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.861099  2119 raft_consensus.cc:740] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.861816  2119 consensus_queue.cc:260] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.864338  2119 ts_tablet_manager.cc:1434] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:14:00.865274  2119 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.877961 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:45693
I20260709 12:14:00.878101  2183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:45693 every 8 connection(s)
I20260709 12:14:00.881162  2119 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.882476  2119 tablet_bootstrap.cc:492] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.883503  2119 ts_tablet_manager.cc:1403] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:14:00.884066 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:00.888681  2119 raft_consensus.cc:359] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.889940  2119 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.890842  2119 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.893821  2119 ts_tablet_manager.cc:1434] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:00.894763  2119 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.914644  2184 heartbeater.cc:344] Connected to a master server at 127.23.222.190:36795
I20260709 12:14:00.915269  2184 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:00.916424  2184 heartbeater.cc:507] Master 127.23.222.190:36795 requested a full tablet report, sending...
I20260709 12:14:00.916968  2119 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.917994  2119 tablet_bootstrap.cc:492] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.919039  2119 ts_tablet_manager.cc:1403] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 12:14:00.921820  2119 raft_consensus.cc:359] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.922643  2119 raft_consensus.cc:740] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.923857  2119 consensus_queue.cc:260] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.926044  1696 ts_manager.cc:194] Re-registered known tserver with Master: bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693)
I20260709 12:14:00.926055  2119 ts_tablet_manager.cc:1434] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:14:00.927465  2119 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.927289  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:00.928207  1875 raft_consensus.cc:606] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:00.931667  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8565d616a35a4e52b227776e3173d454"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:00.932199  1875 raft_consensus.cc:606] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:00.934984  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:00.935513  1875 raft_consensus.cc:606] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:00.936820 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:00.938709 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:00.939530 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:00.940241  1696 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52930
I20260709 12:14:00.944684  2184 heartbeater.cc:499] Master 127.23.222.190:36795 was elected leader, sending a full tablet report...
I20260709 12:14:00.947321  2119 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.948489  2119 tablet_bootstrap.cc:492] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.949265  2119 ts_tablet_manager.cc:1403] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:14:00.951926  2119 raft_consensus.cc:359] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.952636  2119 raft_consensus.cc:740] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.953393  2119 consensus_queue.cc:260] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.955636  2119 ts_tablet_manager.cc:1434] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:00.956580  2119 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.972553  2119 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.973356  2119 tablet_bootstrap.cc:492] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.973963  2119 ts_tablet_manager.cc:1403] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:14:00.976212  2119 raft_consensus.cc:359] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.976780  2119 raft_consensus.cc:740] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.977604  2119 consensus_queue.cc:260] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:00.979984  2119 ts_tablet_manager.cc:1434] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:14:00.980966  2119 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Bootstrap starting.
I20260709 12:14:00.996955  2119 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:00.998136  2119 tablet_bootstrap.cc:492] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Bootstrap complete.
I20260709 12:14:00.999194  2119 ts_tablet_manager.cc:1403] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:14:01.002099  2119 raft_consensus.cc:359] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.002813  2119 raft_consensus.cc:740] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf0faa663d04c03950da23ddde05a88, State: Initialized, Role: FOLLOWER
I20260709 12:14:01.003583  2119 consensus_queue.cc:260] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.005371  2119 ts_tablet_manager.cc:1434] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:01.041613  2157 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.058219  2059 raft_consensus.cc:993] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.058892  2059 raft_consensus.cc:1081] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.060727  1949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:01.061434  1949 raft_consensus.cc:493] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.061780  1949 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.068369  1949 raft_consensus.cc:515] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.069885  1949 leader_election.cc:290] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:01.071180  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:01.071938  1875 raft_consensus.cc:3055] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:01.072261  1875 raft_consensus.cc:740] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:01.073140  1875 consensus_queue.cc:260] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.074592  1875 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.082450  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c4197bc62624595bd86dd25f6c9d81e" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:01.083359  2156 raft_consensus.cc:3060] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.084497  1875 raft_consensus.cc:2468] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:14:01.086387  1912 leader_election.cc:304] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:01.087458  2123 raft_consensus.cc:2804] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:01.088035  2123 raft_consensus.cc:697] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:01.089112  2123 consensus_queue.cc:237] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.093699  2156 raft_consensus.cc:2468] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:14:01.099799  1696 catalog_manager.cc:5697] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 2 to 3, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.277562  2156 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.336892  2198 raft_consensus.cc:993] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.337451  2059 raft_consensus.cc:1081] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.339372  1949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:01.340005  1949 raft_consensus.cc:493] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.340349  1949 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.348380  1949 raft_consensus.cc:515] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.350126  1949 leader_election.cc:290] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:01.351384  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:01.351321  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:01.352303  1875 raft_consensus.cc:3055] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:01.352350  2156 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.352793  1875 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:01.353921  1875 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.355556  1875 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.362633  2156 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:01.364442  1913 leader_election.cc:304] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:14:01.364791  1875 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:01.365610  2123 raft_consensus.cc:2804] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:01.366078  2123 raft_consensus.cc:697] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:01.367048  2123 consensus_queue.cc:237] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.374920  1696 catalog_manager.cc:5697] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 1 to 2, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:01.426523  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:01.505607  2156 raft_consensus.cc:1275] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:01.507550  2123 consensus_queue.cc:1048] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:01.519408  1875 raft_consensus.cc:1275] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:01.521063  2214 consensus_queue.cc:1048] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:01.526357  2198 raft_consensus.cc:993] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.526944  2198 raft_consensus.cc:1081] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.530094  1949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8565d616a35a4e52b227776e3173d454"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:01.530702  1949 raft_consensus.cc:493] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.531064  1949 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.538352  1949 raft_consensus.cc:515] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.541968  1949 leader_election.cc:290] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:01.542276  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:01.542595  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8565d616a35a4e52b227776e3173d454" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:01.543076  1875 raft_consensus.cc:3055] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:01.543246  2156 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.543457  1875 raft_consensus.cc:740] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:01.544514  1875 consensus_queue.cc:260] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.545696  1875 raft_consensus.cc:3060] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.551713  2156 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:14:01.552402  1875 raft_consensus.cc:2468] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:14:01.553319  1913 leader_election.cc:304] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:14:01.554225  2214 raft_consensus.cc:2804] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:01.554811  2214 raft_consensus.cc:697] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:01.555656  2214 consensus_queue.cc:237] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:01.564049  1697 catalog_manager.cc:5697] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 2 to 3, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.833988  2156 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:01.835625  1996 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:01.848579  1875 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:01.850574  2214 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:01.947978 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.956105  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:01.956832  1875 raft_consensus.cc:606] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:01.971302  1949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36"
dest_uuid: "48a928d50d654321be894a5711d78745"
mode: GRACEFUL
new_leader_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:47822
I20260709 12:14:01.971864  1949 raft_consensus.cc:606] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Received request to transfer leadership to TS dcf96fbcdce849398dc58b51bf465f80
I20260709 12:14:01.974802  1949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "48a928d50d654321be894a5711d78745"
mode: GRACEFUL
new_leader_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:47822
I20260709 12:14:01.975265  1949 raft_consensus.cc:606] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Received request to transfer leadership to TS dcf96fbcdce849398dc58b51bf465f80
I20260709 12:14:01.976359 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:01.976955 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:01.977632 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.994164  2211 raft_consensus.cc:993] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.994899  2211 raft_consensus.cc:1081] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:01.996436  1949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:01.996979  1949 raft_consensus.cc:493] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:01.997273  1949 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.003126  1949 raft_consensus.cc:515] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.004711  1949 leader_election.cc:290] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:02.005745  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:02.005738  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:02.007042  1875 raft_consensus.cc:3055] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:02.007042  2157 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.007587  1875 raft_consensus.cc:740] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:02.008579  1875 consensus_queue.cc:260] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.010070  1875 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.016396  2157 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:02.018004  1913 leader_election.cc:304] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:14:02.018952  2214 raft_consensus.cc:2804] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:02.019007  1875 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:02.019469  2214 raft_consensus.cc:697] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:02.020620  2214 consensus_queue.cc:237] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.029281  1697 catalog_manager.cc:5697] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 1 to 2, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.065066  2123 raft_consensus.cc:993] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: : Instructing follower dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:02.065641  2214 raft_consensus.cc:1081] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Signalling peer dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:02.067441  1875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:53024
I20260709 12:14:02.067946  1875 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:02.068241  1875 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.073843  1875 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.075604  1875 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 4 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:14:02.076599  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:02.076666  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:14:02.077414  2157 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.077629  1949 raft_consensus.cc:3055] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:02.078383  1949 raft_consensus.cc:740] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:02.079124  1949 consensus_queue.cc:260] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.080117  1949 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.084851  2157 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 4.
I20260709 12:14:02.085093  1949 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 4.
I20260709 12:14:02.086210  1839 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:02.087229  2211 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:02.087847  2211 raft_consensus.cc:697] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:02.088828  2211 consensus_queue.cc:237] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.096933  1697 catalog_manager.cc:5697] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 3 to 4, leader changed from 48a928d50d654321be894a5711d78745 (127.23.222.131) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 4 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.100893  1875 raft_consensus.cc:1275] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:02.102602  2214 consensus_queue.cc:1048] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:02.113570  2156 raft_consensus.cc:1275] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:02.116003  2123 consensus_queue.cc:1048] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:02.335053  2214 raft_consensus.cc:993] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: : Instructing follower dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:02.335633  2123 raft_consensus.cc:1081] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Signalling peer dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:02.337357  1875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:53024
I20260709 12:14:02.337924  1875 raft_consensus.cc:493] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:02.338223  1875 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:02.343675  1875 raft_consensus.cc:515] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.345228  1875 leader_election.cc:290] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:14:02.346422  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:02.346489  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:14:02.347095  2156 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:02.347245  1949 raft_consensus.cc:3055] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:02.347654  1949 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:02.348560  1949 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.349983  1949 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:02.354430  2156 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 3.
I20260709 12:14:02.355341  1949 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 3.
I20260709 12:14:02.356056  1839 leader_election.cc:304] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:02.356817  2211 raft_consensus.cc:2804] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:02.357321  2211 raft_consensus.cc:697] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:02.358191  2211 consensus_queue.cc:237] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:02.365561  1696 catalog_manager.cc:5697] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 2 to 3, leader changed from 48a928d50d654321be894a5711d78745 (127.23.222.131) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 3 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:02.427829  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:02.431710  2156 raft_consensus.cc:1275] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.433319  2123 consensus_queue.cc:1048] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.444765  1875 raft_consensus.cc:1275] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:02.446300  2123 consensus_queue.cc:1048] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:02.526754  2157 raft_consensus.cc:1275] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 4 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:02.528383  2211 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:02.539525  1949 raft_consensus.cc:1275] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:02.541471  2230 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:02.904737  2156 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:02.906131  2230 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:02.915910  1949 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:02.919299  2198 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:02.986224 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:02.994143  1949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2"
dest_uuid: "48a928d50d654321be894a5711d78745"
mode: GRACEFUL
new_leader_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:47822
I20260709 12:14:02.994752  1949 raft_consensus.cc:606] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Received request to transfer leadership to TS dcf96fbcdce849398dc58b51bf465f80
I20260709 12:14:02.997774  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:02.998621  1875 raft_consensus.cc:606] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:03.001976  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:03.002468  1875 raft_consensus.cc:606] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:03.003626 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:03.004213 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:03.004804 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:03.428961  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:03.434341  2123 raft_consensus.cc:993] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: : Instructing follower dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:03.435577  2234 raft_consensus.cc:1081] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Signalling peer dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:03.437325  1875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:53024
I20260709 12:14:03.437922  1875 raft_consensus.cc:493] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.438320  1875 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:03.444512  1875 raft_consensus.cc:515] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.446462  1875 leader_election.cc:290] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:14:03.447746  2211 raft_consensus.cc:993] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:03.447932  1949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:14:03.447986  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1260092d29724ffab1df5fdcb71479a2" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:03.448443  2211 raft_consensus.cc:1081] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:03.448668  1949 raft_consensus.cc:3055] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:03.448834  2156 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:03.449153  1949 raft_consensus.cc:740] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:03.449975  1949 consensus_queue.cc:260] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.450932  1949 raft_consensus.cc:3060] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:03.451404  1946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:03.452060  1946 raft_consensus.cc:493] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.452409  1946 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.457142  2156 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 3.
I20260709 12:14:03.458280  1949 raft_consensus.cc:2468] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 3.
I20260709 12:14:03.458964  1839 leader_election.cc:304] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:03.459930  2198 raft_consensus.cc:2804] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:03.460443  2198 raft_consensus.cc:697] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:03.461351  1946 raft_consensus.cc:515] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.461337  2198 consensus_queue.cc:237] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.463856  1946 leader_election.cc:290] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 4 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:03.465111  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:03.465710  1875 raft_consensus.cc:3055] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:03.465948  1875 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:03.466001  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:03.466753  1875 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.467085  2156 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.467921  1875 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.475973  1875 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 4.
I20260709 12:14:03.476032  1697 catalog_manager.cc:5697] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 2 to 3, leader changed from 48a928d50d654321be894a5711d78745 (127.23.222.131) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 3 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.477317  1912 leader_election.cc:304] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:03.478222  2234 raft_consensus.cc:2804] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:03.479194  2234 raft_consensus.cc:697] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:03.479962  2234 consensus_queue.cc:237] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.479980  2156 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 4.
I20260709 12:14:03.488193  1696 catalog_manager.cc:5697] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 3 to 4, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 4 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.513949  2211 raft_consensus.cc:993] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:03.514602  2198 raft_consensus.cc:1081] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:03.516494  1946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:03.516983  1946 raft_consensus.cc:493] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:03.517253  1946 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.522364  1946 raft_consensus.cc:515] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.524359  1946 leader_election.cc:290] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:03.525370  2156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:03.525746  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:03.526144  2156 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.526418  1875 raft_consensus.cc:3055] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:03.526764  1875 raft_consensus.cc:740] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:03.527614  1875 consensus_queue.cc:260] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.528808  1875 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.533811  2156 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:03.535292  1913 leader_election.cc:304] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:14:03.535599  1875 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:03.536154  2234 raft_consensus.cc:2804] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.536697  2234 raft_consensus.cc:697] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:03.537741  2234 consensus_queue.cc:237] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:03.545727  1696 catalog_manager.cc:5697] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 1 to 2, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.899713  2156 raft_consensus.cc:1275] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:03.901253  2198 consensus_queue.cc:1048] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:03.912822  1946 raft_consensus.cc:1275] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:03.915115  2245 consensus_queue.cc:1048] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:03.991339  2156 raft_consensus.cc:1275] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.991914  2155 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 4 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:03.993124  2234 consensus_queue.cc:1048] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.993569  2235 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:04.007742  1875 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:04.011471 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:04.016695  2234 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:04.024730  1875 raft_consensus.cc:1275] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.034731  2257 consensus_queue.cc:1048] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:04.054411  1946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a"
dest_uuid: "48a928d50d654321be894a5711d78745"
mode: GRACEFUL
new_leader_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:47822
I20260709 12:14:04.055310  1946 raft_consensus.cc:606] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Received request to transfer leadership to TS dcf96fbcdce849398dc58b51bf465f80
I20260709 12:14:04.062516  1873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:04.063253  1873 raft_consensus.cc:606] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:04.068270  1946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "48a928d50d654321be894a5711d78745"
mode: GRACEFUL
new_leader_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:47822
I20260709 12:14:04.068970  1946 raft_consensus.cc:606] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 LEADER]: Received request to transfer leadership to TS dcf96fbcdce849398dc58b51bf465f80
I20260709 12:14:04.072176 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:04.073413 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:04.075737  2255 raft_consensus.cc:993] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: : Instructing follower dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:04.074311 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:04.076577  2253 raft_consensus.cc:1081] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 LEADER]: Signalling peer dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:04.078656  1874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72da64abf4940c391510a9e40849e85"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:53024
I20260709 12:14:04.079303  1874 raft_consensus.cc:493] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:04.079741  1874 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.089454  1874 raft_consensus.cc:515] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.091425  1874 leader_election.cc:290] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 5 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:14:04.092401  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:04.092556  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72da64abf4940c391510a9e40849e85" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:14:04.093243  2157 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.093277  1946 raft_consensus.cc:3055] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.093808  1946 raft_consensus.cc:740] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:04.094722  1946 consensus_queue.cc:260] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.096312  1946 raft_consensus.cc:3060] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.102752  2157 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 5.
I20260709 12:14:04.104295  1839 leader_election.cc:304] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:04.105037  2198 raft_consensus.cc:2804] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:04.104993  1946 raft_consensus.cc:2468] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 5.
I20260709 12:14:04.105793  2198 raft_consensus.cc:697] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 5 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:04.106694  2198 consensus_queue.cc:237] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.113734  1697 catalog_manager.cc:5697] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 4 to 5, leader changed from 48a928d50d654321be894a5711d78745 (127.23.222.131) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 5 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.238445  2245 raft_consensus.cc:993] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:04.239069  2198 raft_consensus.cc:1081] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:04.241309  1946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:04.241957  1946 raft_consensus.cc:493] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:04.242344  1946 raft_consensus.cc:3060] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.243067  2255 raft_consensus.cc:993] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: : Instructing follower dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:04.243654  2253 raft_consensus.cc:1081] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Signalling peer dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:04.245383  1874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:53024
I20260709 12:14:04.245985  1874 raft_consensus.cc:493] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:04.246395  1874 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.251039  1946 raft_consensus.cc:515] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.253728  1946 leader_election.cc:290] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:04.255093  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:04.255093  2157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a31e9a1136a74e89b1053c9dd342796e" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:04.256006  1875 raft_consensus.cc:3055] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:04.254923  1874 raft_consensus.cc:515] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.256105  2157 raft_consensus.cc:3060] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.256404  1875 raft_consensus.cc:740] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:04.257428  1875 consensus_queue.cc:260] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.258361  1874 leader_election.cc:290] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:14:04.258894  1875 raft_consensus.cc:3060] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.261104  2155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:04.261422  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:14:04.261819  2155 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.262223  1946 raft_consensus.cc:3055] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:04.262737  1946 raft_consensus.cc:740] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:04.263960  1946 consensus_queue.cc:260] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.265092  2157 raft_consensus.cc:2468] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:04.265399  1946 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.266582  1913 leader_election.cc:304] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:14:04.269325  1875 raft_consensus.cc:2468] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 2.
I20260709 12:14:04.270385  2155 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 2.
I20260709 12:14:04.271638  1839 leader_election.cc:304] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:04.272094  2253 raft_consensus.cc:2804] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.272465  2198 raft_consensus.cc:2804] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.272652  2253 raft_consensus.cc:697] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:04.273054  2198 raft_consensus.cc:697] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:04.273818  2253 consensus_queue.cc:237] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.274209  2198 consensus_queue.cc:237] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:04.274897  1946 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 2.
I20260709 12:14:04.285732  1697 catalog_manager.cc:5697] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 1 to 2, leader changed from 48a928d50d654321be894a5711d78745 (127.23.222.131) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.286147  1696 catalog_manager.cc:5697] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 1 to 2, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:04.430222  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:04.569025  2157 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:04.571228  2245 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:04.583575  1946 raft_consensus.cc:1275] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:14:04.585444  2245 consensus_queue.cc:1048] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:04.670872  1875 raft_consensus.cc:1275] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.672335  2269 consensus_queue.cc:1048] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:04.682565  2157 raft_consensus.cc:1275] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.684887  2269 consensus_queue.cc:1048] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:04.685807  2157 raft_consensus.cc:1275] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.687631  2245 consensus_queue.cc:1048] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:04.706799  1946 raft_consensus.cc:1275] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.709003  2198 consensus_queue.cc:1048] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:05.090713 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:05.099390  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:05.100018  1875 raft_consensus.cc:606] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:05.103391  1875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
mode: GRACEFUL
new_leader_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47790
I20260709 12:14:05.103924  1875 raft_consensus.cc:606] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 LEADER]: Received request to transfer leadership to TS 48a928d50d654321be894a5711d78745
I20260709 12:14:05.106851  1946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496"
dest_uuid: "48a928d50d654321be894a5711d78745"
mode: GRACEFUL
new_leader_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:47822
I20260709 12:14:05.107352  1946 raft_consensus.cc:606] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Received request to transfer leadership to TS dcf96fbcdce849398dc58b51bf465f80
I20260709 12:14:05.108806 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:05.109393 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:05.110069 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:05.328598  2198 raft_consensus.cc:993] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:05.329185  2273 raft_consensus.cc:1081] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:05.330892  1946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:05.331460  1946 raft_consensus.cc:493] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.331871  1946 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.337890  1946 raft_consensus.cc:515] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.339684  1946 leader_election.cc:290] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:05.340546  2155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:05.340691  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3d7cf2e06c4228a325cbfc6344342a" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:05.341369  1875 raft_consensus.cc:3055] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:05.341346  2155 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.341850  1875 raft_consensus.cc:740] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:05.342644  1875 consensus_queue.cc:260] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.343618  1875 raft_consensus.cc:3060] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.349449  1875 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:14:05.350417  2155 raft_consensus.cc:2468] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 3.
I20260709 12:14:05.350646  1912 leader_election.cc:304] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:05.351565  2276 raft_consensus.cc:2804] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:05.352072  2276 raft_consensus.cc:697] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:05.352938  2276 consensus_queue.cc:237] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.360301  1697 catalog_manager.cc:5697] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 2 to 3, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:05.431452  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:05.490180  2198 raft_consensus.cc:993] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: : Instructing follower 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:05.490958  2245 raft_consensus.cc:1081] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 LEADER]: Signalling peer 48a928d50d654321be894a5711d78745 to start an election
I20260709 12:14:05.492455  1946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36"
dest_uuid: "48a928d50d654321be894a5711d78745"
 from {username='slave'} at 127.0.0.1:47798
I20260709 12:14:05.492945  1946 raft_consensus.cc:493] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.493206  1946 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.498867  1946 raft_consensus.cc:515] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.500691  1946 leader_election.cc:290] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 5 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469)
I20260709 12:14:05.501634  2155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:05.501904  1875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272b509bc8b84e2d96aaeadd2efcdc36" candidate_uuid: "48a928d50d654321be894a5711d78745" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
I20260709 12:14:05.502413  2155 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.502893  1875 raft_consensus.cc:3055] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:05.503158  1875 raft_consensus.cc:740] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:05.503953  1875 consensus_queue.cc:260] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.504959  1875 raft_consensus.cc:3060] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.509016  2155 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 5.
I20260709 12:14:05.509953  1875 raft_consensus.cc:2468] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a928d50d654321be894a5711d78745 in term 5.
I20260709 12:14:05.510928  1913 leader_election.cc:304] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a928d50d654321be894a5711d78745, bdf0faa663d04c03950da23ddde05a88; no voters: 
I20260709 12:14:05.511662  2276 raft_consensus.cc:2804] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:05.512132  2276 raft_consensus.cc:697] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 5 LEADER]: Becoming Leader. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:05.512996  2276 consensus_queue.cc:237] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.521126  1697 catalog_manager.cc:5697] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 reported cstate change: term changed from 4 to 5, leader changed from dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130) to 48a928d50d654321be894a5711d78745 (127.23.222.131). New cstate: current_term: 5 leader_uuid: "48a928d50d654321be894a5711d78745" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.566468  2275 raft_consensus.cc:993] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: : Instructing follower dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:05.567204  2269 raft_consensus.cc:1081] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Signalling peer dcf96fbcdce849398dc58b51bf465f80 to start an election
I20260709 12:14:05.569329  1875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496"
dest_uuid: "dcf96fbcdce849398dc58b51bf465f80"
 from {username='slave'} at 127.0.0.1:53024
I20260709 12:14:05.569878  1875 raft_consensus.cc:493] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:05.570330  1875 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.576257  1875 raft_consensus.cc:515] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.578121  1875 leader_election.cc:290] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 election: Requested vote from peers bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693), 48a928d50d654321be894a5711d78745 (127.23.222.131:44807)
I20260709 12:14:05.579317  2155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bdf0faa663d04c03950da23ddde05a88"
I20260709 12:14:05.579317  1946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e026292bdd6e4a3bada4da4c4376b496" candidate_uuid: "dcf96fbcdce849398dc58b51bf465f80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a928d50d654321be894a5711d78745"
I20260709 12:14:05.580147  2155 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.580274  1946 raft_consensus.cc:3055] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:05.580915  1946 raft_consensus.cc:740] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a928d50d654321be894a5711d78745, State: Running, Role: LEADER
I20260709 12:14:05.581689  1946 consensus_queue.cc:260] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.583142  1946 raft_consensus.cc:3060] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.586607  2155 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 3.
I20260709 12:14:05.587970  1839 leader_election.cc:304] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdf0faa663d04c03950da23ddde05a88, dcf96fbcdce849398dc58b51bf465f80; no voters: 
I20260709 12:14:05.588723  1946 raft_consensus.cc:2468] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf96fbcdce849398dc58b51bf465f80 in term 3.
I20260709 12:14:05.588807  2245 raft_consensus.cc:2804] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:05.589578  2245 raft_consensus.cc:697] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Becoming Leader. State: Replica: dcf96fbcdce849398dc58b51bf465f80, State: Running, Role: LEADER
I20260709 12:14:05.590482  2245 consensus_queue.cc:237] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } }
I20260709 12:14:05.598766  1697 catalog_manager.cc:5697] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 reported cstate change: term changed from 2 to 3, leader changed from 48a928d50d654321be894a5711d78745 (127.23.222.131) to dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130). New cstate: current_term: 3 leader_uuid: "dcf96fbcdce849398dc58b51bf465f80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:05.817337  1875 raft_consensus.cc:1275] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:05.819756  2269 consensus_queue.cc:1048] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:05.832482  2155 raft_consensus.cc:1275] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:05.835296  2275 consensus_queue.cc:1048] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:05.983530  1946 raft_consensus.cc:1275] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:05.985180  2245 consensus_queue.cc:1048] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a928d50d654321be894a5711d78745" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 44807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:05.997641  2155 raft_consensus.cc:1275] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Refusing update from remote peer dcf96fbcdce849398dc58b51bf465f80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:05.999909  2273 consensus_queue.cc:1048] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:06.012368  2155 raft_consensus.cc:1275] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:06.013959  2275 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdf0faa663d04c03950da23ddde05a88" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 45693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:06.025015  1875 raft_consensus.cc:1275] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Refusing update from remote peer 48a928d50d654321be894a5711d78745: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:06.026566  2269 consensus_queue.cc:1048] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dcf96fbcdce849398dc58b51bf465f80" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 41469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:06.116647 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:06.147013 24442 tablet_server.cc:179] TabletServer@127.23.222.129:45693 shutting down...
W20260709 12:14:06.151058  1913 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:14:06.155249  1913 consensus_peers.cc:597] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.241494 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:06.242128  1839 consensus_peers.cc:597] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.243161 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.244395 24442 raft_consensus.cc:2243] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.245143 24442 raft_consensus.cc:2272] T 93b3ecb00b7349c4bed7d7533161c1d4 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.248208 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.248943 24442 raft_consensus.cc:2243] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.249600 24442 raft_consensus.cc:2272] T 0e3d7cf2e06c4228a325cbfc6344342a P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.255050 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.255939 24442 raft_consensus.cc:2243] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.257082 24442 raft_consensus.cc:2272] T e026292bdd6e4a3bada4da4c4376b496 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.259342  1839 consensus_peers.cc:597] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.261879 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.262812 24442 raft_consensus.cc:2243] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.263461 24442 raft_consensus.cc:2272] T a31e9a1136a74e89b1053c9dd342796e P bdf0faa663d04c03950da23ddde05a88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.266425 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.267220 24442 raft_consensus.cc:2243] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.267988 24442 raft_consensus.cc:2272] T 1260092d29724ffab1df5fdcb71479a2 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.271109 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.271942 24442 raft_consensus.cc:2243] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.272933 24442 raft_consensus.cc:2272] T 8565d616a35a4e52b227776e3173d454 P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.276170 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.276762 24442 raft_consensus.cc:2243] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.277352 24442 raft_consensus.cc:2272] T 272b509bc8b84e2d96aaeadd2efcdc36 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.281088 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.282126 24442 raft_consensus.cc:2243] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.282927 24442 raft_consensus.cc:2272] T b72da64abf4940c391510a9e40849e85 P bdf0faa663d04c03950da23ddde05a88 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.285391 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.285912 24442 raft_consensus.cc:2243] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.286532 24442 raft_consensus.cc:2272] T 6c4197bc62624595bd86dd25f6c9d81e P bdf0faa663d04c03950da23ddde05a88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.289530 24442 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:06.289989 24442 raft_consensus.cc:2243] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.290601 24442 raft_consensus.cc:2272] T 08dfbefc82774d65a3ccc2b967664b55 P bdf0faa663d04c03950da23ddde05a88 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.314354  1913 consensus_peers.cc:597] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.335322 24442 tablet_server.cc:196] TabletServer@127.23.222.129:45693 shutdown complete.
I20260709 12:14:06.377388 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
W20260709 12:14:06.389474  1912 consensus_peers.cc:597] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 -> Peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Couldn't send request to peer dcf96fbcdce849398dc58b51bf465f80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:06.410244  1912 consensus_peers.cc:597] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 -> Peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Couldn't send request to peer dcf96fbcdce849398dc58b51bf465f80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:06.409409  1839 consensus_peers.cc:597] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:06.416708  1913 consensus_peers.cc:597] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:06.425158  1912 consensus_peers.cc:597] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 -> Peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Couldn't send request to peer dcf96fbcdce849398dc58b51bf465f80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.426451 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:06.428175 24442 tablet_replica.cc:333] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.429069 24442 raft_consensus.cc:2243] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.429764 24442 raft_consensus.cc:2272] T 93b3ecb00b7349c4bed7d7533161c1d4 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.433132  1746 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:06.433804 24442 tablet_replica.cc:333] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.434778 24442 raft_consensus.cc:2243] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.436252 24442 raft_consensus.cc:2272] T e026292bdd6e4a3bada4da4c4376b496 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.439755 24442 tablet_replica.cc:333] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.440392 24442 raft_consensus.cc:2243] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.441622 24442 raft_consensus.cc:2272] T 08dfbefc82774d65a3ccc2b967664b55 P dcf96fbcdce849398dc58b51bf465f80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.444649 24442 tablet_replica.cc:333] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.445274 24442 raft_consensus.cc:2243] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.445840 24442 raft_consensus.cc:2272] T 0e3d7cf2e06c4228a325cbfc6344342a P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.449891 24442 tablet_replica.cc:333] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.450594 24442 raft_consensus.cc:2243] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.451170 24442 raft_consensus.cc:2272] T 8565d616a35a4e52b227776e3173d454 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.453589 24442 tablet_replica.cc:333] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.454147 24442 raft_consensus.cc:2243] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.455399 24442 raft_consensus.cc:2272] T 1260092d29724ffab1df5fdcb71479a2 P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.458315 24442 tablet_replica.cc:333] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.459107 24442 raft_consensus.cc:2243] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.459867 24442 raft_consensus.cc:2272] T a31e9a1136a74e89b1053c9dd342796e P dcf96fbcdce849398dc58b51bf465f80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.462807 24442 tablet_replica.cc:333] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.463479 24442 raft_consensus.cc:2243] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.464169 24442 raft_consensus.cc:2272] T 6c4197bc62624595bd86dd25f6c9d81e P dcf96fbcdce849398dc58b51bf465f80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.466955 24442 tablet_replica.cc:333] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.467582 24442 raft_consensus.cc:2243] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.468289 24442 raft_consensus.cc:2272] T 272b509bc8b84e2d96aaeadd2efcdc36 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.471918 24442 tablet_replica.cc:333] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80: stopping tablet replica
I20260709 12:14:06.472491 24442 raft_consensus.cc:2243] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.473869 24442 raft_consensus.cc:2272] T b72da64abf4940c391510a9e40849e85 P dcf96fbcdce849398dc58b51bf465f80 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.480818  1912 consensus_peers.cc:597] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 -> Peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Couldn't send request to peer dcf96fbcdce849398dc58b51bf465f80. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:06.494153  1913 consensus_peers.cc:597] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:06.509840  1913 consensus_peers.cc:597] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.518675 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
I20260709 12:14:06.551636 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
I20260709 12:14:06.593197 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:06.594427 24442 tablet_replica.cc:333] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.595718 24442 raft_consensus.cc:2243] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:06.596530  1913 consensus_peers.cc:597] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 -> Peer bdf0faa663d04c03950da23ddde05a88 (127.23.222.129:45693): Couldn't send request to peer bdf0faa663d04c03950da23ddde05a88. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:45693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.596524 24442 raft_consensus.cc:2272] T e026292bdd6e4a3bada4da4c4376b496 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.600325 24442 tablet_replica.cc:333] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.601099 24442 raft_consensus.cc:2243] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.602186 24442 raft_consensus.cc:2272] T 93b3ecb00b7349c4bed7d7533161c1d4 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.604735 24442 tablet_replica.cc:333] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.605329 24442 raft_consensus.cc:2243] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.605875 24442 raft_consensus.cc:2272] T 08dfbefc82774d65a3ccc2b967664b55 P 48a928d50d654321be894a5711d78745 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.609081 24442 tablet_replica.cc:333] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.609922 24442 raft_consensus.cc:2243] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.611693 24442 raft_consensus.cc:2272] T 8565d616a35a4e52b227776e3173d454 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.614051  1912 consensus_peers.cc:597] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 -> Peer dcf96fbcdce849398dc58b51bf465f80 (127.23.222.130:41469): Couldn't send request to peer dcf96fbcdce849398dc58b51bf465f80. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:41469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.614856 24442 tablet_replica.cc:333] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.615605 24442 raft_consensus.cc:2243] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.616206 24442 raft_consensus.cc:2272] T 1260092d29724ffab1df5fdcb71479a2 P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.618785 24442 tablet_replica.cc:333] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.619362 24442 raft_consensus.cc:2243] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.620428 24442 raft_consensus.cc:2272] T a31e9a1136a74e89b1053c9dd342796e P 48a928d50d654321be894a5711d78745 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.622752 24442 tablet_replica.cc:333] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.623339 24442 raft_consensus.cc:2243] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.624349 24442 raft_consensus.cc:2272] T 272b509bc8b84e2d96aaeadd2efcdc36 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.627398 24442 tablet_replica.cc:333] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.627966 24442 raft_consensus.cc:2243] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.628516 24442 raft_consensus.cc:2272] T b72da64abf4940c391510a9e40849e85 P 48a928d50d654321be894a5711d78745 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.630811 24442 tablet_replica.cc:333] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.631354 24442 raft_consensus.cc:2243] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.632280 24442 raft_consensus.cc:2272] T 6c4197bc62624595bd86dd25f6c9d81e P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.634560 24442 tablet_replica.cc:333] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745: stopping tablet replica
I20260709 12:14:06.635066 24442 raft_consensus.cc:2243] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.635922 24442 raft_consensus.cc:2272] T 0e3d7cf2e06c4228a325cbfc6344342a P 48a928d50d654321be894a5711d78745 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.673025 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:14:06.700940 24442 master.cc:562] Master@127.23.222.190:36795 shutting down...
I20260709 12:14:06.736166 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.736865 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.737226 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P 228a8728f0f6477b84dd512826e77f38: stopping tablet replica
I20260709 12:14:06.760030 24442 master.cc:584] Master@127.23.222.190:36795 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13591 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:14:06.821830 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:42173
I20260709 12:14:06.823347 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:06.829869  2301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.830554  2302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:06.831496  2304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:06.831645 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:06.832880 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:06.833062 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:06.833175 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599246833164 us; error 0 us; skew 500 ppm
I20260709 12:14:06.833678 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:06.836562 24442 webserver.cc:533] Webserver started at http://127.23.222.190:36683/ using document root <none> and password file <none>
I20260709 12:14:06.837244 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:06.837457 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:06.837697 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:06.839186 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "b32c8c2a42e14c58863a4f488be825a9"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-90bm"
I20260709 12:14:06.844034 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:14:06.848227  2309 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:06.849071 24442 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:14:06.849344 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "b32c8c2a42e14c58863a4f488be825a9"
format_stamp: "Formatted at 2026-07-09 12:14:06 on dist-test-slave-90bm"
I20260709 12:14:06.849602 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:06.863983 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:06.865320 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:06.912300 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:42173
I20260709 12:14:06.912688  2360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:42173 every 8 connection(s)
I20260709 12:14:06.916850  2361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:06.931035  2361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9: Bootstrap starting.
I20260709 12:14:06.936749  2361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:06.942154  2361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9: No bootstrap required, opened a new log
I20260709 12:14:06.945015  2361 raft_consensus.cc:359] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c8c2a42e14c58863a4f488be825a9" member_type: VOTER }
I20260709 12:14:06.945576  2361 raft_consensus.cc:385] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:06.945879  2361 raft_consensus.cc:740] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c8c2a42e14c58863a4f488be825a9, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.946563  2361 consensus_queue.cc:260] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c8c2a42e14c58863a4f488be825a9" member_type: VOTER }
I20260709 12:14:06.947122  2361 raft_consensus.cc:399] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:06.947379  2361 raft_consensus.cc:493] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:06.947672  2361 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:06.953593  2361 raft_consensus.cc:515] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c8c2a42e14c58863a4f488be825a9" member_type: VOTER }
I20260709 12:14:06.954210  2361 leader_election.cc:304] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b32c8c2a42e14c58863a4f488be825a9; no voters: 
I20260709 12:14:06.955603  2361 leader_election.cc:290] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:06.956118  2364 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:06.958127  2364 raft_consensus.cc:697] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 1 LEADER]: Becoming Leader. State: Replica: b32c8c2a42e14c58863a4f488be825a9, State: Running, Role: LEADER
I20260709 12:14:06.959161  2364 consensus_queue.cc:237] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c8c2a42e14c58863a4f488be825a9" member_type: VOTER }
I20260709 12:14:06.959883  2361 sys_catalog.cc:565] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:06.966302  2365 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b32c8c2a42e14c58863a4f488be825a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c8c2a42e14c58863a4f488be825a9" member_type: VOTER } }
I20260709 12:14:06.967368  2366 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b32c8c2a42e14c58863a4f488be825a9. Latest consensus state: current_term: 1 leader_uuid: "b32c8c2a42e14c58863a4f488be825a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c8c2a42e14c58863a4f488be825a9" member_type: VOTER } }
I20260709 12:14:06.967864  2366 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:06.967941  2365 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:06.970091  2372 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:06.976001  2372 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:06.978871 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:06.987040  2372 catalog_manager.cc:1383] Generated new cluster ID: d6d09d3be8a54d7b9187a7fc08374249
I20260709 12:14:06.987478  2372 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:07.004683  2372 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:07.006304  2372 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:07.030593  2372 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9: Generated new TSK 0
I20260709 12:14:07.031466  2372 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:07.046418 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:07.054425  2382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:07.055384  2383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:07.057174  2385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:07.057752 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:07.058954 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:07.059223 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:07.059406 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599247059382 us; error 0 us; skew 500 ppm
I20260709 12:14:07.060170 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:07.063024 24442 webserver.cc:533] Webserver started at http://127.23.222.129:35397/ using document root <none> and password file <none>
I20260709 12:14:07.063585 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:07.063817 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:07.064112 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:07.065371 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "49e35a97d40e45ca9d20764ff2688dc3"
format_stamp: "Formatted at 2026-07-09 12:14:07 on dist-test-slave-90bm"
I20260709 12:14:07.070636 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:14:07.074712  2390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.075711 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:07.075994 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "49e35a97d40e45ca9d20764ff2688dc3"
format_stamp: "Formatted at 2026-07-09 12:14:07 on dist-test-slave-90bm"
I20260709 12:14:07.076259 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:07.119449 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:07.121131 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:07.123050 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:07.125741 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:07.125962 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.126338 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:07.126530 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.180549 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:34389
I20260709 12:14:07.180790  2452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:34389 every 8 connection(s)
I20260709 12:14:07.186739 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:07.195943  2457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:07.199301  2458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:07.203559 24442 server_base.cc:1061] running on GCE node
W20260709 12:14:07.203619  2460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:07.205596 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:07.205902 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:07.206118 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599247206096 us; error 0 us; skew 500 ppm
I20260709 12:14:07.206292  2453 heartbeater.cc:344] Connected to a master server at 127.23.222.190:42173
I20260709 12:14:07.206739  2453 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:07.206845 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:07.207711  2453 heartbeater.cc:507] Master 127.23.222.190:42173 requested a full tablet report, sending...
I20260709 12:14:07.210368 24442 webserver.cc:533] Webserver started at http://127.23.222.130:33539/ using document root <none> and password file <none>
I20260709 12:14:07.210778  2326 ts_manager.cc:194] Registered new tserver with Master: 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389)
I20260709 12:14:07.211215 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:07.211526 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:07.211882 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:07.213625  2326 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52968
I20260709 12:14:07.213799 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "13484a08eef24417a924d54af0dc54c0"
format_stamp: "Formatted at 2026-07-09 12:14:07 on dist-test-slave-90bm"
I20260709 12:14:07.219888 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:07.224009  2465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.225085 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:07.225458 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "13484a08eef24417a924d54af0dc54c0"
format_stamp: "Formatted at 2026-07-09 12:14:07 on dist-test-slave-90bm"
I20260709 12:14:07.225805 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:07.250686 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:07.252207 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:07.253844 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:07.256426 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:07.256669 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.256942 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:07.257129 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.308835 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:38081
I20260709 12:14:07.308986  2527 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:38081 every 8 connection(s)
I20260709 12:14:07.314378 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:07.322816  2532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:07.323479  2531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:07.325591  2534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:07.327693  2528 heartbeater.cc:344] Connected to a master server at 127.23.222.190:42173
I20260709 12:14:07.328235  2528 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:07.328428 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:07.329334  2528 heartbeater.cc:507] Master 127.23.222.190:42173 requested a full tablet report, sending...
I20260709 12:14:07.329717 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:07.330060 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:07.330304 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599247330280 us; error 0 us; skew 500 ppm
I20260709 12:14:07.331194 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:07.332311  2326 ts_manager.cc:194] Registered new tserver with Master: 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081)
I20260709 12:14:07.334383  2326 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52974
I20260709 12:14:07.334414 24442 webserver.cc:533] Webserver started at http://127.23.222.131:44023/ using document root <none> and password file <none>
I20260709 12:14:07.335278 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:07.335552 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:07.335896 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:07.338057 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "49ac0b54ff054765ada933f5db0cc8f8"
format_stamp: "Formatted at 2026-07-09 12:14:07 on dist-test-slave-90bm"
I20260709 12:14:07.343115 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:14:07.347291  2539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.348330 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:07.348639 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "49ac0b54ff054765ada933f5db0cc8f8"
format_stamp: "Formatted at 2026-07-09 12:14:07 on dist-test-slave-90bm"
I20260709 12:14:07.348939 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:07.373698 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:07.375114 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:07.376642 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:07.379475 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:07.379678 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.379998 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:07.380146 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:07.430932 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:41211
I20260709 12:14:07.431028  2601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:41211 every 8 connection(s)
I20260709 12:14:07.447394  2602 heartbeater.cc:344] Connected to a master server at 127.23.222.190:42173
I20260709 12:14:07.447875  2602 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:07.448761  2602 heartbeater.cc:507] Master 127.23.222.190:42173 requested a full tablet report, sending...
I20260709 12:14:07.451390  2326 ts_manager.cc:194] Registered new tserver with Master: 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:07.452153 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01751922s
I20260709 12:14:07.453197  2326 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52986
I20260709 12:14:07.484864  2326 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53000:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:07.487439  2326 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:07.557353  2418 tablet_service.cc:1511] Processing CreateTablet for tablet 44df4ef1ded34193929461692a5dfe82 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4dcc35abd77745b7b1d835ebcd26c379]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:07.558338  2417 tablet_service.cc:1511] Processing CreateTablet for tablet 916f7ff881fa4bd28bfe5dfdc777cabd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4dcc35abd77745b7b1d835ebcd26c379]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:07.559042  2418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44df4ef1ded34193929461692a5dfe82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.559775  2417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916f7ff881fa4bd28bfe5dfdc777cabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.561470  2493 tablet_service.cc:1511] Processing CreateTablet for tablet 44df4ef1ded34193929461692a5dfe82 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4dcc35abd77745b7b1d835ebcd26c379]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:07.563297  2493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44df4ef1ded34193929461692a5dfe82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.572366  2492 tablet_service.cc:1511] Processing CreateTablet for tablet 916f7ff881fa4bd28bfe5dfdc777cabd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4dcc35abd77745b7b1d835ebcd26c379]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:07.574452  2492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916f7ff881fa4bd28bfe5dfdc777cabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.576913  2567 tablet_service.cc:1511] Processing CreateTablet for tablet 44df4ef1ded34193929461692a5dfe82 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4dcc35abd77745b7b1d835ebcd26c379]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:07.577364  2566 tablet_service.cc:1511] Processing CreateTablet for tablet 916f7ff881fa4bd28bfe5dfdc777cabd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4dcc35abd77745b7b1d835ebcd26c379]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:07.578989  2566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916f7ff881fa4bd28bfe5dfdc777cabd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.591223  2567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44df4ef1ded34193929461692a5dfe82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:07.604238  2618 tablet_bootstrap.cc:492] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0: Bootstrap starting.
I20260709 12:14:07.606659  2617 tablet_bootstrap.cc:492] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3: Bootstrap starting.
I20260709 12:14:07.612649  2618 tablet_bootstrap.cc:654] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.615248  2617 tablet_bootstrap.cc:654] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.622340  2619 tablet_bootstrap.cc:492] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8: Bootstrap starting.
I20260709 12:14:07.625447  2618 tablet_bootstrap.cc:492] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0: No bootstrap required, opened a new log
I20260709 12:14:07.625869  2617 tablet_bootstrap.cc:492] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3: No bootstrap required, opened a new log
I20260709 12:14:07.625972  2618 ts_tablet_manager.cc:1403] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 12:14:07.626546  2617 ts_tablet_manager.cc:1403] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:14:07.629197  2618 raft_consensus.cc:359] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.629880  2618 raft_consensus.cc:385] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.630121  2618 raft_consensus.cc:740] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.630568  2617 raft_consensus.cc:359] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.630973  2618 consensus_queue.cc:260] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.631491  2617 raft_consensus.cc:385] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.631875  2617 raft_consensus.cc:740] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.632324  2619 tablet_bootstrap.cc:654] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.632989  2617 consensus_queue.cc:260] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.633900  2528 heartbeater.cc:499] Master 127.23.222.190:42173 was elected leader, sending a full tablet report...
I20260709 12:14:07.634384  2618 ts_tablet_manager.cc:1434] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:14:07.635429  2618 tablet_bootstrap.cc:492] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0: Bootstrap starting.
I20260709 12:14:07.643172  2617 ts_tablet_manager.cc:1434] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3: Time spent starting tablet: real 0.016s	user 0.015s	sys 0.001s
I20260709 12:14:07.643316  2453 heartbeater.cc:499] Master 127.23.222.190:42173 was elected leader, sending a full tablet report...
I20260709 12:14:07.644452  2617 tablet_bootstrap.cc:492] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3: Bootstrap starting.
I20260709 12:14:07.643345  2618 tablet_bootstrap.cc:654] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.654489  2617 tablet_bootstrap.cc:654] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.659698  2618 tablet_bootstrap.cc:492] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0: No bootstrap required, opened a new log
I20260709 12:14:07.660394  2618 ts_tablet_manager.cc:1403] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 12:14:07.660948  2619 tablet_bootstrap.cc:492] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8: No bootstrap required, opened a new log
I20260709 12:14:07.661726  2619 ts_tablet_manager.cc:1403] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.012s
I20260709 12:14:07.663997  2618 raft_consensus.cc:359] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.664669  2618 raft_consensus.cc:385] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.664844  2617 tablet_bootstrap.cc:492] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3: No bootstrap required, opened a new log
I20260709 12:14:07.664950  2618 raft_consensus.cc:740] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.665548  2617 ts_tablet_manager.cc:1403] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 12:14:07.665349  2619 raft_consensus.cc:359] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.665978  2618 consensus_queue.cc:260] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.666461  2619 raft_consensus.cc:385] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.669394  2619 raft_consensus.cc:740] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.669869  2617 raft_consensus.cc:359] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.670756  2617 raft_consensus.cc:385] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.670385  2619 consensus_queue.cc:260] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.671114  2617 raft_consensus.cc:740] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.667987  2618 ts_tablet_manager.cc:1434] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:07.672307  2617 consensus_queue.cc:260] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.673789  2602 heartbeater.cc:499] Master 127.23.222.190:42173 was elected leader, sending a full tablet report...
I20260709 12:14:07.674455  2619 ts_tablet_manager.cc:1434] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:14:07.675202  2617 ts_tablet_manager.cc:1434] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:14:07.676294  2619 tablet_bootstrap.cc:492] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8: Bootstrap starting.
I20260709 12:14:07.684108  2619 tablet_bootstrap.cc:654] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:07.690357  2619 tablet_bootstrap.cc:492] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8: No bootstrap required, opened a new log
I20260709 12:14:07.690835  2619 ts_tablet_manager.cc:1403] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:14:07.693343  2619 raft_consensus.cc:359] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.694335  2619 raft_consensus.cc:385] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:07.694702  2619 raft_consensus.cc:740] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Initialized, Role: FOLLOWER
I20260709 12:14:07.695955  2619 consensus_queue.cc:260] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.698351  2619 ts_tablet_manager.cc:1434] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:07.803898  2622 raft_consensus.cc:493] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.804661  2622 raft_consensus.cc:515] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.807081  2622 leader_election.cc:290] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:07.821610  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916f7ff881fa4bd28bfe5dfdc777cabd" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3" is_pre_election: true
I20260709 12:14:07.822685  2428 raft_consensus.cc:2468] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 0.
I20260709 12:14:07.823904  2466 leader_election.cc:304] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:07.824754  2622 raft_consensus.cc:2804] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:07.825210  2622 raft_consensus.cc:493] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.825134  2577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916f7ff881fa4bd28bfe5dfdc777cabd" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8" is_pre_election: true
I20260709 12:14:07.825754  2622 raft_consensus.cc:3060] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:07.825953  2577 raft_consensus.cc:2468] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 0.
I20260709 12:14:07.832763  2622 raft_consensus.cc:515] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.834870  2622 leader_election.cc:290] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 election: Requested vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:07.836078  2577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916f7ff881fa4bd28bfe5dfdc777cabd" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
I20260709 12:14:07.835956  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916f7ff881fa4bd28bfe5dfdc777cabd" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
I20260709 12:14:07.836691  2577 raft_consensus.cc:3060] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:07.836799  2428 raft_consensus.cc:3060] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:07.843477  2577 raft_consensus.cc:2468] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 1.
I20260709 12:14:07.843851  2428 raft_consensus.cc:2468] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 1.
I20260709 12:14:07.845031  2467 leader_election.cc:304] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49ac0b54ff054765ada933f5db0cc8f8; no voters: 
I20260709 12:14:07.846091  2622 raft_consensus.cc:2804] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:07.847438  2622 raft_consensus.cc:697] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Becoming Leader. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Running, Role: LEADER
I20260709 12:14:07.848238  2622 consensus_queue.cc:237] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.857246  2325 catalog_manager.cc:5697] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13484a08eef24417a924d54af0dc54c0 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "13484a08eef24417a924d54af0dc54c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:07.972489  2374 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:07.977373  2623 raft_consensus.cc:493] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.978077  2623 raft_consensus.cc:515] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:07.980285  2623 leader_election.cc:290] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:07.993376  2577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44df4ef1ded34193929461692a5dfe82" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8" is_pre_election: true
I20260709 12:14:07.993499  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44df4ef1ded34193929461692a5dfe82" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13484a08eef24417a924d54af0dc54c0" is_pre_election: true
I20260709 12:14:07.994235  2577 raft_consensus.cc:2468] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 0.
I20260709 12:14:07.994359  2503 raft_consensus.cc:2468] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 0.
I20260709 12:14:07.995683  2392 leader_election.cc:304] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ac0b54ff054765ada933f5db0cc8f8, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:07.996554  2623 raft_consensus.cc:2804] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:07.996963  2623 raft_consensus.cc:493] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.997200  2623 raft_consensus.cc:3060] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.003675  2623 raft_consensus.cc:515] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.005720  2623 leader_election.cc:290] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 1 election: Requested vote from peers 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:08.006701  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44df4ef1ded34193929461692a5dfe82" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13484a08eef24417a924d54af0dc54c0"
I20260709 12:14:08.007321  2577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44df4ef1ded34193929461692a5dfe82" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
I20260709 12:14:08.007359  2503 raft_consensus.cc:3060] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.007936  2577 raft_consensus.cc:3060] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.013950  2577 raft_consensus.cc:2468] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 1.
I20260709 12:14:08.014025  2503 raft_consensus.cc:2468] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 1.
I20260709 12:14:08.015300  2392 leader_election.cc:304] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ac0b54ff054765ada933f5db0cc8f8, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:08.016280  2623 raft_consensus.cc:2804] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:08.017699  2623 raft_consensus.cc:697] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Running, Role: LEADER
I20260709 12:14:08.018707  2623 consensus_queue.cc:237] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.027871  2325 catalog_manager.cc:5697] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "49e35a97d40e45ca9d20764ff2688dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:08.069658  2325 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53008:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:08.072028  2325 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:08.099160  2417 tablet_service.cc:1511] Processing CreateTablet for tablet 4e545c9d4b4b42ebae7889e0643a4929 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e1edf341c4854220b94a1df3092e4cf7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:08.100984  2417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e545c9d4b4b42ebae7889e0643a4929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.101846  2492 tablet_service.cc:1511] Processing CreateTablet for tablet 4e545c9d4b4b42ebae7889e0643a4929 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e1edf341c4854220b94a1df3092e4cf7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:08.102890  2566 tablet_service.cc:1511] Processing CreateTablet for tablet 4e545c9d4b4b42ebae7889e0643a4929 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e1edf341c4854220b94a1df3092e4cf7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:08.103489  2492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e545c9d4b4b42ebae7889e0643a4929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.104286  2566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e545c9d4b4b42ebae7889e0643a4929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.107802  2418 tablet_service.cc:1511] Processing CreateTablet for tablet b76f609019e14c129933b626ba63fa41 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e1edf341c4854220b94a1df3092e4cf7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:08.108752  2567 tablet_service.cc:1511] Processing CreateTablet for tablet b76f609019e14c129933b626ba63fa41 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e1edf341c4854220b94a1df3092e4cf7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:08.109361  2418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f609019e14c129933b626ba63fa41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.110215  2567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f609019e14c129933b626ba63fa41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.113255  2493 tablet_service.cc:1511] Processing CreateTablet for tablet b76f609019e14c129933b626ba63fa41 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e1edf341c4854220b94a1df3092e4cf7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:08.114707  2493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76f609019e14c129933b626ba63fa41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.128031  2619 tablet_bootstrap.cc:492] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: Bootstrap starting.
I20260709 12:14:08.135437  2619 tablet_bootstrap.cc:654] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.136896  2617 tablet_bootstrap.cc:492] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: Bootstrap starting.
I20260709 12:14:08.150162  2618 tablet_bootstrap.cc:492] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: Bootstrap starting.
I20260709 12:14:08.150913  2617 tablet_bootstrap.cc:654] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.161094  2618 tablet_bootstrap.cc:654] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.162901  2619 tablet_bootstrap.cc:492] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: No bootstrap required, opened a new log
I20260709 12:14:08.163600  2619 ts_tablet_manager.cc:1403] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.008s
I20260709 12:14:08.164255  2617 tablet_bootstrap.cc:492] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: No bootstrap required, opened a new log
I20260709 12:14:08.164891  2617 ts_tablet_manager.cc:1403] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.006s
I20260709 12:14:08.167101  2619 raft_consensus.cc:359] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.168002  2619 raft_consensus.cc:385] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.168345  2619 raft_consensus.cc:740] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.169267  2619 consensus_queue.cc:260] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.169425  2617 raft_consensus.cc:359] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.170308  2617 raft_consensus.cc:385] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.170697  2617 raft_consensus.cc:740] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.171597  2617 consensus_queue.cc:260] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.172086  2619 ts_tablet_manager.cc:1434] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:14:08.172995  2618 tablet_bootstrap.cc:492] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: No bootstrap required, opened a new log
I20260709 12:14:08.173648  2619 tablet_bootstrap.cc:492] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8: Bootstrap starting.
I20260709 12:14:08.174662  2617 ts_tablet_manager.cc:1434] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:08.175917  2617 tablet_bootstrap.cc:492] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3: Bootstrap starting.
I20260709 12:14:08.182477  2619 tablet_bootstrap.cc:654] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.183575  2617 tablet_bootstrap.cc:654] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.173624  2618 ts_tablet_manager.cc:1403] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 12:14:08.191042  2618 raft_consensus.cc:359] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.191977  2618 raft_consensus.cc:385] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.192346  2618 raft_consensus.cc:740] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.193347  2618 consensus_queue.cc:260] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.197129  2617 tablet_bootstrap.cc:492] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3: No bootstrap required, opened a new log
I20260709 12:14:08.198103  2617 ts_tablet_manager.cc:1403] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 12:14:08.198208  2618 ts_tablet_manager.cc:1434] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:14:08.200317  2618 tablet_bootstrap.cc:492] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0: Bootstrap starting.
I20260709 12:14:08.202315  2619 tablet_bootstrap.cc:492] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8: No bootstrap required, opened a new log
I20260709 12:14:08.202154  2617 raft_consensus.cc:359] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.203011  2619 ts_tablet_manager.cc:1403] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.017s
I20260709 12:14:08.203279  2617 raft_consensus.cc:385] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.203694  2617 raft_consensus.cc:740] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.204788  2617 consensus_queue.cc:260] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.206498  2619 raft_consensus.cc:359] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.207342  2619 raft_consensus.cc:385] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.207378  2617 ts_tablet_manager.cc:1434] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:14:08.208381  2618 tablet_bootstrap.cc:654] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:08.207834  2619 raft_consensus.cc:740] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.209815  2619 consensus_queue.cc:260] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.212534  2619 ts_tablet_manager.cc:1434] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:08.218611  2618 tablet_bootstrap.cc:492] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0: No bootstrap required, opened a new log
I20260709 12:14:08.219352  2618 ts_tablet_manager.cc:1403] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:14:08.222483  2618 raft_consensus.cc:359] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.223361  2618 raft_consensus.cc:385] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:08.223735  2618 raft_consensus.cc:740] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Initialized, Role: FOLLOWER
I20260709 12:14:08.224720  2618 consensus_queue.cc:260] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.227330  2618 ts_tablet_manager.cc:1434] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:08.342192  2622 consensus_queue.cc:1048] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:08.356941  2622 consensus_queue.cc:1048] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:08.367168  2649 raft_consensus.cc:493] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.367900  2649 raft_consensus.cc:515] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.370527  2649 leader_election.cc:290] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:08.371287  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f609019e14c129933b626ba63fa41" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3" is_pre_election: true
I20260709 12:14:08.372339  2576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f609019e14c129933b626ba63fa41" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8" is_pre_election: true
I20260709 12:14:08.372452  2428 raft_consensus.cc:2468] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 0.
I20260709 12:14:08.373054  2576 raft_consensus.cc:2468] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 0.
I20260709 12:14:08.373885  2466 leader_election.cc:304] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:08.375662  2649 raft_consensus.cc:2804] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:08.376538  2649 raft_consensus.cc:493] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.377261  2649 raft_consensus.cc:3060] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.383538  2649 raft_consensus.cc:515] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.386101  2649 leader_election.cc:290] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 election: Requested vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:08.386762  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f609019e14c129933b626ba63fa41" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
I20260709 12:14:08.387022  2576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f609019e14c129933b626ba63fa41" candidate_uuid: "13484a08eef24417a924d54af0dc54c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
I20260709 12:14:08.387418  2428 raft_consensus.cc:3060] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.387696  2576 raft_consensus.cc:3060] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.395064  2576 raft_consensus.cc:2468] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 1.
I20260709 12:14:08.395588  2428 raft_consensus.cc:2468] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13484a08eef24417a924d54af0dc54c0 in term 1.
I20260709 12:14:08.396432  2467 leader_election.cc:304] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49ac0b54ff054765ada933f5db0cc8f8; no voters: 
I20260709 12:14:08.397347  2649 raft_consensus.cc:2804] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:08.397891  2649 raft_consensus.cc:697] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Becoming Leader. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Running, Role: LEADER
I20260709 12:14:08.398762  2649 consensus_queue.cc:237] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.407119  2325 catalog_manager.cc:5697] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13484a08eef24417a924d54af0dc54c0 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "13484a08eef24417a924d54af0dc54c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:08.456537  2623 consensus_queue.cc:1048] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:08.468503  2658 consensus_queue.cc:1048] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:08.479615  2627 raft_consensus.cc:493] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.480237  2627 raft_consensus.cc:515] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.482980  2627 leader_election.cc:290] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081)
I20260709 12:14:08.499480  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49ac0b54ff054765ada933f5db0cc8f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3" is_pre_election: true
I20260709 12:14:08.499719  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49ac0b54ff054765ada933f5db0cc8f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13484a08eef24417a924d54af0dc54c0" is_pre_election: true
I20260709 12:14:08.500313  2428 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ac0b54ff054765ada933f5db0cc8f8 in term 0.
I20260709 12:14:08.500505  2503 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49ac0b54ff054765ada933f5db0cc8f8 in term 0.
I20260709 12:14:08.501824  2540 leader_election.cc:304] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ac0b54ff054765ada933f5db0cc8f8, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:08.502626  2627 raft_consensus.cc:2804] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:08.502974  2627 raft_consensus.cc:493] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.503258  2627 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.509802  2627 raft_consensus.cc:515] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.511714  2627 leader_election.cc:290] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [CANDIDATE]: Term 1 election: Requested vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081)
I20260709 12:14:08.512989  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49ac0b54ff054765ada933f5db0cc8f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
I20260709 12:14:08.513032  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49ac0b54ff054765ada933f5db0cc8f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13484a08eef24417a924d54af0dc54c0"
I20260709 12:14:08.513860  2428 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.513929  2503 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:08.520502  2503 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ac0b54ff054765ada933f5db0cc8f8 in term 1.
I20260709 12:14:08.520509  2428 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ac0b54ff054765ada933f5db0cc8f8 in term 1.
I20260709 12:14:08.521972  2540 leader_election.cc:304] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49ac0b54ff054765ada933f5db0cc8f8, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:08.522812  2627 raft_consensus.cc:2804] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:08.523803  2627 raft_consensus.cc:697] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 LEADER]: Becoming Leader. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Running, Role: LEADER
I20260709 12:14:08.524677  2627 consensus_queue.cc:237] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.532555  2325 catalog_manager.cc:5697] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "49ac0b54ff054765ada933f5db0cc8f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.618999  2576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929"
dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
mode: GRACEFUL
new_leader_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
 from {username='slave'} at 127.0.0.1:40500
I20260709 12:14:08.619663  2576 raft_consensus.cc:606] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 LEADER]: Received request to transfer leadership to TS 49e35a97d40e45ca9d20764ff2688dc3
I20260709 12:14:08.634889  2503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76f609019e14c129933b626ba63fa41"
dest_uuid: "13484a08eef24417a924d54af0dc54c0"
mode: GRACEFUL
new_leader_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
 from {username='slave'} at 127.0.0.1:35234
I20260709 12:14:08.635607  2503 raft_consensus.cc:606] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Received request to transfer leadership to TS 49e35a97d40e45ca9d20764ff2688dc3
I20260709 12:14:08.905617  2622 consensus_queue.cc:1048] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:08.913329  2652 raft_consensus.cc:993] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: : Instructing follower 49e35a97d40e45ca9d20764ff2688dc3 to start an election
I20260709 12:14:08.913913  2652 raft_consensus.cc:1081] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Signalling peer 49e35a97d40e45ca9d20764ff2688dc3 to start an election
I20260709 12:14:08.918856  2428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b76f609019e14c129933b626ba63fa41"
dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
 from {username='slave'} at 127.0.0.1:49966
I20260709 12:14:08.919634  2428 raft_consensus.cc:493] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:08.920027  2428 raft_consensus.cc:3060] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:08.920152  2622 consensus_queue.cc:1048] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:08.930459  2428 raft_consensus.cc:515] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.933013  2428 leader_election.cc:290] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 2 election: Requested vote from peers 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:08.933218  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f609019e14c129933b626ba63fa41" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13484a08eef24417a924d54af0dc54c0"
I20260709 12:14:08.934181  2503 raft_consensus.cc:3055] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:08.934700  2503 raft_consensus.cc:740] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13484a08eef24417a924d54af0dc54c0, State: Running, Role: LEADER
I20260709 12:14:08.934589  2576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76f609019e14c129933b626ba63fa41" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
I20260709 12:14:08.935426  2576 raft_consensus.cc:3060] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:08.935838  2503 consensus_queue.cc:260] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.937326  2503 raft_consensus.cc:3060] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:08.947772  2503 raft_consensus.cc:2468] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 2.
I20260709 12:14:08.949445  2393 leader_election.cc:304] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:08.950413  2658 raft_consensus.cc:2804] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:08.950968  2658 raft_consensus.cc:697] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Becoming Leader. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Running, Role: LEADER
I20260709 12:14:08.951813  2658 consensus_queue.cc:237] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:08.952818  2576 raft_consensus.cc:2468] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 2.
I20260709 12:14:08.960167  2324 catalog_manager.cc:5697] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 reported cstate change: term changed from 1 to 2, leader changed from 13484a08eef24417a924d54af0dc54c0 (127.23.222.130) to 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "49e35a97d40e45ca9d20764ff2688dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.025571  2627 consensus_queue.cc:1048] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:09.039583  2627 consensus_queue.cc:1048] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:09.048601  2670 raft_consensus.cc:993] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: : Instructing follower 49e35a97d40e45ca9d20764ff2688dc3 to start an election
I20260709 12:14:09.049177  2627 raft_consensus.cc:1081] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 LEADER]: Signalling peer 49e35a97d40e45ca9d20764ff2688dc3 to start an election
I20260709 12:14:09.050987  2428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929"
dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
 from {username='slave'} at 127.0.0.1:49968
I20260709 12:14:09.051628  2428 raft_consensus.cc:493] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.051962  2428 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.058506  2428 raft_consensus.cc:515] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:09.060473  2428 leader_election.cc:290] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 2 election: Requested vote from peers 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081), 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131:41211)
I20260709 12:14:09.061647  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13484a08eef24417a924d54af0dc54c0"
I20260709 12:14:09.061816  2576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49e35a97d40e45ca9d20764ff2688dc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
I20260709 12:14:09.062539  2503 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.062582  2576 raft_consensus.cc:3055] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:09.063117  2576 raft_consensus.cc:740] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Running, Role: LEADER
I20260709 12:14:09.064073  2576 consensus_queue.cc:260] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:09.065490  2576 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:09.072716  2503 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 2.
I20260709 12:14:09.075018  2393 leader_election.cc:304] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49e35a97d40e45ca9d20764ff2688dc3; no voters: 
I20260709 12:14:09.075536  2576 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49e35a97d40e45ca9d20764ff2688dc3 in term 2.
I20260709 12:14:09.075837  2658 raft_consensus.cc:2804] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:09.076412  2658 raft_consensus.cc:697] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Becoming Leader. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Running, Role: LEADER
I20260709 12:14:09.077366  2658 consensus_queue.cc:237] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:09.084458  2325 catalog_manager.cc:5697] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 reported cstate change: term changed from 1 to 2, leader changed from 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131) to 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "49e35a97d40e45ca9d20764ff2688dc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.114898 24442 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:14:09.116791 24442 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:14:09.117257 24442 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:14:09.130851  2428 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929"
dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
mode: GRACEFUL
new_leader_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
 from {username='slave'} at 127.0.0.1:49974
I20260709 12:14:09.131487  2428 raft_consensus.cc:606] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Received request to transfer leadership to TS 49ac0b54ff054765ada933f5db0cc8f8
I20260709 12:14:09.132992 24442 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:14:09.427306  2503 raft_consensus.cc:1275] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Refusing update from remote peer 49e35a97d40e45ca9d20764ff2688dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.428887  2658 consensus_queue.cc:1048] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.437534  2576 raft_consensus.cc:1275] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Refusing update from remote peer 49e35a97d40e45ca9d20764ff2688dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.440019  2623 consensus_queue.cc:1048] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.587190  2503 raft_consensus.cc:1275] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Refusing update from remote peer 49e35a97d40e45ca9d20764ff2688dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.588675  2623 consensus_queue.cc:1048] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.598685  2576 raft_consensus.cc:1275] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Refusing update from remote peer 49e35a97d40e45ca9d20764ff2688dc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:09.601387  2623 consensus_queue.cc:1048] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:09.608543  2658 raft_consensus.cc:993] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: : Instructing follower 49ac0b54ff054765ada933f5db0cc8f8 to start an election
I20260709 12:14:09.609154  2623 raft_consensus.cc:1081] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Signalling peer 49ac0b54ff054765ada933f5db0cc8f8 to start an election
I20260709 12:14:09.611074  2576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929"
dest_uuid: "49ac0b54ff054765ada933f5db0cc8f8"
 from {username='slave'} at 127.0.0.1:40484
I20260709 12:14:09.611639  2576 raft_consensus.cc:493] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:09.611989  2576 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.617966  2576 raft_consensus.cc:515] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:09.620065  2576 leader_election.cc:290] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [CANDIDATE]: Term 3 election: Requested vote from peers 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129:34389), 13484a08eef24417a924d54af0dc54c0 (127.23.222.130:38081)
I20260709 12:14:09.621073  2428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49ac0b54ff054765ada933f5db0cc8f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49e35a97d40e45ca9d20764ff2688dc3"
I20260709 12:14:09.621598  2503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e545c9d4b4b42ebae7889e0643a4929" candidate_uuid: "49ac0b54ff054765ada933f5db0cc8f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13484a08eef24417a924d54af0dc54c0"
I20260709 12:14:09.621815  2428 raft_consensus.cc:3055] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:09.622223  2428 raft_consensus.cc:740] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49e35a97d40e45ca9d20764ff2688dc3, State: Running, Role: LEADER
I20260709 12:14:09.622362  2503 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.623167  2428 consensus_queue.cc:260] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:09.624594  2428 raft_consensus.cc:3060] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:09.630676  2503 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ac0b54ff054765ada933f5db0cc8f8 in term 3.
I20260709 12:14:09.632025  2428 raft_consensus.cc:2468] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49ac0b54ff054765ada933f5db0cc8f8 in term 3.
I20260709 12:14:09.632326  2542 leader_election.cc:304] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13484a08eef24417a924d54af0dc54c0, 49ac0b54ff054765ada933f5db0cc8f8; no voters: 
I20260709 12:14:09.633351  2627 raft_consensus.cc:2804] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:09.634557  2627 raft_consensus.cc:697] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 3 LEADER]: Becoming Leader. State: Replica: 49ac0b54ff054765ada933f5db0cc8f8, State: Running, Role: LEADER
I20260709 12:14:09.635317  2627 consensus_queue.cc:237] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } }
I20260709 12:14:09.642771  2325 catalog_manager.cc:5697] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 reported cstate change: term changed from 2 to 3, leader changed from 49e35a97d40e45ca9d20764ff2688dc3 (127.23.222.129) to 49ac0b54ff054765ada933f5db0cc8f8 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "49ac0b54ff054765ada933f5db0cc8f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49e35a97d40e45ca9d20764ff2688dc3" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 34389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13484a08eef24417a924d54af0dc54c0" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 38081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49ac0b54ff054765ada933f5db0cc8f8" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 41211 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:09.771898 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
I20260709 12:14:09.792917 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:09.793671 24442 tablet_replica.cc:333] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3: stopping tablet replica
I20260709 12:14:09.794232 24442 raft_consensus.cc:2243] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:09.795481 24442 raft_consensus.cc:2272] T b76f609019e14c129933b626ba63fa41 P 49e35a97d40e45ca9d20764ff2688dc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.798719 24442 tablet_replica.cc:333] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3: stopping tablet replica
I20260709 12:14:09.799373 24442 raft_consensus.cc:2243] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.799829 24442 raft_consensus.cc:2272] T 4e545c9d4b4b42ebae7889e0643a4929 P 49e35a97d40e45ca9d20764ff2688dc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.802503 24442 tablet_replica.cc:333] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3: stopping tablet replica
I20260709 12:14:09.803054 24442 raft_consensus.cc:2243] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:09.803897 24442 raft_consensus.cc:2272] T 44df4ef1ded34193929461692a5dfe82 P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.806223 24442 tablet_replica.cc:333] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3: stopping tablet replica
I20260709 12:14:09.807025 24442 raft_consensus.cc:2243] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.807471 24442 raft_consensus.cc:2272] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49e35a97d40e45ca9d20764ff2688dc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.837517 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
I20260709 12:14:09.854998 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
I20260709 12:14:09.874778 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:09.875512 24442 tablet_replica.cc:333] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0: stopping tablet replica
I20260709 12:14:09.876148 24442 raft_consensus.cc:2243] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.876675 24442 raft_consensus.cc:2272] T 4e545c9d4b4b42ebae7889e0643a4929 P 13484a08eef24417a924d54af0dc54c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.879622 24442 tablet_replica.cc:333] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0: stopping tablet replica
I20260709 12:14:09.880252 24442 raft_consensus.cc:2243] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.880772 24442 raft_consensus.cc:2272] T b76f609019e14c129933b626ba63fa41 P 13484a08eef24417a924d54af0dc54c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.883533 24442 tablet_replica.cc:333] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0: stopping tablet replica
I20260709 12:14:09.884090 24442 raft_consensus.cc:2243] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.884538 24442 raft_consensus.cc:2272] T 44df4ef1ded34193929461692a5dfe82 P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.886529 24442 tablet_replica.cc:333] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0: stopping tablet replica
I20260709 12:14:09.887010 24442 raft_consensus.cc:2243] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:09.887869 24442 raft_consensus.cc:2272] T 916f7ff881fa4bd28bfe5dfdc777cabd P 13484a08eef24417a924d54af0dc54c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.912132 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
I20260709 12:14:09.928020 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
I20260709 12:14:09.949971 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:09.951139 24442 tablet_replica.cc:333] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8: stopping tablet replica
I20260709 12:14:09.952114 24442 raft_consensus.cc:2243] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.952734 24442 raft_consensus.cc:2272] T b76f609019e14c129933b626ba63fa41 P 49ac0b54ff054765ada933f5db0cc8f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.956207 24442 tablet_replica.cc:333] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: stopping tablet replica
I20260709 12:14:09.956866 24442 raft_consensus.cc:2243] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:09.957734 24442 pending_rounds.cc:70] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: Trying to abort 1 pending ops.
I20260709 12:14:09.957923 24442 pending_rounds.cc:77] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622526514237440 op_type: NO_OP noop_request { }
I20260709 12:14:09.958369 24442 raft_consensus.cc:2889] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:09.958709 24442 raft_consensus.cc:2272] T 4e545c9d4b4b42ebae7889e0643a4929 P 49ac0b54ff054765ada933f5db0cc8f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.961532 24442 tablet_replica.cc:333] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8: stopping tablet replica
I20260709 12:14:09.962385 24442 raft_consensus.cc:2243] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.962906 24442 raft_consensus.cc:2272] T 44df4ef1ded34193929461692a5dfe82 P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.965015 24442 tablet_replica.cc:333] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8: stopping tablet replica
I20260709 12:14:09.965549 24442 raft_consensus.cc:2243] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:09.966003 24442 raft_consensus.cc:2272] T 916f7ff881fa4bd28bfe5dfdc777cabd P 49ac0b54ff054765ada933f5db0cc8f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:09.991467 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:14:10.007521 24442 master.cc:562] Master@127.23.222.190:42173 shutting down...
I20260709 12:14:10.026299 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:10.026997 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:10.027352 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P b32c8c2a42e14c58863a4f488be825a9: stopping tablet replica
I20260709 12:14:10.039987 24442 master.cc:584] Master@127.23.222.190:42173 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3253 ms)
[----------] 6 tests from LeaderRebalancerTest (355075 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:14:10.075390 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:38881
I20260709 12:14:10.076694 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:10.082505  2679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:10.082726  2680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:10.084328  2682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:10.085686 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:10.087019 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:10.087335 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:10.087548 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599250087516 us; error 0 us; skew 500 ppm
I20260709 12:14:10.088274 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:10.092074 24442 webserver.cc:533] Webserver started at http://127.23.222.190:39733/ using document root <none> and password file <none>
I20260709 12:14:10.093143 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:10.093426 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:10.094017 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:10.095638 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "0f4ee6461ce7432288a62552b3725478"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.101315 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:14:10.105396  2687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.106514 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:10.106858 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "0f4ee6461ce7432288a62552b3725478"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.107131 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:10.121753 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:10.123000 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:10.164462 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:38881
I20260709 12:14:10.164601  2738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:38881 every 8 connection(s)
I20260709 12:14:10.168715  2739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.182040  2739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478: Bootstrap starting.
I20260709 12:14:10.187534  2739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:10.192550  2739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478: No bootstrap required, opened a new log
I20260709 12:14:10.194996  2739 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f4ee6461ce7432288a62552b3725478" member_type: VOTER }
I20260709 12:14:10.195544  2739 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:10.195814  2739 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4ee6461ce7432288a62552b3725478, State: Initialized, Role: FOLLOWER
I20260709 12:14:10.196532  2739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f4ee6461ce7432288a62552b3725478" member_type: VOTER }
I20260709 12:14:10.197044  2739 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:10.197261  2739 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:10.197613  2739 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:10.203351  2739 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f4ee6461ce7432288a62552b3725478" member_type: VOTER }
I20260709 12:14:10.204027  2739 leader_election.cc:304] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f4ee6461ce7432288a62552b3725478; no voters: 
I20260709 12:14:10.205293  2739 leader_election.cc:290] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:10.205716  2742 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:10.207413  2742 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 1 LEADER]: Becoming Leader. State: Replica: 0f4ee6461ce7432288a62552b3725478, State: Running, Role: LEADER
I20260709 12:14:10.208151  2742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f4ee6461ce7432288a62552b3725478" member_type: VOTER }
I20260709 12:14:10.208684  2739 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:10.211294  2743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f4ee6461ce7432288a62552b3725478" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f4ee6461ce7432288a62552b3725478" member_type: VOTER } }
I20260709 12:14:10.212155  2743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:10.211297  2744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f4ee6461ce7432288a62552b3725478. Latest consensus state: current_term: 1 leader_uuid: "0f4ee6461ce7432288a62552b3725478" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f4ee6461ce7432288a62552b3725478" member_type: VOTER } }
I20260709 12:14:10.213136  2744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:10.215680  2747 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:10.220954  2747 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:10.231436  2747 catalog_manager.cc:1383] Generated new cluster ID: 5f5c99627bf74c3ab2055919bbbb77d4
I20260709 12:14:10.231926  2747 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:10.232152 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:10.265893  2747 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:10.267462  2747 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:10.282451  2747 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478: Generated new TSK 0
I20260709 12:14:10.283176  2747 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:10.299595 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:10.307144  2760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:10.307754  2761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:10.311760 24442 server_base.cc:1061] running on GCE node
W20260709 12:14:10.311655  2763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:10.313179 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:10.313391 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:10.313520 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599250313508 us; error 0 us; skew 500 ppm
I20260709 12:14:10.314066 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:10.316892 24442 webserver.cc:533] Webserver started at http://127.23.222.129:45351/ using document root <none> and password file <none>
I20260709 12:14:10.317379 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:10.317565 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:10.317800 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:10.319074 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "0567de2e86f64dcd955de7b57f97deb8"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.323930 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:14:10.327836  2768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.328795 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:10.329172 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "0567de2e86f64dcd955de7b57f97deb8"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.329471 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:10.348706 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:10.350358 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:10.352285 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:10.355255 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:10.355475 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.355779 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:10.355983 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.405618 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:32859
I20260709 12:14:10.405727  2830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:32859 every 8 connection(s)
I20260709 12:14:10.411518 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:10.420464  2835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:10.421348  2836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:10.423972  2838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:10.425755 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:10.426959 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:10.427186 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:10.427413 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599250427394 us; error 0 us; skew 500 ppm
I20260709 12:14:10.428139 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:10.429852  2831 heartbeater.cc:344] Connected to a master server at 127.23.222.190:38881
I20260709 12:14:10.430485  2831 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:10.431128 24442 webserver.cc:533] Webserver started at http://127.23.222.130:41575/ using document root <none> and password file <none>
I20260709 12:14:10.431499  2831 heartbeater.cc:507] Master 127.23.222.190:38881 requested a full tablet report, sending...
I20260709 12:14:10.431782 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:10.432091 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:10.432402 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:10.433753 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "8c9892e39cad43c1b378df6880ff1585"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.434141  2704 ts_manager.cc:194] Registered new tserver with Master: 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859)
I20260709 12:14:10.436714  2704 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48532
I20260709 12:14:10.439328 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:14:10.444176  2843 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.445101 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:14:10.445451 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "8c9892e39cad43c1b378df6880ff1585"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.445779 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:10.505574 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:10.507313 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:10.509196 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:10.512001 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:10.512274 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.512542 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:10.512720 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.560072 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:45697
I20260709 12:14:10.560199  2905 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:45697 every 8 connection(s)
I20260709 12:14:10.565476 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:10.573099  2909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:10.574653  2910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:10.578187 24442 server_base.cc:1061] running on GCE node
W20260709 12:14:10.578030  2912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:10.579308  2906 heartbeater.cc:344] Connected to a master server at 127.23.222.190:38881
I20260709 12:14:10.579622 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:14:10.579782  2906 heartbeater.cc:461] Registering TS with master...
W20260709 12:14:10.579931 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:10.580173 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599250580151 us; error 0 us; skew 500 ppm
I20260709 12:14:10.580832  2906 heartbeater.cc:507] Master 127.23.222.190:38881 requested a full tablet report, sending...
I20260709 12:14:10.581045 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:10.583778  2704 ts_manager.cc:194] Registered new tserver with Master: 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:10.584299 24442 webserver.cc:533] Webserver started at http://127.23.222.131:44897/ using document root <none> and password file <none>
I20260709 12:14:10.584887 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:10.585109 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:10.585398 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:10.585577  2704 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48548
I20260709 12:14:10.586920 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "bf434d3160e048d2ae43783dcb5c4452"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.592306 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:10.596155  2917 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.596983 24442 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:14:10.597329 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "bf434d3160e048d2ae43783dcb5c4452"
format_stamp: "Formatted at 2026-07-09 12:14:10 on dist-test-slave-90bm"
I20260709 12:14:10.597608 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:10.620955 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:10.622232 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:10.623850 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:10.626374 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:10.626557 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.626875 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:10.627023 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:10.676185 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:34185
I20260709 12:14:10.676309  2979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:34185 every 8 connection(s)
I20260709 12:14:10.693846  2980 heartbeater.cc:344] Connected to a master server at 127.23.222.190:38881
I20260709 12:14:10.694489  2980 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:10.695363  2980 heartbeater.cc:507] Master 127.23.222.190:38881 requested a full tablet report, sending...
I20260709 12:14:10.697976  2704 ts_manager.cc:194] Registered new tserver with Master: bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:10.698127 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018124704s
I20260709 12:14:10.700030  2704 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48560
I20260709 12:14:10.729833  2704 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48568:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:10.732900  2704 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:10.819303  2871 tablet_service.cc:1511] Processing CreateTablet for tablet abcb55386d074c40b86d773780c27daf (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:10.820940  2871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcb55386d074c40b86d773780c27daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.831208  2870 tablet_service.cc:1511] Processing CreateTablet for tablet 0908f97816214cddbd15d618c9725306 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:10.832921  2870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0908f97816214cddbd15d618c9725306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.833465  2865 tablet_service.cc:1511] Processing CreateTablet for tablet be559602e94449c0a4adad5067dd1178 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:10.835054  2865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be559602e94449c0a4adad5067dd1178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.835454  2869 tablet_service.cc:1511] Processing CreateTablet for tablet 18df1b1df2734612a43e25825eb17a89 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:10.836881  2869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18df1b1df2734612a43e25825eb17a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.837493  2794 tablet_service.cc:1511] Processing CreateTablet for tablet 18df1b1df2734612a43e25825eb17a89 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:10.839048  2794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18df1b1df2734612a43e25825eb17a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.839480  2868 tablet_service.cc:1511] Processing CreateTablet for tablet f4859451644e4e9b81e16da7480bde72 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:10.840938  2868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4859451644e4e9b81e16da7480bde72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.841183  2867 tablet_service.cc:1511] Processing CreateTablet for tablet c42f985376024658a96143f87d8bff18 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:10.842692  2867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f985376024658a96143f87d8bff18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.843003  2793 tablet_service.cc:1511] Processing CreateTablet for tablet f4859451644e4e9b81e16da7480bde72 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:10.844465  2793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4859451644e4e9b81e16da7480bde72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.845014  2866 tablet_service.cc:1511] Processing CreateTablet for tablet 88c6ee4ba61149afad248ea2580eedd3 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:10.846040  2792 tablet_service.cc:1511] Processing CreateTablet for tablet c42f985376024658a96143f87d8bff18 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:10.846778  2866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c6ee4ba61149afad248ea2580eedd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.851485  2796 tablet_service.cc:1511] Processing CreateTablet for tablet abcb55386d074c40b86d773780c27daf (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:10.854103  2790 tablet_service.cc:1511] Processing CreateTablet for tablet be559602e94449c0a4adad5067dd1178 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:10.854419  2945 tablet_service.cc:1511] Processing CreateTablet for tablet abcb55386d074c40b86d773780c27daf (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:10.855866  2945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcb55386d074c40b86d773780c27daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.856521  2791 tablet_service.cc:1511] Processing CreateTablet for tablet 88c6ee4ba61149afad248ea2580eedd3 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:10.859483  2944 tablet_service.cc:1511] Processing CreateTablet for tablet 0908f97816214cddbd15d618c9725306 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:10.860980  2944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0908f97816214cddbd15d618c9725306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.863240  2943 tablet_service.cc:1511] Processing CreateTablet for tablet 18df1b1df2734612a43e25825eb17a89 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:10.863927  2864 tablet_service.cc:1511] Processing CreateTablet for tablet a05f73e044004481ade3b0f468be3102 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:10.865353  2943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18df1b1df2734612a43e25825eb17a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.865417  2864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05f73e044004481ade3b0f468be3102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.867853  2942 tablet_service.cc:1511] Processing CreateTablet for tablet f4859451644e4e9b81e16da7480bde72 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:10.870177  2942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4859451644e4e9b81e16da7480bde72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.875308  2937 tablet_service.cc:1511] Processing CreateTablet for tablet 92d44dd63c74460186ed3e42516f6dd0 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:10.870819  2792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f985376024658a96143f87d8bff18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.876777  2937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d44dd63c74460186ed3e42516f6dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.870553  2939 tablet_service.cc:1511] Processing CreateTablet for tablet be559602e94449c0a4adad5067dd1178 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:10.878759  2791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c6ee4ba61149afad248ea2580eedd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.879230  2939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be559602e94449c0a4adad5067dd1178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.881773  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcb55386d074c40b86d773780c27daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.837570  2795 tablet_service.cc:1511] Processing CreateTablet for tablet 0908f97816214cddbd15d618c9725306 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:10.883288  2795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0908f97816214cddbd15d618c9725306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.886715  2790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be559602e94449c0a4adad5067dd1178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.887835  2863 tablet_service.cc:1511] Processing CreateTablet for tablet 92d44dd63c74460186ed3e42516f6dd0 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:10.889720  2863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d44dd63c74460186ed3e42516f6dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.871565  2941 tablet_service.cc:1511] Processing CreateTablet for tablet c42f985376024658a96143f87d8bff18 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:10.872865  2938 tablet_service.cc:1511] Processing CreateTablet for tablet a05f73e044004481ade3b0f468be3102 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:10.873508  2940 tablet_service.cc:1511] Processing CreateTablet for tablet 88c6ee4ba61149afad248ea2580eedd3 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:10.892647  2941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f985376024658a96143f87d8bff18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.896701  2789 tablet_service.cc:1511] Processing CreateTablet for tablet a05f73e044004481ade3b0f468be3102 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:10.897878  2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05f73e044004481ade3b0f468be3102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.898591  2789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05f73e044004481ade3b0f468be3102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.900250  2940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c6ee4ba61149afad248ea2580eedd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.911954  2788 tablet_service.cc:1511] Processing CreateTablet for tablet 92d44dd63c74460186ed3e42516f6dd0 (DEFAULT_TABLE table=test-workload [id=05a91a9f1a7f438589d3593fd1b5b7b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:10.913734  2788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d44dd63c74460186ed3e42516f6dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:10.941547  2995 tablet_bootstrap.cc:492] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:10.987596  2995 tablet_bootstrap.cc:654] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.016350  2996 tablet_bootstrap.cc:492] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.024951  2996 tablet_bootstrap.cc:654] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.031445  2997 tablet_bootstrap.cc:492] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.041256  2997 tablet_bootstrap.cc:654] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.052438  2996 tablet_bootstrap.cc:492] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.053318  2996 ts_tablet_manager.cc:1403] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.013s
I20260709 12:14:11.057022  2996 raft_consensus.cc:359] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.057905  2996 raft_consensus.cc:385] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.058210  2996 raft_consensus.cc:740] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.059208  2996 consensus_queue.cc:260] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.060055  2995 tablet_bootstrap.cc:492] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.060738  2995 ts_tablet_manager.cc:1403] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.000s
I20260709 12:14:11.061064  2997 tablet_bootstrap.cc:492] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.061837  2997 ts_tablet_manager.cc:1403] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 12:14:11.063402  2995 raft_consensus.cc:359] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.064122  2995 raft_consensus.cc:385] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.064421  2995 raft_consensus.cc:740] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.065275  2995 consensus_queue.cc:260] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.066471  2997 raft_consensus.cc:359] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.067637  2997 raft_consensus.cc:385] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.068011  2997 raft_consensus.cc:740] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.069147  2906 heartbeater.cc:499] Master 127.23.222.190:38881 was elected leader, sending a full tablet report...
I20260709 12:14:11.069691  2995 ts_tablet_manager.cc:1434] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:11.069361  2997 consensus_queue.cc:260] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.071316  2995 tablet_bootstrap.cc:492] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.079288  2980 heartbeater.cc:499] Master 127.23.222.190:38881 was elected leader, sending a full tablet report...
I20260709 12:14:11.079866  2996 ts_tablet_manager.cc:1434] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.026s	user 0.018s	sys 0.007s
I20260709 12:14:11.080147  2997 ts_tablet_manager.cc:1434] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.004s
I20260709 12:14:11.081239  2831 heartbeater.cc:499] Master 127.23.222.190:38881 was elected leader, sending a full tablet report...
I20260709 12:14:11.081758  2996 tablet_bootstrap.cc:492] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.089918  2996 tablet_bootstrap.cc:654] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.091713  2997 tablet_bootstrap.cc:492] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.092828  2995 tablet_bootstrap.cc:654] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.106408  2997 tablet_bootstrap.cc:654] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.108793  2996 tablet_bootstrap.cc:492] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.108973  2995 tablet_bootstrap.cc:492] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.109642  2995 ts_tablet_manager.cc:1403] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
I20260709 12:14:11.109622  2996 ts_tablet_manager.cc:1403] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.012s
I20260709 12:14:11.113366  2995 raft_consensus.cc:359] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.114295  2995 raft_consensus.cc:385] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.114655  2995 raft_consensus.cc:740] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.115542  2995 consensus_queue.cc:260] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.116855  3001 raft_consensus.cc:493] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.117513  3001 raft_consensus.cc:515] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.118651  2995 ts_tablet_manager.cc:1434] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:11.119845  2995 tablet_bootstrap.cc:492] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.120993  2997 tablet_bootstrap.cc:492] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.122643  2997 ts_tablet_manager.cc:1403] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
I20260709 12:14:11.123669  2996 raft_consensus.cc:359] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.124547  2996 raft_consensus.cc:385] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.124876  2996 raft_consensus.cc:740] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.125911  2996 consensus_queue.cc:260] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.131675  3001 leader_election.cc:290] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:11.132205  2995 tablet_bootstrap.cc:654] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.140226  2996 ts_tablet_manager.cc:1434] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:14:11.141635  2996 tablet_bootstrap.cc:492] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.143676  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a05f73e044004481ade3b0f468be3102" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
W20260709 12:14:11.146735  2918 leader_election.cc:343] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.155201  2996 tablet_bootstrap.cc:654] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.166641  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a05f73e044004481ade3b0f468be3102" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.171276  2995 tablet_bootstrap.cc:492] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.171944  2995 ts_tablet_manager.cc:1403] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.004s
W20260709 12:14:11.172876  2919 leader_election.cc:343] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.173511  2919 leader_election.cc:304] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:11.174618  3007 raft_consensus.cc:2749] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.181510  2997 raft_consensus.cc:359] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.176478  2995 raft_consensus.cc:359] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.183283  2997 raft_consensus.cc:385] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.183362  2995 raft_consensus.cc:385] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.183765  2997 raft_consensus.cc:740] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.183837  2995 raft_consensus.cc:740] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.184784  2997 consensus_queue.cc:260] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.184840  2995 consensus_queue.cc:260] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.187705  2997 ts_tablet_manager.cc:1434] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:14:11.188135  2995 ts_tablet_manager.cc:1434] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:14:11.189026  2997 tablet_bootstrap.cc:492] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.190106  2995 tablet_bootstrap.cc:492] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.197737  2997 tablet_bootstrap.cc:654] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.199877  2995 tablet_bootstrap.cc:654] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.204154  3002 raft_consensus.cc:493] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.204916  3002 raft_consensus.cc:515] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.212534  2996 tablet_bootstrap.cc:492] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.213347  2996 ts_tablet_manager.cc:1403] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.006s
I20260709 12:14:11.217904  2996 raft_consensus.cc:359] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.219161  2996 raft_consensus.cc:385] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.219565  2996 raft_consensus.cc:740] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.220566  2996 consensus_queue.cc:260] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.223694  2996 ts_tablet_manager.cc:1434] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 12:14:11.225013  2752 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:11.225030  2996 tablet_bootstrap.cc:492] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.229921  2997 tablet_bootstrap.cc:492] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.230441  3002 leader_election.cc:290] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.234019  2997 ts_tablet_manager.cc:1403] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.021s
I20260709 12:14:11.235819  2996 tablet_bootstrap.cc:654] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.238955  2997 raft_consensus.cc:359] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.240094  2997 raft_consensus.cc:385] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.240494  2997 raft_consensus.cc:740] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.241578  2997 consensus_queue.cc:260] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.244666  2997 ts_tablet_manager.cc:1434] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:11.245978  2997 tablet_bootstrap.cc:492] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.253935  2997 tablet_bootstrap.cc:654] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.257074  2996 tablet_bootstrap.cc:492] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.257795  2996 ts_tablet_manager.cc:1403] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.013s
I20260709 12:14:11.261297  2996 raft_consensus.cc:359] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.262202  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.232813  2995 tablet_bootstrap.cc:492] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.263175  2955 raft_consensus.cc:2468] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:11.263833  2995 ts_tablet_manager.cc:1403] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.012s
I20260709 12:14:11.265075  2847 leader_election.cc:304] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.262163  2996 raft_consensus.cc:385] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.266450  2996 raft_consensus.cc:740] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.267340  2996 consensus_queue.cc:260] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.267601  2995 raft_consensus.cc:359] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.268476  2995 raft_consensus.cc:385] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.268826  2995 raft_consensus.cc:740] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.270201  2995 consensus_queue.cc:260] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.416062  3003 raft_consensus.cc:493] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.416766  3003 raft_consensus.cc:515] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.423034  3003 leader_election.cc:290] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.448288  2995 ts_tablet_manager.cc:1434] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.184s	user 0.006s	sys 0.012s
I20260709 12:14:11.449821  2995 tablet_bootstrap.cc:492] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.279922  3002 raft_consensus.cc:2804] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.458225  3002 raft_consensus.cc:493] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.458707  3002 raft_consensus.cc:3060] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.458845  2995 tablet_bootstrap.cc:654] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.469353  2995 tablet_bootstrap.cc:492] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.470172  2995 ts_tablet_manager.cc:1403] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:14:11.473687  2995 raft_consensus.cc:359] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.465829  3016 raft_consensus.cc:493] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.474776  2995 raft_consensus.cc:385] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.475293  2995 raft_consensus.cc:740] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.475108  3016 raft_consensus.cc:515] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.476154  2997 tablet_bootstrap.cc:492] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.476917  2997 ts_tablet_manager.cc:1403] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.231s	user 0.029s	sys 0.014s
I20260709 12:14:11.476279  2995 consensus_queue.cc:260] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.478878  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4859451644e4e9b81e16da7480bde72" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:11.481402  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f985376024658a96143f87d8bff18" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.482197  2955 raft_consensus.cc:2468] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.483879  2772 leader_election.cc:304] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.484848  3003 raft_consensus.cc:2804] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.485232  3003 raft_consensus.cc:493] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.485594  3003 raft_consensus.cc:3060] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.486311  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f985376024658a96143f87d8bff18" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.487032  2881 raft_consensus.cc:2468] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.488495  3016 leader_election.cc:290] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.491210  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4859451644e4e9b81e16da7480bde72" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
W20260709 12:14:11.493351  2847 leader_election.cc:343] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.494737  3003 raft_consensus.cc:515] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.495738  2997 raft_consensus.cc:359] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.496532  2997 raft_consensus.cc:385] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.496822  2997 raft_consensus.cc:740] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.497632  2997 consensus_queue.cc:260] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.497915  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f985376024658a96143f87d8bff18" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:11.498697  2881 raft_consensus.cc:3060] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.501379  3002 raft_consensus.cc:515] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.505412  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.506022  2955 raft_consensus.cc:3060] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.507339  3003 leader_election.cc:290] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.508066  3003 raft_consensus.cc:493] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.508539  3003 raft_consensus.cc:515] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.510394  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f985376024658a96143f87d8bff18" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.511324  2954 raft_consensus.cc:3060] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.511901  2881 raft_consensus.cc:2468] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.513489  2770 leader_election.cc:304] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:11.515627  3022 raft_consensus.cc:2804] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.516153  3022 raft_consensus.cc:697] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:11.516812  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.517102  3022 consensus_queue.cc:237] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
W20260709 12:14:11.518682  2770 leader_election.cc:343] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.519912  2997 ts_tablet_manager.cc:1434] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.003s
I20260709 12:14:11.520867  3003 leader_election.cc:290] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.521175  2997 tablet_bootstrap.cc:492] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.522421  3002 leader_election.cc:290] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.523298  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
W20260709 12:14:11.527941  2772 leader_election.cc:343] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.528478  2772 leader_election.cc:304] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8; no voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:11.522461  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:11.530112  3003 raft_consensus.cc:2749] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.531116  2997 tablet_bootstrap.cc:654] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.532850  2996 ts_tablet_manager.cc:1434] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.275s	user 0.013s	sys 0.003s
I20260709 12:14:11.524515  2955 raft_consensus.cc:2468] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:11.534765  2995 ts_tablet_manager.cc:1434] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.064s	user 0.027s	sys 0.031s
I20260709 12:14:11.535542  2847 leader_election.cc:304] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.536106  2995 tablet_bootstrap.cc:492] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.537139  3020 raft_consensus.cc:2804] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.538108  3020 raft_consensus.cc:697] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:11.539402  3020 consensus_queue.cc:237] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.545156  2995 tablet_bootstrap.cc:654] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.552661  2997 tablet_bootstrap.cc:492] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.553244  2997 ts_tablet_manager.cc:1403] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 12:14:11.556453  2997 raft_consensus.cc:359] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.557343  2997 raft_consensus.cc:385] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.557646  2997 raft_consensus.cc:740] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.561230  2996 tablet_bootstrap.cc:492] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.562554  2995 tablet_bootstrap.cc:492] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.563227  2995 ts_tablet_manager.cc:1403] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 12:14:11.562999  2997 consensus_queue.cc:260] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.567520  2997 ts_tablet_manager.cc:1434] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:14:11.567324  2995 raft_consensus.cc:359] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.569052  2995 raft_consensus.cc:385] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.569412  2995 raft_consensus.cc:740] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.570233  2995 consensus_queue.cc:260] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.572331  2997 tablet_bootstrap.cc:492] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.572899  2995 ts_tablet_manager.cc:1434] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:14:11.574508  2995 tablet_bootstrap.cc:492] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.580605  2703 catalog_manager.cc:5697] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.581820  2997 tablet_bootstrap.cc:654] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.582345  2995 tablet_bootstrap.cc:654] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.581274  2702 catalog_manager.cc:5697] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.580505  2954 raft_consensus.cc:2468] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
W20260709 12:14:11.587352  2844 leader_election.cc:343] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.587877  2844 leader_election.cc:304] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:11.588431  2997 tablet_bootstrap.cc:492] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.589016  2997 ts_tablet_manager.cc:1403] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:14:11.589174  3020 raft_consensus.cc:2749] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:11.590643  2844 leader_election.cc:343] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.593482  2997 raft_consensus.cc:359] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.594305  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:11.594673  2997 raft_consensus.cc:385] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.595175  2997 raft_consensus.cc:740] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.595990  2995 tablet_bootstrap.cc:492] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.596706  2995 ts_tablet_manager.cc:1403] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 12:14:11.596060  2997 consensus_queue.cc:260] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.598974  2997 ts_tablet_manager.cc:1434] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 12:14:11.599047  2844 leader_election.cc:343] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.600226  2997 tablet_bootstrap.cc:492] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.600292  2995 raft_consensus.cc:359] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.601186  2995 raft_consensus.cc:385] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.601518  2995 raft_consensus.cc:740] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.602519  2995 consensus_queue.cc:260] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.604718  2996 tablet_bootstrap.cc:654] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.605815  2995 ts_tablet_manager.cc:1434] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:14:11.607127  2995 tablet_bootstrap.cc:492] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.610754  2997 tablet_bootstrap.cc:654] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.618709  2995 tablet_bootstrap.cc:654] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.627542  2996 tablet_bootstrap.cc:492] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.627821  2997 tablet_bootstrap.cc:492] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.628331  2996 ts_tablet_manager.cc:1403] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.014s
I20260709 12:14:11.628648  2997 ts_tablet_manager.cc:1403] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 12:14:11.631567  2995 tablet_bootstrap.cc:492] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.632174  2995 ts_tablet_manager.cc:1403] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 12:14:11.632422  3020 raft_consensus.cc:493] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.632747  3002 raft_consensus.cc:493] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.632493  2996 raft_consensus.cc:359] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.633219  3020 raft_consensus.cc:515] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.633720  2996 raft_consensus.cc:385] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.633584  3002 raft_consensus.cc:515] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.636632  3002 leader_election.cc:290] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.637288  2997 raft_consensus.cc:359] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.638453  2997 raft_consensus.cc:385] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.638356  2995 raft_consensus.cc:359] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.638863  2997 raft_consensus.cc:740] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.639199  2995 raft_consensus.cc:385] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.639490  2995 raft_consensus.cc:740] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.639708  2997 consensus_queue.cc:260] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.640338  2995 consensus_queue.cc:260] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.641767  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:11.642351  2997 ts_tablet_manager.cc:1434] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:14:11.642607  2806 raft_consensus.cc:2468] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:11.642854  2995 ts_tablet_manager.cc:1434] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:14:11.643409  2997 tablet_bootstrap.cc:492] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:11.643728  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df1b1df2734612a43e25825eb17a89" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:11.645459  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df1b1df2734612a43e25825eb17a89" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.646878  2844 leader_election.cc:304] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
W20260709 12:14:11.647257  2847 leader_election.cc:343] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:11.647850  2844 leader_election.cc:343] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.648121  3002 raft_consensus.cc:2804] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.648307  2844 leader_election.cc:304] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:11.648617  3002 raft_consensus.cc:493] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.649060  3002 raft_consensus.cc:3060] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.649194  3016 raft_consensus.cc:2749] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.634308  2996 raft_consensus.cc:740] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.651387  3020 leader_election.cc:290] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.651261  2995 tablet_bootstrap.cc:492] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:11.652714  2996 consensus_queue.cc:260] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.655040  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.656242  2996 ts_tablet_manager.cc:1434] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
W20260709 12:14:11.657609  2847 leader_election.cc:343] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.660504  2997 tablet_bootstrap.cc:654] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.662664  2995 tablet_bootstrap.cc:654] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.664997  2996 tablet_bootstrap.cc:492] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.665496  3021 raft_consensus.cc:493] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.670025  3021 raft_consensus.cc:515] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.676859  3021 leader_election.cc:290] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.678305  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4859451644e4e9b81e16da7480bde72" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.678740  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4859451644e4e9b81e16da7480bde72" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.679725  2881 raft_consensus.cc:2468] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
W20260709 12:14:11.679984  2772 leader_election.cc:343] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.681648  3021 raft_consensus.cc:493] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.682643  2996 tablet_bootstrap.cc:654] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.682247  3021 raft_consensus.cc:515] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.685482  3021 leader_election.cc:290] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.686177  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0908f97816214cddbd15d618c9725306" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.686959  2954 raft_consensus.cc:2468] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.687965  2772 leader_election.cc:304] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.688669  3021 raft_consensus.cc:2804] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.689023  3021 raft_consensus.cc:493] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.689324  3021 raft_consensus.cc:3060] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.690681  2770 leader_election.cc:304] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:11.691850  3022 raft_consensus.cc:2804] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.692235  3022 raft_consensus.cc:493] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.692596  3022 raft_consensus.cc:3060] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.698756  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0908f97816214cddbd15d618c9725306" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.699667  2881 raft_consensus.cc:2468] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.700371  3003 raft_consensus.cc:493] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.700963  3003 raft_consensus.cc:515] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.700980  3021 raft_consensus.cc:515] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.704062  3021 leader_election.cc:290] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.704792  3003 leader_election.cc:290] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.708957  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0908f97816214cddbd15d618c9725306" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.709636  2955 raft_consensus.cc:3060] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.710000  3022 raft_consensus.cc:515] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.713804  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4859451644e4e9b81e16da7480bde72" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:11.714500  2879 raft_consensus.cc:3060] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.714658  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0908f97816214cddbd15d618c9725306" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:11.715358  2880 raft_consensus.cc:3060] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.707969  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.718917  2954 raft_consensus.cc:2468] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.720767  2772 leader_election.cc:304] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.721716  3003 raft_consensus.cc:2804] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.722102  3003 raft_consensus.cc:493] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.722460  3003 raft_consensus.cc:3060] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.723372  2879 raft_consensus.cc:2468] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.724809  2770 leader_election.cc:304] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:11.725780  3021 raft_consensus.cc:2804] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.745694  3021 raft_consensus.cc:697] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:11.747193  3021 consensus_queue.cc:237] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.750854  2955 raft_consensus.cc:2468] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.750844  3003 raft_consensus.cc:515] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.752717  2772 leader_election.cc:304] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.753499  3003 leader_election.cc:290] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.754412  3003 raft_consensus.cc:2804] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.754958  3022 leader_election.cc:290] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.754910  3003 raft_consensus.cc:697] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:11.745241  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.678761  3002 raft_consensus.cc:515] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.759603  2881 raft_consensus.cc:2468] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.764302  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:11.765537  2879 raft_consensus.cc:3060] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.770362  3002 leader_election.cc:290] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.771159  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:11.771898  2805 raft_consensus.cc:3060] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.774314  2997 tablet_bootstrap.cc:492] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.775089  2997 ts_tablet_manager.cc:1403] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.025s
I20260709 12:14:11.774336  2995 tablet_bootstrap.cc:492] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:11.778365  2995 ts_tablet_manager.cc:1403] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.018s
I20260709 12:14:11.779119  2997 raft_consensus.cc:359] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.779873  2997 raft_consensus.cc:385] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.780146  2997 raft_consensus.cc:740] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.781016  2997 consensus_queue.cc:260] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.781265  2995 raft_consensus.cc:359] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.781926  2995 raft_consensus.cc:385] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.762583  3003 consensus_queue.cc:237] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.782214  2995 raft_consensus.cc:740] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.783175  2995 consensus_queue.cc:260] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.783360  2880 raft_consensus.cc:2468] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.782241  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
W20260709 12:14:11.786517  2847 leader_election.cc:343] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.786798  2996 tablet_bootstrap.cc:492] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.788920  2995 ts_tablet_manager.cc:1434] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:14:11.791810  2997 ts_tablet_manager.cc:1434] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:14:11.792917  2997 tablet_bootstrap.cc:492] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
W20260709 12:14:11.797034  2772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.131:34185, user_credentials={real_user=slave}} blocked reactor thread for 44409.2us
I20260709 12:14:11.799225  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.800858  2955 raft_consensus.cc:3060] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.801065  2997 tablet_bootstrap.cc:654] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.802309  2879 raft_consensus.cc:2468] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.803529  2770 leader_election.cc:304] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:11.804359  3021 raft_consensus.cc:2804] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.805127  3021 raft_consensus.cc:697] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:11.799947  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4859451644e4e9b81e16da7480bde72" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.807905  3002 raft_consensus.cc:493] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.808107  2772 leader_election.cc:343] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:11.808478  3002 raft_consensus.cc:515] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.811193  3002 leader_election.cc:290] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.806458  3021 consensus_queue.cc:237] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.812376  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a05f73e044004481ade3b0f468be3102" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:11.813355  2806 raft_consensus.cc:2468] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:11.815258  2844 leader_election.cc:304] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:11.816531  3002 raft_consensus.cc:2804] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.817194  3002 raft_consensus.cc:493] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.817976  3002 raft_consensus.cc:3060] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.819695  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a05f73e044004481ade3b0f468be3102" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.820756  2954 raft_consensus.cc:2468] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:11.795625  2996 ts_tablet_manager.cc:1403] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.000s
I20260709 12:14:11.837852  3002 raft_consensus.cc:515] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.840737  3003 raft_consensus.cc:493] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.841372  2997 tablet_bootstrap.cc:492] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:11.841478  3003 raft_consensus.cc:515] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.842193  2997 ts_tablet_manager.cc:1403] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.008s
I20260709 12:14:11.837913  2805 raft_consensus.cc:2468] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:11.844498  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a05f73e044004481ade3b0f468be3102" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:11.845775  2997 raft_consensus.cc:359] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.846751  2997 raft_consensus.cc:385] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.846647  2844 leader_election.cc:304] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:11.845711  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.847241  2997 raft_consensus.cc:740] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.842670  2996 raft_consensus.cc:359] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.848059  2996 raft_consensus.cc:385] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.848117  2997 consensus_queue.cc:260] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.846553  2806 raft_consensus.cc:3060] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.848439  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.849635  2954 raft_consensus.cc:2393] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0567de2e86f64dcd955de7b57f97deb8 in current term 1: Already voted for candidate 8c9892e39cad43c1b378df6880ff1585 in this term.
I20260709 12:14:11.849989  3003 leader_election.cc:290] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.851022  2772 leader_election.cc:304] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8; no voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:11.851394  2997 ts_tablet_manager.cc:1434] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:11.851879  3003 raft_consensus.cc:3060] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.848306  3020 raft_consensus.cc:2804] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.854753  3020 raft_consensus.cc:697] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:11.848515  2996 raft_consensus.cc:740] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.855710  3020 consensus_queue.cc:237] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.856248  2996 consensus_queue.cc:260] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.858898  2996 ts_tablet_manager.cc:1434] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:14:11.859213  2700 catalog_manager.cc:5697] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.860479  3003 raft_consensus.cc:2749] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:11.862609  2996 tablet_bootstrap.cc:492] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.863919  3002 leader_election.cc:290] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.865168  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a05f73e044004481ade3b0f468be3102" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.865869  2954 raft_consensus.cc:3060] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.861289  2700 catalog_manager.cc:5697] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.845173  2955 raft_consensus.cc:2468] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.871133  2996 tablet_bootstrap.cc:654] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.875566  2954 raft_consensus.cc:2468] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:11.877684  2847 leader_election.cc:304] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.865762  2806 raft_consensus.cc:2468] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:11.879747  3002 raft_consensus.cc:2804] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.880280  3002 raft_consensus.cc:697] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:11.881229  3002 consensus_queue.cc:237] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.884516  2996 tablet_bootstrap.cc:492] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.885196  2996 ts_tablet_manager.cc:1403] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:14:11.888820  2996 raft_consensus.cc:359] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.889699  2996 raft_consensus.cc:385] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.890021  2996 raft_consensus.cc:740] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.890597  2704 catalog_manager.cc:5697] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.893842  2996 consensus_queue.cc:260] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.897246  2996 ts_tablet_manager.cc:1434] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:14:11.898459  2996 tablet_bootstrap.cc:492] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.905731  2996 tablet_bootstrap.cc:654] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.911525  2996 tablet_bootstrap.cc:492] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.912081  2996 ts_tablet_manager.cc:1403] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:14:11.918898  3003 raft_consensus.cc:493] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.919564  3003 raft_consensus.cc:515] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.919909  2996 raft_consensus.cc:359] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.920710  2996 raft_consensus.cc:385] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.921025  2996 raft_consensus.cc:740] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.921904  2996 consensus_queue.cc:260] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.922895  2703 catalog_manager.cc:5697] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.923775  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df1b1df2734612a43e25825eb17a89" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.924302  2996 ts_tablet_manager.cc:1434] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:11.924530  2954 raft_consensus.cc:2468] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.925437  2996 tablet_bootstrap.cc:492] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:11.926045  2772 leader_election.cc:304] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.926997  3003 leader_election.cc:290] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.927551  3003 raft_consensus.cc:2804] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.927875  3003 raft_consensus.cc:493] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.928193  3003 raft_consensus.cc:3060] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.932142  2996 tablet_bootstrap.cc:654] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:11.935791  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df1b1df2734612a43e25825eb17a89" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:11.936558  2879 raft_consensus.cc:2468] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:11.936862  3003 raft_consensus.cc:515] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.940164  3003 leader_election.cc:290] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:11.940418  2996 tablet_bootstrap.cc:492] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:11.940698  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df1b1df2734612a43e25825eb17a89" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:11.941017  2996 ts_tablet_manager.cc:1403] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:14:11.941300  2954 raft_consensus.cc:3060] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.942690  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df1b1df2734612a43e25825eb17a89" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:11.943315  2879 raft_consensus.cc:3060] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:11.944208  2996 raft_consensus.cc:359] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.944937  2996 raft_consensus.cc:385] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:11.945211  2996 raft_consensus.cc:740] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:11.946014  2996 consensus_queue.cc:260] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.948526  2996 ts_tablet_manager.cc:1434] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:11.948354  2700 catalog_manager.cc:5697] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.949682  2954 raft_consensus.cc:2468] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.950855  2772 leader_election.cc:304] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:11.951679  3003 raft_consensus.cc:2804] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:11.952260  3003 raft_consensus.cc:697] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:11.953156  3003 consensus_queue.cc:237] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:11.959203  2879 raft_consensus.cc:2468] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:11.965636  3003 consensus_queue.cc:1048] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:11.967540  2700 catalog_manager.cc:5697] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.979786  3003 consensus_queue.cc:1048] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:11.983604  3002 raft_consensus.cc:493] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.984287  3002 raft_consensus.cc:515] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:11.986316  3002 leader_election.cc:290] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185), 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859)
I20260709 12:14:11.987057  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:11.987833  2954 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:11.987929  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:11.988577  2806 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:11.990203  2844 leader_election.cc:304] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:11.991474  3002 raft_consensus.cc:2804] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:11.991848  3002 raft_consensus.cc:493] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.992170  3002 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.002343  3002 raft_consensus.cc:515] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:12.005069  3002 leader_election.cc:290] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185), 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859)
I20260709 12:14:12.005369  2954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:12.005724  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:12.006480  2806 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.006484  2954 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.013214  2806 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:12.014559  2844 leader_election.cc:304] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:12.015064  2954 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:12.015476  3002 raft_consensus.cc:2804] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:12.016167  3002 raft_consensus.cc:697] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:12.017040  3002 consensus_queue.cc:237] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:12.026422  2700 catalog_manager.cc:5697] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.140899  3002 consensus_queue.cc:1048] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:12.146204  3002 consensus_queue.cc:1048] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.158420  2955 raft_consensus.cc:3060] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.167615  3003 consensus_queue.cc:1048] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:12.177301  3021 consensus_queue.cc:1048] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.182499  3003 consensus_queue.cc:1048] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:12.193876  3007 raft_consensus.cc:493] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:12.194640  3007 raft_consensus.cc:515] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.199837  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:12.200747  2806 raft_consensus.cc:2393] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bf434d3160e048d2ae43783dcb5c4452 in current term 1: Already voted for candidate 8c9892e39cad43c1b378df6880ff1585 in this term.
I20260709 12:14:12.205524  3021 consensus_queue.cc:1048] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.207737  3007 leader_election.cc:290] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:12.209884  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:12.213995  2919 leader_election.cc:304] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:12.216238  3007 raft_consensus.cc:3060] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:12.220685  3021 consensus_queue.cc:1048] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.225306  2881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abcb55386d074c40b86d773780c27daf"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "0567de2e86f64dcd955de7b57f97deb8"
 from {username='slave'} at 127.0.0.1:33092
I20260709 12:14:12.225972  2881 raft_consensus.cc:606] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Received request to transfer leadership to TS 0567de2e86f64dcd955de7b57f97deb8
I20260709 12:14:12.240258  3007 raft_consensus.cc:2749] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:12.242729  3022 consensus_queue.cc:1048] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.248862  3016 consensus_queue.cc:1048] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:12.268947  3020 consensus_queue.cc:1048] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:12.285398  2902 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef200 after lost signal to thread 24445
W20260709 12:14:12.287015  2902 debug-util.cc:398] Leaking SignalData structure 0x7b080024b6a0 after lost signal to thread 2738
I20260709 12:14:12.296293  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c42f985376024658a96143f87d8bff18"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
mode: GRACEFUL
new_leader_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:48586
I20260709 12:14:12.297173  2806 raft_consensus.cc:606] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Received request to transfer leadership to TS 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:12.303874  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
mode: GRACEFUL
new_leader_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:48586
I20260709 12:14:12.304560  2806 raft_consensus.cc:606] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Received request to transfer leadership to TS 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:12.317827  2879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:33092
I20260709 12:14:12.318480  2879 raft_consensus.cc:606] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Received request to transfer leadership to TS bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:12.421916  3021 consensus_queue.cc:1048] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.424530  3041 raft_consensus.cc:993] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: : Instructing follower 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:12.425060  3041 raft_consensus.cc:1081] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Signalling peer 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:12.427352  2880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c42f985376024658a96143f87d8bff18"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:33090
I20260709 12:14:12.428211  2880 raft_consensus.cc:493] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.428773  2880 raft_consensus.cc:3060] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.442250  3021 consensus_queue.cc:1048] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.448990  2880 raft_consensus.cc:515] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.454628  3002 consensus_queue.cc:1048] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.456791  2880 leader_election.cc:290] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:12.458186  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f985376024658a96143f87d8bff18" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:12.459106  2805 raft_consensus.cc:3055] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.459559  2805 raft_consensus.cc:740] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:12.459960  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f985376024658a96143f87d8bff18" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:12.460716  2953 raft_consensus.cc:3060] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.460758  2805 consensus_queue.cc:260] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.464275  3002 consensus_queue.cc:1048] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.471489  2805 raft_consensus.cc:3060] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.474203  2953 raft_consensus.cc:2468] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:12.497644  2847 leader_election.cc:304] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:12.498759  3002 raft_consensus.cc:2804] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.499670  3002 raft_consensus.cc:697] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:12.500702  3002 consensus_queue.cc:237] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.510330  3002 consensus_queue.cc:1048] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.512049  2700 catalog_manager.cc:5697] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 1 to 2, leader changed from 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129) to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.527771  2805 raft_consensus.cc:2468] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:12.539239  3020 raft_consensus.cc:993] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower 0567de2e86f64dcd955de7b57f97deb8 to start an election
I20260709 12:14:12.540138  3020 raft_consensus.cc:1081] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Signalling peer 0567de2e86f64dcd955de7b57f97deb8 to start an election
I20260709 12:14:12.547359  2804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abcb55386d074c40b86d773780c27daf"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:14:12.548133  2804 raft_consensus.cc:493] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.548673  2804 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.550355  3020 consensus_queue.cc:1048] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:12.567087  2804 raft_consensus.cc:515] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:12.568503  2806 raft_consensus.cc:1240] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Rejecting Update request from peer 8c9892e39cad43c1b378df6880ff1585 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:12.570196  2804 leader_election.cc:290] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:12.573459  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:12.573925  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:12.574179  2955 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.574715  2880 raft_consensus.cc:3055] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.575114  2880 raft_consensus.cc:740] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:12.576110  2880 consensus_queue.cc:260] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:12.577798  2880 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.581400  2955 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 2.
I20260709 12:14:12.582805  2772 leader_election.cc:304] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:12.583588  3021 raft_consensus.cc:2804] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.584054  3021 raft_consensus.cc:697] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:12.585002  3021 consensus_queue.cc:237] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:12.587299  2880 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 2.
I20260709 12:14:12.592653  2702 catalog_manager.cc:5697] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 1 to 2, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:12.652029  3003 raft_consensus.cc:993] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: : Instructing follower 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:12.652626  3041 raft_consensus.cc:1081] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Signalling peer 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:12.654366  2880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:33090
I20260709 12:14:12.654930  2880 raft_consensus.cc:493] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.655273  2880 raft_consensus.cc:3060] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.661813  2880 raft_consensus.cc:515] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.664563  2880 leader_election.cc:290] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:12.665307  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:12.665879  2955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88c6ee4ba61149afad248ea2580eedd3" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:12.666143  2806 raft_consensus.cc:3055] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.666608  2955 raft_consensus.cc:3060] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.666647  2806 raft_consensus.cc:740] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:12.667783  2806 consensus_queue.cc:260] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.669389  2806 raft_consensus.cc:3060] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.672889  2955 raft_consensus.cc:2468] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:12.674122  2847 leader_election.cc:304] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:12.674969  3020 raft_consensus.cc:2804] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.675462  3020 raft_consensus.cc:697] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:12.676256  3020 consensus_queue.cc:237] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.679900  2806 raft_consensus.cc:2468] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:12.685207  2702 catalog_manager.cc:5697] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 1 to 2, leader changed from 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129) to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:12.701427  3074 raft_consensus.cc:993] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:12.701963  3074 raft_consensus.cc:1081] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Signalling peer bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:12.703640  2955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:14:12.704165  2955 raft_consensus.cc:493] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:12.704492  2955 raft_consensus.cc:3060] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.711125  2955 raft_consensus.cc:515] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.713114  2955 leader_election.cc:290] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:12.715124  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:12.715210  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d44dd63c74460186ed3e42516f6dd0" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:12.716092  2880 raft_consensus.cc:3055] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:12.716396  2806 raft_consensus.cc:3060] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.716535  2880 raft_consensus.cc:740] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:12.718362  2880 consensus_queue.cc:260] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.719947  2880 raft_consensus.cc:3060] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:12.723596  2806 raft_consensus.cc:2468] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:12.724996  2918 leader_election.cc:304] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:12.725986  3007 raft_consensus.cc:2804] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:12.727210  3007 raft_consensus.cc:697] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:12.728298  3007 consensus_queue.cc:237] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:12.729817  2880 raft_consensus.cc:2468] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:12.740331  2702 catalog_manager.cc:5697] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 1 to 2, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:12.923194  2806 raft_consensus.cc:1275] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.924697  3074 consensus_queue.cc:1048] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:12.935156  2955 raft_consensus.cc:1275] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:12.937038  3016 consensus_queue.cc:1048] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.048982  2880 raft_consensus.cc:1275] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer 0567de2e86f64dcd955de7b57f97deb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.051129  3039 consensus_queue.cc:1048] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:13.062441  2955 raft_consensus.cc:1275] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 0567de2e86f64dcd955de7b57f97deb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.063977  3022 consensus_queue.cc:1048] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.116961  2955 raft_consensus.cc:1275] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.119241  3016 consensus_queue.cc:1048] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.127998  2806 raft_consensus.cc:1275] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.129828  3002 consensus_queue.cc:1048] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.167158  2880 raft_consensus.cc:1275] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.168859  3007 consensus_queue.cc:1048] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:13.178196  2806 raft_consensus.cc:1275] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:13.182811  3007 consensus_queue.cc:1048] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:15.203490  2827 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd520 after lost signal to thread 24445
W20260709 12:14:15.204782  2827 debug-util.cc:398] Leaking SignalData structure 0x7b080036c5a0 after lost signal to thread 2738
W20260709 12:14:15.206110  2827 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb580 after lost signal to thread 2830
W20260709 12:14:15.207281  2827 debug-util.cc:398] Leaking SignalData structure 0x7b08001fefa0 after lost signal to thread 2905
W20260709 12:14:15.208916  2827 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2880 after lost signal to thread 2979
W20260709 12:14:15.209578  2827 debug-util.cc:398] Leaking SignalData structure 0x7b080035ddc0 after lost signal to thread 3045
I20260709 12:14:15.678952  2700 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54428:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:15.682974  2700 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:15.767925  2794 tablet_service.cc:1511] Processing CreateTablet for tablet 3e14601d0685473dabce354125d5209b (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:15.769429  2794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e14601d0685473dabce354125d5209b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.772764  2864 tablet_service.cc:1511] Processing CreateTablet for tablet 3e14601d0685473dabce354125d5209b (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:15.774399  2864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e14601d0685473dabce354125d5209b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.778580  2937 tablet_service.cc:1511] Processing CreateTablet for tablet 3e14601d0685473dabce354125d5209b (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:15.780215  2937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e14601d0685473dabce354125d5209b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.781949  2945 tablet_service.cc:1511] Processing CreateTablet for tablet 534d0a5a06cf4d998e76650ba65f9168 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:15.783551  2945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534d0a5a06cf4d998e76650ba65f9168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.788069  2943 tablet_service.cc:1511] Processing CreateTablet for tablet 60187b90c27241d888d4ccd79840201f (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:15.789680  2943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60187b90c27241d888d4ccd79840201f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.792255  2871 tablet_service.cc:1511] Processing CreateTablet for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:15.778671  2866 tablet_service.cc:1511] Processing CreateTablet for tablet 534d0a5a06cf4d998e76650ba65f9168 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:15.793906  2871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.796482  2789 tablet_service.cc:1511] Processing CreateTablet for tablet 534d0a5a06cf4d998e76650ba65f9168 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:15.797967  2789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534d0a5a06cf4d998e76650ba65f9168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.799300  2796 tablet_service.cc:1511] Processing CreateTablet for tablet 60187b90c27241d888d4ccd79840201f (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:15.801512  2790 tablet_service.cc:1511] Processing CreateTablet for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:15.792255  2863 tablet_service.cc:1511] Processing CreateTablet for tablet 60187b90c27241d888d4ccd79840201f (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:15.804404  2863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60187b90c27241d888d4ccd79840201f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.810111  2942 tablet_service.cc:1511] Processing CreateTablet for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:15.811894  2942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.815405  2940 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0de36e2a604a8eb463cb8588dfffc1 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:15.816977  2940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0de36e2a604a8eb463cb8588dfffc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.819681  2944 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7eb0c7caee4501a4b45bb45bc107ca (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:15.821575  2944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7eb0c7caee4501a4b45bb45bc107ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.826524  2866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534d0a5a06cf4d998e76650ba65f9168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.829176  2867 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0de36e2a604a8eb463cb8588dfffc1 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:15.830736  2867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0de36e2a604a8eb463cb8588dfffc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.833357  2938 tablet_service.cc:1511] Processing CreateTablet for tablet 1adf5ce52596498bbfdb7768ed0e0c46 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:15.834673  2790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.834993  2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adf5ce52596498bbfdb7768ed0e0c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.835852  2791 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0de36e2a604a8eb463cb8588dfffc1 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:15.837282  2791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0de36e2a604a8eb463cb8588dfffc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.838174  2939 tablet_service.cc:1511] Processing CreateTablet for tablet 72c33d9327104fb89a6d5ea17b1f5baf (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:15.838642  2796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60187b90c27241d888d4ccd79840201f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.839607  2939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c33d9327104fb89a6d5ea17b1f5baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.845460  2793 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7eb0c7caee4501a4b45bb45bc107ca (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:15.847048  2793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7eb0c7caee4501a4b45bb45bc107ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.852716  2795 tablet_service.cc:1511] Processing CreateTablet for tablet 1adf5ce52596498bbfdb7768ed0e0c46 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:15.853065  2792 tablet_service.cc:1511] Processing CreateTablet for tablet 72c33d9327104fb89a6d5ea17b1f5baf (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:15.854286  2870 tablet_service.cc:1511] Processing CreateTablet for tablet 1adf5ce52596498bbfdb7768ed0e0c46 (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:15.854748  2792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c33d9327104fb89a6d5ea17b1f5baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.855201  2869 tablet_service.cc:1511] Processing CreateTablet for tablet 2c7eb0c7caee4501a4b45bb45bc107ca (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:15.855857  2870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adf5ce52596498bbfdb7768ed0e0c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.856560  2869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c7eb0c7caee4501a4b45bb45bc107ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.857896  2868 tablet_service.cc:1511] Processing CreateTablet for tablet 72c33d9327104fb89a6d5ea17b1f5baf (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:15.867936  2868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c33d9327104fb89a6d5ea17b1f5baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.860901  2795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1adf5ce52596498bbfdb7768ed0e0c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.876480  2788 tablet_service.cc:1511] Processing CreateTablet for tablet 9a500af1b98f4507ba54d9e09d99e85f (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:15.878075  2788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a500af1b98f4507ba54d9e09d99e85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.924788  2865 tablet_service.cc:1511] Processing CreateTablet for tablet 9a500af1b98f4507ba54d9e09d99e85f (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:15.926527  2865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a500af1b98f4507ba54d9e09d99e85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:15.936446  2941 tablet_service.cc:1511] Processing CreateTablet for tablet 9a500af1b98f4507ba54d9e09d99e85f (DEFAULT_TABLE table=soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:15.938104  2941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a500af1b98f4507ba54d9e09d99e85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:16.004570  3094 tablet_bootstrap.cc:492] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.091216  3095 tablet_bootstrap.cc:492] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
W20260709 12:14:16.084451  2847 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:34185, user_credentials={real_user=slave}} blocked reactor thread for 63608.1us
I20260709 12:14:16.106460  3094 tablet_bootstrap.cc:654] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.117229  3096 tablet_bootstrap.cc:492] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.131956  3096 tablet_bootstrap.cc:654] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.147097  3095 tablet_bootstrap.cc:654] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.156433  3094 tablet_bootstrap.cc:492] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:16.156435  3096 tablet_bootstrap.cc:492] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.157244  3096 ts_tablet_manager.cc:1403] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.005s
I20260709 12:14:16.157202  3094 ts_tablet_manager.cc:1403] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.013s
I20260709 12:14:16.161463  3096 raft_consensus.cc:359] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.161798  3094 raft_consensus.cc:359] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.162382  3096 raft_consensus.cc:385] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.162787  3096 raft_consensus.cc:740] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.163839  3094 raft_consensus.cc:385] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.164316  3094 raft_consensus.cc:740] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.166453  3094 consensus_queue.cc:260] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.166610  3096 consensus_queue.cc:260] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.169631  3095 tablet_bootstrap.cc:492] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.170423  3095 ts_tablet_manager.cc:1403] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.005s
I20260709 12:14:16.170609  3096 ts_tablet_manager.cc:1434] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 12:14:16.171823  3096 tablet_bootstrap.cc:492] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.173813  3095 raft_consensus.cc:359] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.175422  3095 raft_consensus.cc:385] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.175805  3095 raft_consensus.cc:740] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.176792  3095 consensus_queue.cc:260] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.192639  3095 ts_tablet_manager.cc:1434] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:14:16.194185  3095 tablet_bootstrap.cc:492] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:16.180047  3096 tablet_bootstrap.cc:654] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.195657  3094 ts_tablet_manager.cc:1434] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.004s
I20260709 12:14:16.211259  3096 tablet_bootstrap.cc:492] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.212067  3096 ts_tablet_manager.cc:1403] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.002s
I20260709 12:14:16.212129  3095 tablet_bootstrap.cc:654] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.216969  3096 raft_consensus.cc:359] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.218060  3096 raft_consensus.cc:385] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.218518  3096 raft_consensus.cc:740] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.219604  3096 consensus_queue.cc:260] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.222803  3096 ts_tablet_manager.cc:1434] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:14:16.224102  3096 tablet_bootstrap.cc:492] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.232779  3096 tablet_bootstrap.cc:654] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.241143  3094 tablet_bootstrap.cc:492] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.249377  3094 tablet_bootstrap.cc:654] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.277585  3095 tablet_bootstrap.cc:492] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.277681  3094 tablet_bootstrap.cc:492] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:16.321151  3095 ts_tablet_manager.cc:1403] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.127s	user 0.023s	sys 0.010s
I20260709 12:14:16.322293  3094 ts_tablet_manager.cc:1403] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.007s
I20260709 12:14:16.338101  3094 raft_consensus.cc:359] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.346815  3096 tablet_bootstrap.cc:492] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.350232  3096 ts_tablet_manager.cc:1403] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.126s	user 0.020s	sys 0.011s
I20260709 12:14:16.349611  3094 raft_consensus.cc:385] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.354808  3094 raft_consensus.cc:740] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.356253  3094 consensus_queue.cc:260] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.352763  3095 raft_consensus.cc:359] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.366163  3094 ts_tablet_manager.cc:1434] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 12:14:16.366581  3095 raft_consensus.cc:385] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.367092  3095 raft_consensus.cc:740] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.359495  3096 raft_consensus.cc:359] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.368353  3096 raft_consensus.cc:385] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.368824  3096 raft_consensus.cc:740] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.371814  3095 consensus_queue.cc:260] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.372599  3096 consensus_queue.cc:260] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.383847  3096 ts_tablet_manager.cc:1434] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.008s
I20260709 12:14:16.377310  3094 tablet_bootstrap.cc:492] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.389523  3098 raft_consensus.cc:493] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.390453  3098 raft_consensus.cc:515] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.395354  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:16.396327  2806 raft_consensus.cc:2468] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:16.399276  3094 tablet_bootstrap.cc:654] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.401486  2844 leader_election.cc:304] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:16.402908  3100 raft_consensus.cc:2804] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.403362  3100 raft_consensus.cc:493] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.403708  3100 raft_consensus.cc:3060] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.406589  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
W20260709 12:14:16.409708  2847 leader_election.cc:343] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.411288  3098 leader_election.cc:290] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.387517  3095 ts_tablet_manager.cc:1434] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.006s
I20260709 12:14:16.415607  3096 tablet_bootstrap.cc:492] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.420856  3095 tablet_bootstrap.cc:492] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:16.430827  3105 raft_consensus.cc:493] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.430574  3100 raft_consensus.cc:515] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.431777  3105 raft_consensus.cc:515] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.436447  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:16.436583  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e14601d0685473dabce354125d5209b" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:16.437237  2806 raft_consensus.cc:3060] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:16.439749  2770 leader_election.cc:343] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.442934  3098 raft_consensus.cc:493] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.443167  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e14601d0685473dabce354125d5209b" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:16.443917  3098 raft_consensus.cc:515] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.444772  3105 leader_election.cc:290] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.444252  2953 raft_consensus.cc:2468] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:16.446663  2772 leader_election.cc:304] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:16.448127  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:16.449332  3098 leader_election.cc:290] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
W20260709 12:14:16.450021  2844 leader_election.cc:343] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.451071  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
W20260709 12:14:16.452831  2847 leader_election.cc:343] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.453353  2847 leader_election.cc:304] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:16.454643  3099 raft_consensus.cc:2749] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.448128  3105 raft_consensus.cc:2804] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.455716  3105 raft_consensus.cc:493] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.456110  3105 raft_consensus.cc:3060] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.464469  3095 tablet_bootstrap.cc:654] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.467691  3094 tablet_bootstrap.cc:492] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:16.479712  3094 ts_tablet_manager.cc:1403] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.006s
I20260709 12:14:16.480180  3096 tablet_bootstrap.cc:654] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.484243  3094 raft_consensus.cc:359] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.485144  3094 raft_consensus.cc:385] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.485466  3094 raft_consensus.cc:740] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.468895  3100 leader_election.cc:290] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.472235  2806 raft_consensus.cc:2468] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:16.487285  3094 consensus_queue.cc:260] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.488127  2844 leader_election.cc:304] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:16.477504  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:16.489218  3100 raft_consensus.cc:2804] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.489799  3100 raft_consensus.cc:697] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
W20260709 12:14:16.490701  2847 leader_election.cc:343] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.491025  3100 consensus_queue.cc:237] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.497589  3077 raft_consensus.cc:493] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.498150  3105 raft_consensus.cc:515] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.498248  3077 raft_consensus.cc:515] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.504439  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:16.505187  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
W20260709 12:14:16.506395  2918 leader_election.cc:343] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:16.507162  2919 leader_election.cc:343] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.507652  2919 leader_election.cc:304] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:16.509457  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e14601d0685473dabce354125d5209b" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:16.511165  3105 leader_election.cc:290] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
W20260709 12:14:16.511304  2770 leader_election.cc:343] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.506438  3077 leader_election.cc:290] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:16.516691  3077 raft_consensus.cc:2749] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.518982  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e14601d0685473dabce354125d5209b" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:16.519719  2953 raft_consensus.cc:3060] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.536969  3094 ts_tablet_manager.cc:1434] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 12:14:16.538849  3094 tablet_bootstrap.cc:492] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.549283  2700 catalog_manager.cc:5697] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.570120  2953 raft_consensus.cc:2468] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:16.572395  3099 raft_consensus.cc:493] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.575774  3099 raft_consensus.cc:515] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.581524  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
W20260709 12:14:16.583739  2844 leader_election.cc:343] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.585561  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:16.590436  3096 tablet_bootstrap.cc:492] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.591253  3096 ts_tablet_manager.cc:1403] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.176s	user 0.049s	sys 0.036s
W20260709 12:14:16.595431  2847 leader_election.cc:343] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.596232  2847 leader_election.cc:304] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:16.586701  3099 leader_election.cc:290] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.597451  3100 raft_consensus.cc:2749] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.604003  3095 tablet_bootstrap.cc:492] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.604285  3096 raft_consensus.cc:359] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.606568  3096 raft_consensus.cc:385] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.607074  3096 raft_consensus.cc:740] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.607191  2772 leader_election.cc:304] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:16.608803  3105 raft_consensus.cc:2804] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.608625  3096 consensus_queue.cc:260] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.609412  3105 raft_consensus.cc:697] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:16.610308  3095 ts_tablet_manager.cc:1403] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.197s	user 0.004s	sys 0.019s
I20260709 12:14:16.610772  3105 consensus_queue.cc:237] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.620774  3096 ts_tablet_manager.cc:1434] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
W20260709 12:14:16.617842  2752 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:16.622624  3096 tablet_bootstrap.cc:492] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.623117  3094 tablet_bootstrap.cc:654] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.624742  3095 raft_consensus.cc:359] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.625614  3095 raft_consensus.cc:385] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.625917  3095 raft_consensus.cc:740] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.630808  3095 consensus_queue.cc:260] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.641479  3100 raft_consensus.cc:493] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.642215  3100 raft_consensus.cc:515] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.643186  2702 catalog_manager.cc:5697] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.645145  3095 ts_tablet_manager.cc:1434] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:14:16.646559  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:16.646952  3095 tablet_bootstrap.cc:492] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
W20260709 12:14:16.648568  2844 leader_election.cc:343] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.654886  3100 leader_election.cc:290] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.660759  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
W20260709 12:14:16.662647  2847 leader_election.cc:343] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.663148  2847 leader_election.cc:304] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:16.664745  3100 raft_consensus.cc:2749] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:16.673554  3096 tablet_bootstrap.cc:654] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.682200  3094 tablet_bootstrap.cc:492] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:16.683202  3094 ts_tablet_manager.cc:1403] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.145s	user 0.020s	sys 0.025s
I20260709 12:14:16.692305  3095 tablet_bootstrap.cc:654] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.698777  3096 tablet_bootstrap.cc:492] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.699489  3096 ts_tablet_manager.cc:1403] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.077s	user 0.005s	sys 0.012s
I20260709 12:14:16.700080  3094 raft_consensus.cc:359] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.701138  3094 raft_consensus.cc:385] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.701515  3094 raft_consensus.cc:740] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.702558  3094 consensus_queue.cc:260] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.703574  3096 raft_consensus.cc:359] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.704439  3096 raft_consensus.cc:385] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.704766  3096 raft_consensus.cc:740] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.705717  3096 consensus_queue.cc:260] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.706657  3094 ts_tablet_manager.cc:1434] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:14:16.712422  3096 ts_tablet_manager.cc:1434] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:14:16.714068  3096 tablet_bootstrap.cc:492] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.719175  3094 tablet_bootstrap.cc:492] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.721331  3095 tablet_bootstrap.cc:492] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.723676  3095 ts_tablet_manager.cc:1403] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.006s
I20260709 12:14:16.726775  3096 tablet_bootstrap.cc:654] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.729058  3095 raft_consensus.cc:359] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.730043  3095 raft_consensus.cc:385] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.730494  3095 raft_consensus.cc:740] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.731559  3095 consensus_queue.cc:260] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.734243  3095 ts_tablet_manager.cc:1434] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:14:16.736136  3095 tablet_bootstrap.cc:492] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:16.737578  3094 tablet_bootstrap.cc:654] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.745239  3095 tablet_bootstrap.cc:654] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.757405  3095 tablet_bootstrap.cc:492] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.759256  3095 ts_tablet_manager.cc:1403] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 12:14:16.760615  3094 tablet_bootstrap.cc:492] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:16.760984  3096 tablet_bootstrap.cc:492] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.761382  3094 ts_tablet_manager.cc:1403] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.011s
I20260709 12:14:16.761583  3096 ts_tablet_manager.cc:1403] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.004s
I20260709 12:14:16.763594  3095 raft_consensus.cc:359] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.764557  3095 raft_consensus.cc:385] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.764918  3095 raft_consensus.cc:740] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.765214  3094 raft_consensus.cc:359] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.765487  3096 raft_consensus.cc:359] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.766167  3094 raft_consensus.cc:385] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.766417  3096 raft_consensus.cc:385] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.765919  3095 consensus_queue.cc:260] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.766673  3094 raft_consensus.cc:740] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.766822  3096 raft_consensus.cc:740] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.767725  3094 consensus_queue.cc:260] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.771049  3096 consensus_queue.cc:260] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.774617  3096 ts_tablet_manager.cc:1434] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:14:16.776183  3096 tablet_bootstrap.cc:492] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.779336  3095 ts_tablet_manager.cc:1434] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:14:16.781030  3095 tablet_bootstrap.cc:492] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:16.783782  3094 ts_tablet_manager.cc:1434] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:14:16.792805  3096 tablet_bootstrap.cc:654] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.794207  3094 tablet_bootstrap.cc:492] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.792814  3095 tablet_bootstrap.cc:654] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.804769  3094 tablet_bootstrap.cc:654] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.811856  3096 tablet_bootstrap.cc:492] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.812116  3100 raft_consensus.cc:493] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.812496  3096 ts_tablet_manager.cc:1403] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.012s
I20260709 12:14:16.812721  3100 raft_consensus.cc:515] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.816247  3096 raft_consensus.cc:359] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.817133  3096 raft_consensus.cc:385] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.817456  3096 raft_consensus.cc:740] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.818361  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c33d9327104fb89a6d5ea17b1f5baf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:16.818653  3096 consensus_queue.cc:260] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
W20260709 12:14:16.820448  2844 leader_election.cc:343] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.822654  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c33d9327104fb89a6d5ea17b1f5baf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:16.823433  2951 raft_consensus.cc:2468] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:16.824817  2847 leader_election.cc:304] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8
I20260709 12:14:16.825794  3099 raft_consensus.cc:2804] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.826164  3099 raft_consensus.cc:493] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.826527  3099 raft_consensus.cc:3060] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.829397  3096 ts_tablet_manager.cc:1434] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 12:14:16.831172  3095 tablet_bootstrap.cc:492] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.831763  3095 ts_tablet_manager.cc:1403] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.019s
I20260709 12:14:16.834077  3096 tablet_bootstrap.cc:492] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.835793  3095 raft_consensus.cc:359] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.836700  3100 leader_election.cc:290] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.837174  3095 raft_consensus.cc:385] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.837642  3095 raft_consensus.cc:740] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.838721  3095 consensus_queue.cc:260] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.842751  3094 tablet_bootstrap.cc:492] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:16.843246  3105 raft_consensus.cc:493] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.847774  3105 raft_consensus.cc:515] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.850451  3105 leader_election.cc:290] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.845772  3095 ts_tablet_manager.cc:1434] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:14:16.851720  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:16.852514  2951 raft_consensus.cc:2468] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:16.852829  3095 tablet_bootstrap.cc:492] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:16.851408  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:16.846675  3099 raft_consensus.cc:515] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
W20260709 12:14:16.857499  2770 leader_election.cc:343] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.859478  2772 leader_election.cc:304] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:16.860523  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c33d9327104fb89a6d5ea17b1f5baf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:16.861007  3105 raft_consensus.cc:2804] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.861261  2806 raft_consensus.cc:3060] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.861435  3105 raft_consensus.cc:493] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.861845  3105 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.851421  3094 ts_tablet_manager.cc:1403] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.004s
I20260709 12:14:16.864672  3095 tablet_bootstrap.cc:654] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.867514  3099 leader_election.cc:290] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.868364  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c33d9327104fb89a6d5ea17b1f5baf" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:16.869031  2951 raft_consensus.cc:3060] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.867301  3094 raft_consensus.cc:359] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.871302  3094 raft_consensus.cc:385] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.871781  3094 raft_consensus.cc:740] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.873132  3096 tablet_bootstrap.cc:654] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.873549  3094 consensus_queue.cc:260] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.877535  2806 raft_consensus.cc:2468] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:16.879537  2844 leader_election.cc:304] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:16.881469  3094 ts_tablet_manager.cc:1434] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:14:16.882997  3099 raft_consensus.cc:2804] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.883605  3099 raft_consensus.cc:697] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:16.884498  3099 consensus_queue.cc:237] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.883037  3094 tablet_bootstrap.cc:492] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:16.892449  3041 raft_consensus.cc:493] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.893069  3041 raft_consensus.cc:515] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.897289  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:16.898073  2880 raft_consensus.cc:2468] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:16.899176  3105 raft_consensus.cc:515] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.899519  2770 leader_election.cc:304] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:16.902627  2951 raft_consensus.cc:2468] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:16.903151  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:16.901993  3041 leader_election.cc:290] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.903858  2953 raft_consensus.cc:2468] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:16.904330  3041 raft_consensus.cc:2804] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.904738  3041 raft_consensus.cc:493] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.905099  3041 raft_consensus.cc:3060] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.917070  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
W20260709 12:14:16.918630  2770 leader_election.cc:343] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:16.921746  3094 tablet_bootstrap.cc:654] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.924194  3105 leader_election.cc:290] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.927390  2700 catalog_manager.cc:5697] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.919548  3095 tablet_bootstrap.cc:492] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:16.925388  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:16.930287  2953 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.935704  3041 raft_consensus.cc:515] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.937216  3099 consensus_queue.cc:1048] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:16.940331  3041 leader_election.cc:290] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.941776  2950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:16.942763  3096 tablet_bootstrap.cc:492] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:16.943701  2950 raft_consensus.cc:3060] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.944034  3096 ts_tablet_manager.cc:1403] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.004s
I20260709 12:14:16.947997  3096 raft_consensus.cc:359] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.948850  3096 raft_consensus.cc:385] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.949191  3096 raft_consensus.cc:740] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.950110  3096 consensus_queue.cc:260] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.951050  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:16.951756  2880 raft_consensus.cc:3060] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.953606  3096 ts_tablet_manager.cc:1434] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:16.955047  3096 tablet_bootstrap.cc:492] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: Bootstrap starting.
I20260709 12:14:16.953465  2950 raft_consensus.cc:2468] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:16.938544  3095 ts_tablet_manager.cc:1403] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.004s
I20260709 12:14:16.963443  2772 leader_election.cc:304] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:16.964321  3105 raft_consensus.cc:2804] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.964823  3105 raft_consensus.cc:697] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:16.965714  3105 consensus_queue.cc:237] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.966632  2953 raft_consensus.cc:2468] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:16.968082  2772 leader_election.cc:304] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:16.970459  3096 tablet_bootstrap.cc:654] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:16.970041  3095 raft_consensus.cc:359] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.970918  3095 raft_consensus.cc:385] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:16.971220  3095 raft_consensus.cc:740] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:16.971571  3041 raft_consensus.cc:2804] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:16.973296  3041 raft_consensus.cc:697] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:16.972100  3095 consensus_queue.cc:260] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.978879  3099 raft_consensus.cc:493] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.979162  3041 consensus_queue.cc:237] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.979781  3099 raft_consensus.cc:515] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:16.984567  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:16.984802  3099 leader_election.cc:290] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:16.985347  2804 raft_consensus.cc:2468] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:16.986665  2950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:16.986778  2844 leader_election.cc:304] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:16.987506  2950 raft_consensus.cc:2468] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:16.987824  3099 raft_consensus.cc:2804] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:16.988375  3099 raft_consensus.cc:493] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:16.988973  3099 raft_consensus.cc:3060] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:16.989531  2880 raft_consensus.cc:2468] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:16.992391  3095 ts_tablet_manager.cc:1434] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:14:16.993896  3095 tablet_bootstrap.cc:492] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:17.002046  3131 raft_consensus.cc:493] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.004272  3094 tablet_bootstrap.cc:492] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:17.004417  3131 raft_consensus.cc:515] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.005115  3094 ts_tablet_manager.cc:1403] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.016s
I20260709 12:14:17.005610  3099 raft_consensus.cc:515] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.007117  3131 leader_election.cc:290] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.008689  3095 tablet_bootstrap.cc:654] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.008821  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:17.008968  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:17.009603  2804 raft_consensus.cc:3060] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.009908  2880 raft_consensus.cc:2468] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 0.
I20260709 12:14:17.011299  2770 leader_election.cc:304] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:17.011724  2950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:17.012481  3131 raft_consensus.cc:2804] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.012895  3131 raft_consensus.cc:493] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.021078  3099 leader_election.cc:290] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.019881  3131 raft_consensus.cc:3060] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.026454  2950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:17.034574  2950 raft_consensus.cc:3060] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.037213  3077 raft_consensus.cc:493] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.038098  3077 raft_consensus.cc:515] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
W20260709 12:14:17.032061  2772 leader_election.cc:343] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.050108  3077 leader_election.cc:290] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:17.051939  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:17.048866  3094 raft_consensus.cc:359] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.055483  3094 raft_consensus.cc:385] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.055573  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:17.055843  3094 raft_consensus.cc:740] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.060254  2918 leader_election.cc:304] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:17.063259  2953 raft_consensus.cc:3060] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.071470  3094 consensus_queue.cc:260] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.075407  3094 ts_tablet_manager.cc:1434] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.001s
I20260709 12:14:17.087585  2804 raft_consensus.cc:2468] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:17.087275  3131 raft_consensus.cc:515] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.089078  2844 leader_election.cc:304] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:17.094866  3096 tablet_bootstrap.cc:492] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: No bootstrap required, opened a new log
I20260709 12:14:17.099304  3096 ts_tablet_manager.cc:1403] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: Time spent bootstrapping tablet: real 0.145s	user 0.018s	sys 0.019s
I20260709 12:14:17.097714  3094 tablet_bootstrap.cc:492] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:17.096776  2700 catalog_manager.cc:5697] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.103145  3077 raft_consensus.cc:2749] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:17.098407  2950 raft_consensus.cc:2468] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:17.104167  3100 raft_consensus.cc:2804] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.108453  3099 consensus_queue.cc:1048] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.111291  3096 raft_consensus.cc:359] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.112226  3096 raft_consensus.cc:385] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.112524  3096 raft_consensus.cc:740] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.105369  2700 catalog_manager.cc:5697] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:17.116740  2770 consensus_peers.cc:597] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 -> Peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Couldn't send request to peer 8c9892e39cad43c1b378df6880ff1585. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:17.119428  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:17.120110  2880 raft_consensus.cc:3060] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.121992  3131 leader_election.cc:290] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.123041  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
W20260709 12:14:17.131970  2772 leader_election.cc:343] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.133515  3096 consensus_queue.cc:260] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.136943  3095 tablet_bootstrap.cc:492] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:17.141053  3077 raft_consensus.cc:493] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.141887  3096 ts_tablet_manager.cc:1434] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:14:17.142024  3095 ts_tablet_manager.cc:1403] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.148s	user 0.006s	sys 0.014s
I20260709 12:14:17.141760  3077 raft_consensus.cc:515] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.148345  3077 leader_election.cc:290] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:17.149962  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:17.151882  2879 raft_consensus.cc:2468] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 0.
I20260709 12:14:17.152648  2880 raft_consensus.cc:2468] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 1.
I20260709 12:14:17.153133  2919 leader_election.cc:304] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:17.154489  2770 leader_election.cc:304] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:17.154690  3077 raft_consensus.cc:2804] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.155478  3077 raft_consensus.cc:493] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.156085  3077 raft_consensus.cc:3060] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.151170  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
W20260709 12:14:17.159601  2918 leader_election.cc:343] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.160073  3131 raft_consensus.cc:2804] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.161067  3131 raft_consensus.cc:697] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:17.162066  3131 consensus_queue.cc:237] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.162833  3095 raft_consensus.cc:359] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.163581  3095 raft_consensus.cc:385] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.163866  3095 raft_consensus.cc:740] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.167441  3077 raft_consensus.cc:515] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.168942  3100 raft_consensus.cc:697] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:17.169610  3094 tablet_bootstrap.cc:654] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.170111  3100 consensus_queue.cc:237] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.167520  3095 consensus_queue.cc:260] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.172927  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:17.173321  3041 raft_consensus.cc:493] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.173853  3041 raft_consensus.cc:515] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.174683  3077 leader_election.cc:290] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:17.176873  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:17.177597  2880 raft_consensus.cc:3060] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.178869  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:17.179414  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:17.180363  2951 raft_consensus.cc:2393] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0567de2e86f64dcd955de7b57f97deb8 in current term 1: Already voted for candidate bf434d3160e048d2ae43783dcb5c4452 in this term.
I20260709 12:14:17.182087  2772 leader_election.cc:304] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8; no voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:17.183084  3105 raft_consensus.cc:3060] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.190508  3041 leader_election.cc:290] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.193790  3105 raft_consensus.cc:2749] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:17.196115  2880 raft_consensus.cc:2468] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 1.
I20260709 12:14:17.198413  2919 leader_election.cc:304] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:17.199790  3077 raft_consensus.cc:2804] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.200488  3077 raft_consensus.cc:697] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:17.201648  3077 consensus_queue.cc:237] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.219249  2702 catalog_manager.cc:5697] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.220918  3100 raft_consensus.cc:493] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.208169  2806 raft_consensus.cc:2468] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 1.
I20260709 12:14:17.221897  3100 raft_consensus.cc:515] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.229203  3105 consensus_queue.cc:1048] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.236402  3095 ts_tablet_manager.cc:1434] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 12:14:17.239411  3095 tablet_bootstrap.cc:492] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: Bootstrap starting.
I20260709 12:14:17.240820  3094 tablet_bootstrap.cc:492] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:17.248334  3094 ts_tablet_manager.cc:1403] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.007s
I20260709 12:14:17.252628  3094 raft_consensus.cc:359] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.253981  3094 raft_consensus.cc:385] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.255509  3100 leader_election.cc:290] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.256114  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:17.258057  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:17.258745  2704 catalog_manager.cc:5697] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 0 to 1, leader changed from <none> to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:17.260321  2844 leader_election.cc:343] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.254334  3094 raft_consensus.cc:740] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.254428  2700 catalog_manager.cc:5697] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.262988  3095 tablet_bootstrap.cc:654] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.262487  3094 consensus_queue.cc:260] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.275084  2951 raft_consensus.cc:2468] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 0.
I20260709 12:14:17.276587  3094 ts_tablet_manager.cc:1434] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:14:17.277441  2847 leader_election.cc:304] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8
I20260709 12:14:17.277935  3094 tablet_bootstrap.cc:492] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: Bootstrap starting.
I20260709 12:14:17.278496  3100 raft_consensus.cc:2804] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:17.278906  3100 raft_consensus.cc:493] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.279239  3100 raft_consensus.cc:3060] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.283649  3095 tablet_bootstrap.cc:492] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: No bootstrap required, opened a new log
I20260709 12:14:17.287468  3095 ts_tablet_manager.cc:1403] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.002s
I20260709 12:14:17.289507  3100 raft_consensus.cc:515] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.293166  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:17.293413  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:17.294008  2951 raft_consensus.cc:3060] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:17.294574  2844 leader_election.cc:343] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:17.294457  3095 raft_consensus.cc:359] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.286664  3094 tablet_bootstrap.cc:654] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:17.295409  3095 raft_consensus.cc:385] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.302693  3095 raft_consensus.cc:740] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.303826  3095 consensus_queue.cc:260] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.305068  2951 raft_consensus.cc:2468] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 1.
I20260709 12:14:17.308485  3100 leader_election.cc:290] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.324568  3094 tablet_bootstrap.cc:492] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: No bootstrap required, opened a new log
I20260709 12:14:17.324993  3095 ts_tablet_manager.cc:1434] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 12:14:17.325217  3094 ts_tablet_manager.cc:1403] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.010s
I20260709 12:14:17.327109  2847 leader_election.cc:304] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8
I20260709 12:14:17.328830  3143 raft_consensus.cc:2804] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:17.329347  3143 raft_consensus.cc:697] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:17.328685  3094 raft_consensus.cc:359] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.330303  3143 consensus_queue.cc:237] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.331204  3094 raft_consensus.cc:385] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:17.331548  3094 raft_consensus.cc:740] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Initialized, Role: FOLLOWER
I20260709 12:14:17.332345  3094 consensus_queue.cc:260] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.344208  3094 ts_tablet_manager.cc:1434] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:14:17.352965  3135 consensus_queue.cc:1048] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.359004  3143 consensus_queue.cc:1048] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.376739  3105 consensus_queue.cc:1048] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.384025  2704 catalog_manager.cc:5697] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.394116  3135 raft_consensus.cc:493] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.395663  3098 consensus_queue.cc:1048] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.401356  3135 raft_consensus.cc:515] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.408711  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:17.439851  3098 raft_consensus.cc:493] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.442049  3098 raft_consensus.cc:515] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.451090  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:17.454506  3100 raft_consensus.cc:493] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.455436  3100 raft_consensus.cc:515] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.461434  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e14601d0685473dabce354125d5209b" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:17.467407  3100 leader_election.cc:290] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.471154  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e14601d0685473dabce354125d5209b" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:17.473839  2844 leader_election.cc:304] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:17.476552  3100 raft_consensus.cc:2749] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:17.476866  2879 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.479853  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:17.480808  2953 raft_consensus.cc:2393] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c9892e39cad43c1b378df6880ff1585 in current term 1: Already voted for candidate 0567de2e86f64dcd955de7b57f97deb8 in this term.
I20260709 12:14:17.482132  2847 leader_election.cc:304] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585; no voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:17.483026  3098 leader_election.cc:290] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.490335  3135 leader_election.cc:290] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:17.491638  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf434d3160e048d2ae43783dcb5c4452" is_pre_election: true
I20260709 12:14:17.492635  2953 raft_consensus.cc:2393] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0567de2e86f64dcd955de7b57f97deb8 in current term 1: Already voted for candidate 8c9892e39cad43c1b378df6880ff1585 in this term.
I20260709 12:14:17.494628  2772 leader_election.cc:304] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8; no voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:17.499071  3105 raft_consensus.cc:3060] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.505764  3131 consensus_queue.cc:1048] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.522507  3098 raft_consensus.cc:2749] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:17.522925  2879 raft_consensus.cc:3060] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.531457  3105 raft_consensus.cc:2749] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:17.568830  3105 consensus_queue.cc:1048] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.597760  3100 consensus_queue.cc:1048] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.639637  3113 consensus_queue.cc:1048] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.643000  3113 consensus_queue.cc:1048] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.651552  2951 raft_consensus.cc:3060] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:17.673485  3098 consensus_queue.cc:1048] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.701114  3113 raft_consensus.cc:493] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.701882  3113 raft_consensus.cc:515] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:17.706465  3135 consensus_queue.cc:1048] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:17.706748  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0567de2e86f64dcd955de7b57f97deb8" is_pre_election: true
I20260709 12:14:17.724834  3135 consensus_queue.cc:1048] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:14:17.724859  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9892e39cad43c1b378df6880ff1585" is_pre_election: true
I20260709 12:14:17.738375  3113 leader_election.cc:290] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:17.759177  2919 leader_election.cc:304] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bf434d3160e048d2ae43783dcb5c4452; no voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:17.761297  3098 consensus_queue.cc:1048] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:17.765964  3167 raft_consensus.cc:2749] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:17.768976  3098 consensus_queue.cc:1048] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:14:17.956367  2878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "0567de2e86f64dcd955de7b57f97deb8"
 from {username='slave'} at 127.0.0.1:33092
I20260709 12:14:17.957448  2878 raft_consensus.cc:606] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Received request to transfer leadership to TS 0567de2e86f64dcd955de7b57f97deb8
I20260709 12:14:17.965593  2880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60187b90c27241d888d4ccd79840201f"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "0567de2e86f64dcd955de7b57f97deb8"
 from {username='slave'} at 127.0.0.1:33092
I20260709 12:14:17.966353  2880 raft_consensus.cc:606] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Received request to transfer leadership to TS 0567de2e86f64dcd955de7b57f97deb8
I20260709 12:14:17.978472  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
mode: GRACEFUL
new_leader_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:48586
I20260709 12:14:17.979441  2806 raft_consensus.cc:606] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Received request to transfer leadership to TS 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:17.988298  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
mode: GRACEFUL
new_leader_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:48586
I20260709 12:14:17.989154  2806 raft_consensus.cc:606] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Received request to transfer leadership to TS 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:18.025015  2950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
mode: GRACEFUL
new_leader_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:53238
I20260709 12:14:18.025866  2950 raft_consensus.cc:606] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 LEADER]: Received request to transfer leadership to TS 8c9892e39cad43c1b378df6880ff1585
I20260709 12:14:18.038002  2880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:33092
I20260709 12:14:18.038868  2880 raft_consensus.cc:606] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Received request to transfer leadership to TS bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:18.186772  3098 raft_consensus.cc:993] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:18.187400  3098 raft_consensus.cc:1081] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Signalling peer bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:18.189586  2950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:14:18.190496  2950 raft_consensus.cc:493] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.190989  2950 raft_consensus.cc:3060] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.205536  2950 raft_consensus.cc:515] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.209215  2950 leader_election.cc:290] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:18.211620  2880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:18.212332  2880 raft_consensus.cc:3055] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.212692  2880 raft_consensus.cc:740] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:18.213769  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a500af1b98f4507ba54d9e09d99e85f" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:18.214636  2806 raft_consensus.cc:3060] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.221642  3105 raft_consensus.cc:993] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: : Instructing follower 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:18.222368  3105 raft_consensus.cc:1081] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Signalling peer 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:18.213644  2880 consensus_queue.cc:260] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.224751  2806 raft_consensus.cc:2468] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:18.226279  2878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:33090
I20260709 12:14:18.226604  2918 leader_election.cc:304] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:18.227108  2878 raft_consensus.cc:493] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.227596  2878 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.228084  3169 raft_consensus.cc:2804] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.228677  3169 raft_consensus.cc:697] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:18.229645  3169 consensus_queue.cc:237] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.233357  2880 raft_consensus.cc:3060] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.243827  2880 raft_consensus.cc:2468] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:18.245864  2878 raft_consensus.cc:515] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.246721  2703 catalog_manager.cc:5697] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 1 to 2, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:18.250406  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:18.251201  2806 raft_consensus.cc:3055] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.251554  2806 raft_consensus.cc:740] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:18.253147  2806 consensus_queue.cc:260] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.254910  2806 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.262629  2878 leader_election.cc:290] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:18.264277  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:18.265054  2951 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.266614  2806 raft_consensus.cc:2468] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:18.268697  2844 leader_election.cc:304] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:18.269832  3099 raft_consensus.cc:2804] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.270452  3099 raft_consensus.cc:697] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:18.271521  3099 consensus_queue.cc:237] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.285504  3165 raft_consensus.cc:993] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: : Instructing follower 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:18.286172  3167 raft_consensus.cc:1081] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 LEADER]: Signalling peer 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:18.288477  2879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:33082
I20260709 12:14:18.289129  2879 raft_consensus.cc:493] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.289608  2879 raft_consensus.cc:3060] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.295115  2951 raft_consensus.cc:2468] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:18.306734  2879 raft_consensus.cc:515] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.307178  2702 catalog_manager.cc:5697] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 1 to 2, leader changed from 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129) to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.309839  2879 leader_election.cc:290] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:18.313657  2804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:18.314457  2804 raft_consensus.cc:3060] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.318472  2951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1adf5ce52596498bbfdb7768ed0e0c46" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:18.319301  2951 raft_consensus.cc:3055] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.322024  3100 raft_consensus.cc:993] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower 0567de2e86f64dcd955de7b57f97deb8 to start an election
I20260709 12:14:18.322973  3100 raft_consensus.cc:1081] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Signalling peer 0567de2e86f64dcd955de7b57f97deb8 to start an election
I20260709 12:14:18.328778  2806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:14:18.334093  2806 raft_consensus.cc:493] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.334688  2806 raft_consensus.cc:3060] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.331048  2951 raft_consensus.cc:740] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:18.346210  3098 raft_consensus.cc:993] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower 0567de2e86f64dcd955de7b57f97deb8 to start an election
I20260709 12:14:18.344635  2804 raft_consensus.cc:2468] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:18.346783  3098 raft_consensus.cc:1081] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Signalling peer 0567de2e86f64dcd955de7b57f97deb8 to start an election
I20260709 12:14:18.348260  2951 consensus_queue.cc:260] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.344810  2806 raft_consensus.cc:515] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.352442  2805 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60187b90c27241d888d4ccd79840201f"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:14:18.353125  2805 raft_consensus.cc:493] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.353539  2805 raft_consensus.cc:3060] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.353883  2806 leader_election.cc:290] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:18.355505  2844 leader_election.cc:304] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:18.355880  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:18.356391  3143 raft_consensus.cc:2804] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.356556  2953 raft_consensus.cc:3060] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.356925  3143 raft_consensus.cc:697] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:18.357882  3143 consensus_queue.cc:237] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.360774  2878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534d0a5a06cf4d998e76650ba65f9168" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:18.361461  2878 raft_consensus.cc:3055] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.361784  2878 raft_consensus.cc:740] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:18.351881  2951 raft_consensus.cc:3060] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.363183  2878 consensus_queue.cc:260] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.366104  2878 raft_consensus.cc:3060] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.370438  2953 raft_consensus.cc:2468] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 2.
I20260709 12:14:18.371803  2772 leader_election.cc:304] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:18.372920  3105 raft_consensus.cc:2804] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.373662  3105 raft_consensus.cc:697] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:18.375020  3105 consensus_queue.cc:237] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.379118  2805 raft_consensus.cc:515] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.381912  2805 leader_election.cc:290] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:18.384382  2879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:18.385648  2879 raft_consensus.cc:3055] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.386113  2879 raft_consensus.cc:740] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:18.391289  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60187b90c27241d888d4ccd79840201f" candidate_uuid: "0567de2e86f64dcd955de7b57f97deb8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:18.392316  2953 raft_consensus.cc:3060] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.400170  2878 raft_consensus.cc:2468] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 2.
I20260709 12:14:18.387326  2879 consensus_queue.cc:260] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.403589  2704 catalog_manager.cc:5697] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 1 to 2, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.414516  2879 raft_consensus.cc:3060] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.425448  2951 raft_consensus.cc:2468] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:18.429951  2953 raft_consensus.cc:2468] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 2.
I20260709 12:14:18.431638  2772 leader_election.cc:304] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:18.432741  3105 raft_consensus.cc:2804] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.434365  3105 raft_consensus.cc:697] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Becoming Leader. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:18.435416  2879 raft_consensus.cc:2468] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0567de2e86f64dcd955de7b57f97deb8 in term 2.
I20260709 12:14:18.435499  3105 consensus_queue.cc:237] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.443691  2704 catalog_manager.cc:5697] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 1 to 2, leader changed from bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131) to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.477766  2704 catalog_manager.cc:5697] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 reported cstate change: term changed from 1 to 2, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "0567de2e86f64dcd955de7b57f97deb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.531054  3041 raft_consensus.cc:993] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: : Instructing follower 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:18.531642  3105 raft_consensus.cc:1081] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Signalling peer 8c9892e39cad43c1b378df6880ff1585 to start an election
I20260709 12:14:18.533560  2879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
 from {username='slave'} at 127.0.0.1:33090
I20260709 12:14:18.534209  2879 raft_consensus.cc:493] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.534700  2879 raft_consensus.cc:3060] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.541810  2879 raft_consensus.cc:515] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.544194  2879 leader_election.cc:290] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131:34185)
I20260709 12:14:18.544703  2805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:18.545397  2805 raft_consensus.cc:3055] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:18.545693  2805 raft_consensus.cc:740] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:18.546476  2805 consensus_queue.cc:260] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.547451  2805 raft_consensus.cc:3060] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.551398  2953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0de36e2a604a8eb463cb8588dfffc1" candidate_uuid: "8c9892e39cad43c1b378df6880ff1585" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
I20260709 12:14:18.552110  2953 raft_consensus.cc:3060] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:18.557267  2805 raft_consensus.cc:2468] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:18.559072  2844 leader_election.cc:304] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, 8c9892e39cad43c1b378df6880ff1585; no voters: 
I20260709 12:14:18.560402  3098 raft_consensus.cc:2804] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:18.560954  3098 raft_consensus.cc:697] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:18.561853  3098 consensus_queue.cc:237] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:18.563859  2953 raft_consensus.cc:2468] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9892e39cad43c1b378df6880ff1585 in term 2.
I20260709 12:14:18.583504  2704 catalog_manager.cc:5697] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 reported cstate change: term changed from 1 to 2, leader changed from 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129) to 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "8c9892e39cad43c1b378df6880ff1585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.684006  2805 raft_consensus.cc:1275] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.685892  3098 consensus_queue.cc:1048] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.714552  2951 raft_consensus.cc:1275] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.716639  3098 consensus_queue.cc:1048] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:18.804512  2879 raft_consensus.cc:1275] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.806551  3167 consensus_queue.cc:1048] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:18.845813  2805 raft_consensus.cc:1275] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.866189  3167 consensus_queue.cc:1048] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.901567  2805 raft_consensus.cc:1275] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.904111  3099 consensus_queue.cc:1048] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:18.922811  2953 raft_consensus.cc:1275] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 0567de2e86f64dcd955de7b57f97deb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.929111  3105 consensus_queue.cc:1048] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.933069  2953 raft_consensus.cc:1275] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.935928  3098 consensus_queue.cc:1048] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.953293  2950 raft_consensus.cc:1275] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 0567de2e86f64dcd955de7b57f97deb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.957587  3105 consensus_queue.cc:1048] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.969785  2879 raft_consensus.cc:1275] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer 0567de2e86f64dcd955de7b57f97deb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.971894  3041 consensus_queue.cc:1048] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.976161  2878 raft_consensus.cc:1275] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer 0567de2e86f64dcd955de7b57f97deb8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.996253  3105 consensus_queue.cc:1048] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:19.041221  2953 raft_consensus.cc:1275] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:19.042955  3099 consensus_queue.cc:1048] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:19.057480  2805 raft_consensus.cc:1275] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer 8c9892e39cad43c1b378df6880ff1585: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:19.061054  3190 consensus_queue.cc:1048] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:21.043442  2704 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:21.066622  2704 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:21.108530 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:14:21.213941  2844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:32859, user_credentials={real_user=slave}} blocked reactor thread for 80475.4us
W20260709 12:14:21.264422  2772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:34185, user_credentials={real_user=slave}} blocked reactor thread for 66687.6us
I20260709 12:14:21.520629  2880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:59786
I20260709 12:14:21.521329  2880 raft_consensus.cc:606] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Received request to transfer leadership to TS bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:21.521821  3259 tablet.cc:1724] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.541044  3261 tablet.cc:1724] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.523170  3254 tablet.cc:1724] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.663908  3263 tablet.cc:1724] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.631098  3262 tablet.cc:1724] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.682049  3274 tablet.cc:1724] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.682337  3271 tablet.cc:1724] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:21.696089  2981 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:9a500af1b98f4507ba54d9e09d99e85f)
W20260709 12:14:21.709697  2981 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:9a500af1b98f4507ba54d9e09d99e85f)
W20260709 12:14:21.713411  2981 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:9a500af1b98f4507ba54d9e09d99e85f)
I20260709 12:14:21.705439  2704 catalog_manager.cc:5789] TS 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697) does not have the latest schema for tablet 2c7eb0c7caee4501a4b45bb45bc107ca (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.723464  2704 catalog_manager.cc:5789] TS 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697) does not have the latest schema for tablet 1adf5ce52596498bbfdb7768ed0e0c46 (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.690421  3269 tablet.cc:1724] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.726529  2704 catalog_manager.cc:5789] TS 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697) does not have the latest schema for tablet 4e0de36e2a604a8eb463cb8588dfffc1 (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.687529  3268 tablet.cc:1724] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.746068  3275 tablet.cc:1724] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.717267  3277 tablet.cc:1724] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.756999  3273 tablet.cc:1724] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.800077  3230 raft_consensus.cc:993] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:21.801102  3230 raft_consensus.cc:1081] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Signalling peer bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:21.838057  2702 catalog_manager.cc:5789] TS 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859) does not have the latest schema for tablet a3f7b4d08e6e44a4ad21e82fe2eb93f6 (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.846861  2702 catalog_manager.cc:5789] TS 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859) does not have the latest schema for tablet 3e14601d0685473dabce354125d5209b (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.853866  2947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:14:21.854624  2947 raft_consensus.cc:493] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:21.855031  2947 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.861404  2702 catalog_manager.cc:5789] TS 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859) does not have the latest schema for tablet 534d0a5a06cf4d998e76650ba65f9168 (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.862485  2702 catalog_manager.cc:5789] TS 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859) does not have the latest schema for tablet 60187b90c27241d888d4ccd79840201f (table soft_deleted_table [id=c5b573a040384beaaee10d743c66021f]). Expected version 1 got 0
I20260709 12:14:21.866680  3271 tablet.cc:1724] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.888573  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
mode: GRACEFUL
new_leader_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:53270
I20260709 12:14:21.889240  2806 raft_consensus.cc:606] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Received request to transfer leadership to TS bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:21.894752 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:14:21.895514 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.896674  3273 tablet.cc:1724] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.899122  3263 tablet.cc:1724] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.913322  2947 raft_consensus.cc:515] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:21.916934  2806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abcb55386d074c40b86d773780c27daf"
dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
mode: GRACEFUL
new_leader_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:53270
I20260709 12:14:21.917665  2806 raft_consensus.cc:606] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Received request to transfer leadership to TS bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:21.919538  2947 leader_election.cc:290] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 3 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:21.921061  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:21.921277  3269 tablet.cc:1724] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.921890  2881 raft_consensus.cc:3055] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:21.923332  2881 raft_consensus.cc:740] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:21.922935  3277 tablet.cc:1724] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.922609  3274 tablet.cc:1724] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.927011  2877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be559602e94449c0a4adad5067dd1178"
dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
mode: GRACEFUL
new_leader_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:59786
I20260709 12:14:21.927177  2881 consensus_queue.cc:260] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:21.927910  2877 raft_consensus.cc:606] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Received request to transfer leadership to TS bf434d3160e048d2ae43783dcb5c4452
I20260709 12:14:21.928668  2881 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.936782  3262 tablet.cc:1724] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.939734  2801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c7eb0c7caee4501a4b45bb45bc107ca" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:21.940570  2801 raft_consensus.cc:3060] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:21.946103  3259 tablet.cc:1724] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.949379  2801 raft_consensus.cc:2468] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 3.
I20260709 12:14:21.934314  3271 tablet.cc:1724] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.951915  2918 leader_election.cc:304] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:21.953033  3265 raft_consensus.cc:2804] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:21.953632  3265 raft_consensus.cc:697] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 3 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:21.953303  3268 tablet.cc:1724] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.954110  3275 tablet.cc:1724] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.954619  3265 consensus_queue.cc:237] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:21.964097 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:21.967722 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:21.965057  3261 tablet.cc:1724] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.974668  3254 tablet.cc:1724] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.990276  3269 tablet.cc:1724] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:21.998961  3274 tablet.cc:1724] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:22.003432  2881 raft_consensus.cc:2468] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 3.
I20260709 12:14:22.024442  2704 catalog_manager.cc:5697] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 2 to 3, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.035074  2702 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478: soft_deleted_table [id=c5b573a040384beaaee10d743c66021f] alter complete (version 1)
I20260709 12:14:22.191448  3219 raft_consensus.cc:993] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: : Instructing follower bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:22.192173  3218 raft_consensus.cc:1081] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Signalling peer bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:22.193913  2947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be559602e94449c0a4adad5067dd1178"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:35202
I20260709 12:14:22.194666  2947 raft_consensus.cc:493] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.195101  2947 raft_consensus.cc:3060] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.201546  2947 raft_consensus.cc:515] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:22.203737  2947 leader_election.cc:290] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:22.204413  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:22.204824  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be559602e94449c0a4adad5067dd1178" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:22.205176  2806 raft_consensus.cc:3060] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.205498  2881 raft_consensus.cc:3055] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:22.205874  2881 raft_consensus.cc:740] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9892e39cad43c1b378df6880ff1585, State: Running, Role: LEADER
I20260709 12:14:22.207078  2881 consensus_queue.cc:260] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:22.208792  2881 raft_consensus.cc:3060] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.213385  2806 raft_consensus.cc:2468] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:22.214632  2918 leader_election.cc:304] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:22.215458  3265 raft_consensus.cc:2804] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:22.215907  3265 raft_consensus.cc:697] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:22.216840  2881 raft_consensus.cc:2468] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:22.216748  3265 consensus_queue.cc:237] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:22.226752  2703 catalog_manager.cc:5697] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 1 to 2, leader changed from 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130) to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.305584  3239 raft_consensus.cc:993] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: : Instructing follower bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:22.306356  3252 raft_consensus.cc:1081] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Signalling peer bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:22.308097  2947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:35212
I20260709 12:14:22.308581  3239 raft_consensus.cc:993] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: : Instructing follower bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:22.308738  2947 raft_consensus.cc:493] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.309233  3252 raft_consensus.cc:1081] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Signalling peer bf434d3160e048d2ae43783dcb5c4452 to start an election
I20260709 12:14:22.309273  2947 raft_consensus.cc:3060] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.311132  2954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abcb55386d074c40b86d773780c27daf"
dest_uuid: "bf434d3160e048d2ae43783dcb5c4452"
 from {username='slave'} at 127.0.0.1:35212
I20260709 12:14:22.311684  2954 raft_consensus.cc:493] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:22.312021  2954 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.316471  2947 raft_consensus.cc:515] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:22.317859  2954 raft_consensus.cc:515] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:22.318588  2947 leader_election.cc:290] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Requested vote from peers 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859), 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697)
I20260709 12:14:22.319504  2806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:22.319676  2881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7b4d08e6e44a4ad21e82fe2eb93f6" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:22.320578  2881 raft_consensus.cc:3060] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.321285  2877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c9892e39cad43c1b378df6880ff1585"
I20260709 12:14:22.321487  2806 raft_consensus.cc:3055] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:22.321564  2801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb55386d074c40b86d773780c27daf" candidate_uuid: "bf434d3160e048d2ae43783dcb5c4452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0567de2e86f64dcd955de7b57f97deb8"
I20260709 12:14:22.322111  2877 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.322434  2801 raft_consensus.cc:3055] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:22.323123  2801 raft_consensus.cc:740] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:22.323186  2954 leader_election.cc:290] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 3 election: Requested vote from peers 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697), 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859)
I20260709 12:14:22.322093  2806 raft_consensus.cc:740] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0567de2e86f64dcd955de7b57f97deb8, State: Running, Role: LEADER
I20260709 12:14:22.324136  2801 consensus_queue.cc:260] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:22.325726  2801 raft_consensus.cc:3060] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:22.325498  2806 consensus_queue.cc:260] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:22.326980  2806 raft_consensus.cc:3060] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:22.329895  2881 raft_consensus.cc:2468] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:22.331300  2919 leader_election.cc:304] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c9892e39cad43c1b378df6880ff1585, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:22.332360  3265 raft_consensus.cc:2804] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:22.333478  2801 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 3.
I20260709 12:14:22.333719  3265 raft_consensus.cc:697] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:22.334780  2918 leader_election.cc:304] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0567de2e86f64dcd955de7b57f97deb8, bf434d3160e048d2ae43783dcb5c4452; no voters: 
I20260709 12:14:22.335779  2806 raft_consensus.cc:2468] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 2.
I20260709 12:14:22.335813  3200 raft_consensus.cc:2804] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:22.336555  2877 raft_consensus.cc:2468] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bf434d3160e048d2ae43783dcb5c4452 in term 3.
I20260709 12:14:22.336201  3265 consensus_queue.cc:237] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } }
I20260709 12:14:22.338688  3200 raft_consensus.cc:697] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 3 LEADER]: Becoming Leader. State: Replica: bf434d3160e048d2ae43783dcb5c4452, State: Running, Role: LEADER
I20260709 12:14:22.339759  3200 consensus_queue.cc:237] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } }
I20260709 12:14:22.345214  2703 catalog_manager.cc:5697] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 1 to 2, leader changed from 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129) to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.359366  2703 catalog_manager.cc:5697] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 reported cstate change: term changed from 2 to 3, leader changed from 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129) to bf434d3160e048d2ae43783dcb5c4452 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "bf434d3160e048d2ae43783dcb5c4452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf434d3160e048d2ae43783dcb5c4452" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 34185 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:22.538653  2877 raft_consensus.cc:1275] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:22.540248  3200 consensus_queue.cc:1048] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:22.553181  2806 raft_consensus.cc:1275] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:22.554689  3285 consensus_queue.cc:1048] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:22.653481  2877 raft_consensus.cc:1275] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:22.654981  3285 consensus_queue.cc:1048] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:22.665928  2806 raft_consensus.cc:1275] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:22.667757  3200 consensus_queue.cc:1048] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:22.726308  2806 raft_consensus.cc:1275] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:22.727772  3200 consensus_queue.cc:1048] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:22.735342  2877 raft_consensus.cc:1275] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.741151  2877 raft_consensus.cc:1275] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:22.741040  3200 consensus_queue.cc:1048] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:22.743130  3200 consensus_queue.cc:1048] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9892e39cad43c1b378df6880ff1585" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 45697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:22.757684  2806 raft_consensus.cc:1275] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Refusing update from remote peer bf434d3160e048d2ae43783dcb5c4452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:22.759369  3293 consensus_queue.cc:1048] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0567de2e86f64dcd955de7b57f97deb8" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 32859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:22.971596 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:22.978209 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:22.978821 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:22.984285 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:22.984732 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:23.985988 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:23.992195 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:23.992722 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:23.997887 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:23.998643 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:25.000442 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:25.006871 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:25.007395 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:25.013851 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:25.014460 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:26.015928 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:26.022172 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:26.022763 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:26.030426 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:26.031032 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:27.333649 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:27.341176 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:27.341809 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:27.348862 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:27.349396 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:28.144527  2976 debug-util.cc:398] Leaking SignalData structure 0x7b0800290840 after lost signal to thread 24445
W20260709 12:14:28.146131  2976 debug-util.cc:398] Leaking SignalData structure 0x7b0800157da0 after lost signal to thread 2738
W20260709 12:14:28.147513  2976 debug-util.cc:398] Leaking SignalData structure 0x7b0800261020 after lost signal to thread 2830
W20260709 12:14:28.148690  2976 debug-util.cc:398] Leaking SignalData structure 0x7b080010f160 after lost signal to thread 2905
W20260709 12:14:28.149816  2976 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9760 after lost signal to thread 2979
I20260709 12:14:28.350986 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:28.357110 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:28.357702 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:28.365046 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:28.365765 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:29.367141 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:29.376124 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:29.377086 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:29.385599 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:29.386283 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:30.387758 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:30.397408 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:30.398070 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:30.406359 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:30.406988 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:31.408329 24442 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:31.417285 24442 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:31.417990 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:31.426753 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:31.427415 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:32.494211 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
W20260709 12:14:32.495767  2844 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 12:14:32.502519  2844 consensus_peers.cc:597] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.541432  2918 consensus_peers.cc:597] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.544569 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:32.545840 24442 tablet_replica.cc:333] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.547055 24442 raft_consensus.cc:2243] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.548156 24442 raft_consensus.cc:2272] T 1adf5ce52596498bbfdb7768ed0e0c46 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.552498 24442 tablet_replica.cc:333] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.553813 24442 raft_consensus.cc:2243] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.554651 24442 raft_consensus.cc:2272] T 9a500af1b98f4507ba54d9e09d99e85f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.557639 24442 tablet_replica.cc:333] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.558439 24442 raft_consensus.cc:2243] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.559044 24442 raft_consensus.cc:2272] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.562043 24442 tablet_replica.cc:333] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.563323 24442 raft_consensus.cc:2243] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.564077 24442 raft_consensus.cc:2272] T 2c7eb0c7caee4501a4b45bb45bc107ca P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.567823 24442 tablet_replica.cc:333] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.568733 24442 raft_consensus.cc:2243] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.570046 24442 raft_consensus.cc:2272] T 3e14601d0685473dabce354125d5209b P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.573104 24442 tablet_replica.cc:333] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.573777 24442 raft_consensus.cc:2243] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.574503 24442 raft_consensus.cc:2272] T 4e0de36e2a604a8eb463cb8588dfffc1 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.577220 24442 tablet_replica.cc:333] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.577962 24442 raft_consensus.cc:2243] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.578610 24442 raft_consensus.cc:2272] T 88c6ee4ba61149afad248ea2580eedd3 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.581427 24442 tablet_replica.cc:333] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.582165 24442 raft_consensus.cc:2243] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.582787 24442 raft_consensus.cc:2272] T be559602e94449c0a4adad5067dd1178 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.585655 24442 tablet_replica.cc:333] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.586371 24442 raft_consensus.cc:2243] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.587589 24442 raft_consensus.cc:2272] T 18df1b1df2734612a43e25825eb17a89 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.590598 24442 tablet_replica.cc:333] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.591318 24442 raft_consensus.cc:2243] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.591959 24442 raft_consensus.cc:2272] T abcb55386d074c40b86d773780c27daf P 0567de2e86f64dcd955de7b57f97deb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.595474 24442 tablet_replica.cc:333] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.596212 24442 raft_consensus.cc:2243] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.597191 24442 raft_consensus.cc:2272] T 534d0a5a06cf4d998e76650ba65f9168 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.600063 24442 tablet_replica.cc:333] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.600770 24442 raft_consensus.cc:2243] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.601807 24442 raft_consensus.cc:2272] T 60187b90c27241d888d4ccd79840201f P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.604861 24442 tablet_replica.cc:333] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.605592 24442 raft_consensus.cc:2243] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.606190 24442 raft_consensus.cc:2272] T 92d44dd63c74460186ed3e42516f6dd0 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.609033 24442 tablet_replica.cc:333] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.609614 24442 raft_consensus.cc:2243] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.610152 24442 raft_consensus.cc:2272] T a05f73e044004481ade3b0f468be3102 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.613175 24442 tablet_replica.cc:333] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.613955 24442 raft_consensus.cc:2243] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.614933 24442 raft_consensus.cc:2272] T f4859451644e4e9b81e16da7480bde72 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.618211 24442 tablet_replica.cc:333] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.619038 24442 raft_consensus.cc:2243] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.619851 24442 raft_consensus.cc:2272] T 72c33d9327104fb89a6d5ea17b1f5baf P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.623142 24442 tablet_replica.cc:333] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.623850 24442 raft_consensus.cc:2243] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.624889 24442 raft_consensus.cc:2272] T 0908f97816214cddbd15d618c9725306 P 0567de2e86f64dcd955de7b57f97deb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.627565 24442 tablet_replica.cc:333] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8: stopping tablet replica
I20260709 12:14:32.628141 24442 raft_consensus.cc:2243] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.628959 24442 raft_consensus.cc:2272] T c42f985376024658a96143f87d8bff18 P 0567de2e86f64dcd955de7b57f97deb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.704622 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
W20260709 12:14:32.732869  2918 consensus_peers.cc:597] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.749224  2844 consensus_peers.cc:597] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.749788  2844 consensus_peers.cc:597] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.756733  2918 consensus_peers.cc:597] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.768365 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
W20260709 12:14:32.779877  2844 consensus_peers.cc:597] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.807613  2844 consensus_peers.cc:597] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.819483 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:32.820659 24442 tablet_replica.cc:333] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.821947 24442 raft_consensus.cc:2243] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.822889 24442 raft_consensus.cc:2272] T 3e14601d0685473dabce354125d5209b P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.825852 24442 tablet_replica.cc:333] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.826597 24442 raft_consensus.cc:2243] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.827188 24442 raft_consensus.cc:2272] T 2c7eb0c7caee4501a4b45bb45bc107ca P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.829937 24442 tablet_replica.cc:333] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.830770 24442 raft_consensus.cc:2243] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.831491 24442 raft_consensus.cc:2272] T 9a500af1b98f4507ba54d9e09d99e85f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.835321 24442 tablet_replica.cc:333] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.836653 24442 raft_consensus.cc:2243] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.837844 24442 raft_consensus.cc:2272] T 1adf5ce52596498bbfdb7768ed0e0c46 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.838232  2844 consensus_peers.cc:597] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.840582 24442 tablet_replica.cc:333] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.841285 24442 raft_consensus.cc:2243] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.841787 24442 raft_consensus.cc:2272] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.844372 24442 tablet_replica.cc:333] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.845016 24442 raft_consensus.cc:2243] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.845692 24442 raft_consensus.cc:2272] T 534d0a5a06cf4d998e76650ba65f9168 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.848311 24442 tablet_replica.cc:333] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.848997 24442 raft_consensus.cc:2243] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.849691 24442 raft_consensus.cc:2272] T 60187b90c27241d888d4ccd79840201f P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.853358 24442 tablet_replica.cc:333] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.854053 24442 raft_consensus.cc:2243] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.855132 24442 raft_consensus.cc:2272] T 4e0de36e2a604a8eb463cb8588dfffc1 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.858151 24442 tablet_replica.cc:333] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.858843 24442 raft_consensus.cc:2243] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.859403 24442 raft_consensus.cc:2272] T be559602e94449c0a4adad5067dd1178 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.861976 24442 tablet_replica.cc:333] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.862627 24442 raft_consensus.cc:2243] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.863493 24442 raft_consensus.cc:2272] T 88c6ee4ba61149afad248ea2580eedd3 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.866012 24442 tablet_replica.cc:333] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.866612 24442 raft_consensus.cc:2243] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.867568 24442 raft_consensus.cc:2272] T a05f73e044004481ade3b0f468be3102 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.869869 24442 tablet_replica.cc:333] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.870428 24442 raft_consensus.cc:2243] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.870868 24442 raft_consensus.cc:2272] T 92d44dd63c74460186ed3e42516f6dd0 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.874362 24442 tablet_replica.cc:333] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.875139 24442 raft_consensus.cc:2243] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.876410 24442 raft_consensus.cc:2272] T c42f985376024658a96143f87d8bff18 P 8c9892e39cad43c1b378df6880ff1585 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.879182  2919 consensus_peers.cc:597] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 -> Peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Couldn't send request to peer 8c9892e39cad43c1b378df6880ff1585. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.880273 24442 tablet_replica.cc:333] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.880927 24442 raft_consensus.cc:2243] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.881430 24442 raft_consensus.cc:2272] T abcb55386d074c40b86d773780c27daf P 8c9892e39cad43c1b378df6880ff1585 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.883862 24442 tablet_replica.cc:333] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.884509 24442 raft_consensus.cc:2243] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.884953 24442 raft_consensus.cc:2272] T 18df1b1df2734612a43e25825eb17a89 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.887388 24442 tablet_replica.cc:333] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.887879 24442 raft_consensus.cc:2243] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:32.888726 24442 raft_consensus.cc:2272] T 72c33d9327104fb89a6d5ea17b1f5baf P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.891096 24442 tablet_replica.cc:333] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.891623 24442 raft_consensus.cc:2243] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.892017 24442 raft_consensus.cc:2272] T 0908f97816214cddbd15d618c9725306 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:32.894330 24442 tablet_replica.cc:333] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585: stopping tablet replica
I20260709 12:14:32.894790 24442 raft_consensus.cc:2243] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:32.895221 24442 raft_consensus.cc:2272] T f4859451644e4e9b81e16da7480bde72 P 8c9892e39cad43c1b378df6880ff1585 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:32.914924  2918 consensus_peers.cc:597] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.929699  2919 consensus_peers.cc:597] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 -> Peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Couldn't send request to peer 8c9892e39cad43c1b378df6880ff1585. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.936849  2918 consensus_peers.cc:597] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:32.956499  2919 consensus_peers.cc:597] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 -> Peer 8c9892e39cad43c1b378df6880ff1585 (127.23.222.130:45697): Couldn't send request to peer 8c9892e39cad43c1b378df6880ff1585. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:45697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:32.977927 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
W20260709 12:14:32.980350  2918 consensus_peers.cc:597] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 -> Peer 0567de2e86f64dcd955de7b57f97deb8 (127.23.222.129:32859): Couldn't send request to peer 0567de2e86f64dcd955de7b57f97deb8. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:32859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:33.027845 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
I20260709 12:14:33.067538 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:33.068710 24442 tablet_replica.cc:333] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.069921 24442 raft_consensus.cc:2243] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.071321 24442 raft_consensus.cc:2272] T a3f7b4d08e6e44a4ad21e82fe2eb93f6 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.073930 24442 tablet_replica.cc:333] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.074693 24442 raft_consensus.cc:2243] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.075274 24442 raft_consensus.cc:2272] T 1adf5ce52596498bbfdb7768ed0e0c46 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.078087 24442 tablet_replica.cc:333] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.078979 24442 raft_consensus.cc:2243] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.080276 24442 raft_consensus.cc:2272] T 2c7eb0c7caee4501a4b45bb45bc107ca P bf434d3160e048d2ae43783dcb5c4452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.082796 24442 tablet_replica.cc:333] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.083545 24442 raft_consensus.cc:2243] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.084075 24442 raft_consensus.cc:2272] T 534d0a5a06cf4d998e76650ba65f9168 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.086341 24442 tablet_replica.cc:333] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.086959 24442 raft_consensus.cc:2243] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.087476 24442 raft_consensus.cc:2272] T 60187b90c27241d888d4ccd79840201f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.089938 24442 tablet_replica.cc:333] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.090569 24442 raft_consensus.cc:2243] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.091094 24442 raft_consensus.cc:2272] T 3e14601d0685473dabce354125d5209b P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.093258 24442 tablet_replica.cc:333] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.093847 24442 raft_consensus.cc:2243] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.094791 24442 raft_consensus.cc:2272] T 9a500af1b98f4507ba54d9e09d99e85f P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.096904 24442 tablet_replica.cc:333] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.097461 24442 raft_consensus.cc:2243] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.097851 24442 raft_consensus.cc:2272] T a05f73e044004481ade3b0f468be3102 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.100265 24442 tablet_replica.cc:333] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.100786 24442 raft_consensus.cc:2243] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.101668 24442 raft_consensus.cc:2272] T 92d44dd63c74460186ed3e42516f6dd0 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.103987 24442 tablet_replica.cc:333] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.104519 24442 raft_consensus.cc:2243] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.105346 24442 raft_consensus.cc:2272] T abcb55386d074c40b86d773780c27daf P bf434d3160e048d2ae43783dcb5c4452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.107627 24442 tablet_replica.cc:333] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.108177 24442 raft_consensus.cc:2243] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.108572 24442 raft_consensus.cc:2272] T 18df1b1df2734612a43e25825eb17a89 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.110977 24442 tablet_replica.cc:333] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.112030 24442 raft_consensus.cc:2243] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.112686 24442 raft_consensus.cc:2272] T 4e0de36e2a604a8eb463cb8588dfffc1 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.115021 24442 tablet_replica.cc:333] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.115638 24442 raft_consensus.cc:2243] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.116655 24442 raft_consensus.cc:2272] T be559602e94449c0a4adad5067dd1178 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.119059 24442 tablet_replica.cc:333] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.119732 24442 raft_consensus.cc:2243] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.120314 24442 raft_consensus.cc:2272] T 88c6ee4ba61149afad248ea2580eedd3 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.123193 24442 tablet_replica.cc:333] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.123883 24442 raft_consensus.cc:2243] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.124454 24442 raft_consensus.cc:2272] T 72c33d9327104fb89a6d5ea17b1f5baf P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.126789 24442 tablet_replica.cc:333] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.127355 24442 raft_consensus.cc:2243] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.127879 24442 raft_consensus.cc:2272] T 0908f97816214cddbd15d618c9725306 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.130249 24442 tablet_replica.cc:333] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.130817 24442 raft_consensus.cc:2243] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.131332 24442 raft_consensus.cc:2272] T c42f985376024658a96143f87d8bff18 P bf434d3160e048d2ae43783dcb5c4452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.133809 24442 tablet_replica.cc:333] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452: stopping tablet replica
I20260709 12:14:33.134428 24442 raft_consensus.cc:2243] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:33.134920 24442 raft_consensus.cc:2272] T f4859451644e4e9b81e16da7480bde72 P bf434d3160e048d2ae43783dcb5c4452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.204067 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:14:33.251822 24442 master.cc:562] Master@127.23.222.190:38881 shutting down...
I20260709 12:14:33.284813 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:33.285653 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:33.285984 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0f4ee6461ce7432288a62552b3725478: stopping tablet replica
I20260709 12:14:33.308704 24442 master.cc:584] Master@127.23.222.190:38881 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (23296 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:14:33.372059 24442 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.222.190:39105
I20260709 12:14:33.373356 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:33.380518  3334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.380539  3333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.380631  3336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:33.382032 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:33.383266 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:33.383509 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:33.383635 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599273383618 us; error 0 us; skew 500 ppm
I20260709 12:14:33.384117 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:33.387146 24442 webserver.cc:533] Webserver started at http://127.23.222.190:35645/ using document root <none> and password file <none>
I20260709 12:14:33.387655 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:33.387821 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:33.388047 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:33.389303 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/master-0-root/instance:
uuid: "5c0f76a841c243fbbadafc742bce6436"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.394477 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:14:33.398751  3341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.399796 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:33.400149 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/master-0-root
uuid: "5c0f76a841c243fbbadafc742bce6436"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.400493 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:33.425117 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:33.426673 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:33.479185 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.190:39105
I20260709 12:14:33.479542  3392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.190:39105 every 8 connection(s)
I20260709 12:14:33.484280  3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:33.498977  3393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436: Bootstrap starting.
I20260709 12:14:33.506700  3393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:33.512207  3393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436: No bootstrap required, opened a new log
I20260709 12:14:33.515028  3393 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c0f76a841c243fbbadafc742bce6436" member_type: VOTER }
I20260709 12:14:33.515532  3393 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:33.515733  3393 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c0f76a841c243fbbadafc742bce6436, State: Initialized, Role: FOLLOWER
I20260709 12:14:33.516462  3393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c0f76a841c243fbbadafc742bce6436" member_type: VOTER }
I20260709 12:14:33.516993  3393 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:33.517207  3393 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:33.517535  3393 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:33.523751  3393 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c0f76a841c243fbbadafc742bce6436" member_type: VOTER }
I20260709 12:14:33.524366  3393 leader_election.cc:304] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c0f76a841c243fbbadafc742bce6436; no voters: 
I20260709 12:14:33.525642  3393 leader_election.cc:290] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:33.526072  3396 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:33.527851  3396 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 1 LEADER]: Becoming Leader. State: Replica: 5c0f76a841c243fbbadafc742bce6436, State: Running, Role: LEADER
I20260709 12:14:33.528606  3396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c0f76a841c243fbbadafc742bce6436" member_type: VOTER }
I20260709 12:14:33.528909  3393 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:33.534636  3398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c0f76a841c243fbbadafc742bce6436. Latest consensus state: current_term: 1 leader_uuid: "5c0f76a841c243fbbadafc742bce6436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c0f76a841c243fbbadafc742bce6436" member_type: VOTER } }
I20260709 12:14:33.535666  3398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:33.535776  3397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c0f76a841c243fbbadafc742bce6436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c0f76a841c243fbbadafc742bce6436" member_type: VOTER } }
I20260709 12:14:33.536479  3397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:33.538103  3406 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:33.544371  3406 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:33.545848 24442 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:33.556793  3406 catalog_manager.cc:1383] Generated new cluster ID: 87f8b60609374575b6482d1d22f98283
I20260709 12:14:33.557194  3406 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:33.577548  3406 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:33.579140  3406 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:33.603701  3406 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436: Generated new TSK 0
I20260709 12:14:33.604418  3406 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:33.613283 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:33.620273  3414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.621731  3415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.623196  3417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:33.624575 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:33.625728 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:33.625928 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:33.626132 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599273626097 us; error 0 us; skew 500 ppm
I20260709 12:14:33.626775 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:33.630357 24442 webserver.cc:533] Webserver started at http://127.23.222.129:38121/ using document root <none> and password file <none>
I20260709 12:14:33.630995 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:33.631220 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:33.631524 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:33.632789 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-0-root/instance:
uuid: "575eb2eea84a4baa9c8c313e035a5b82"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.637639 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:14:33.641760  3422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.643133 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:33.643566 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-0-root
uuid: "575eb2eea84a4baa9c8c313e035a5b82"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.643949 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:33.664976 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:33.666558 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:33.668377 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:33.671393 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:33.671635 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.671931 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:33.672142 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.724411 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.129:44501
I20260709 12:14:33.724531  3484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.129:44501 every 8 connection(s)
I20260709 12:14:33.730193 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:33.738824  3489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.741927  3490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.746269  3492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:33.747223 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:33.748777 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:33.748984 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:33.749198 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599273749180 us; error 0 us; skew 500 ppm
I20260709 12:14:33.749887 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:33.753525 24442 webserver.cc:533] Webserver started at http://127.23.222.130:42821/ using document root <none> and password file <none>
I20260709 12:14:33.754114 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:33.754379 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:33.754518  3485 heartbeater.cc:344] Connected to a master server at 127.23.222.190:39105
I20260709 12:14:33.754673 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:33.755080  3485 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:33.755949  3485 heartbeater.cc:507] Master 127.23.222.190:39105 requested a full tablet report, sending...
I20260709 12:14:33.756278 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-1-root/instance:
uuid: "4e40ab447e46441593eca3776e0cf0b7"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.758632  3358 ts_manager.cc:194] Registered new tserver with Master: 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501)
I20260709 12:14:33.761210  3358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52284
I20260709 12:14:33.762007 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:14:33.766217  3497 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.767429 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:33.767814 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-1-root
uuid: "4e40ab447e46441593eca3776e0cf0b7"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.768159 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:33.787282 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:33.788735 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:33.790531 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:33.793071 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:33.793323 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.793601 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:33.793794 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.850798 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.130:44763
I20260709 12:14:33.850906  3559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.130:44763 every 8 connection(s)
I20260709 12:14:33.856877 24442 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:33.866202  3563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.866513  3564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:33.869557  3566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:33.870910  3560 heartbeater.cc:344] Connected to a master server at 127.23.222.190:39105
I20260709 12:14:33.871232 24442 server_base.cc:1061] running on GCE node
I20260709 12:14:33.871472  3560 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:33.872289 24442 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:33.872603 24442 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:33.872469  3560 heartbeater.cc:507] Master 127.23.222.190:39105 requested a full tablet report, sending...
I20260709 12:14:33.872923 24442 hybrid_clock.cc:648] HybridClock initialized: now 1783599273872910 us; error 0 us; skew 500 ppm
I20260709 12:14:33.873682 24442 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:33.875736  3358 ts_manager.cc:194] Registered new tserver with Master: 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:33.876938 24442 webserver.cc:533] Webserver started at http://127.23.222.131:41715/ using document root <none> and password file <none>
I20260709 12:14:33.877626 24442 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:33.877843 24442 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:33.877777  3358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52286
I20260709 12:14:33.878407 24442 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:33.879899 24442 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-2-root/instance:
uuid: "48dadfe9d82c4b13b51c3459a4162531"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.885413 24442 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:33.889567  3571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.890616 24442 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:33.890909 24442 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-2-root
uuid: "48dadfe9d82c4b13b51c3459a4162531"
format_stamp: "Formatted at 2026-07-09 12:14:33 on dist-test-slave-90bm"
I20260709 12:14:33.891176 24442 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiBoHBe/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894803819-24442-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:33.914516 24442 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:33.916072 24442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:33.917563 24442 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:33.920233 24442 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:33.920499 24442 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.920779 24442 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:33.921012 24442 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:33.973117 24442 rpc_server.cc:307] RPC server started. Bound to: 127.23.222.131:43617
I20260709 12:14:33.973237  3633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.222.131:43617 every 8 connection(s)
I20260709 12:14:33.990736  3634 heartbeater.cc:344] Connected to a master server at 127.23.222.190:39105
I20260709 12:14:33.991367  3634 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:33.992249  3634 heartbeater.cc:507] Master 127.23.222.190:39105 requested a full tablet report, sending...
I20260709 12:14:33.995107  3358 ts_manager.cc:194] Registered new tserver with Master: 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:33.996096 24442 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018882579s
I20260709 12:14:33.996717  3358 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52294
I20260709 12:14:34.027443  3358 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52296:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:34.031059  3358 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:34.110833  3599 tablet_service.cc:1511] Processing CreateTablet for tablet b376a0f3a02a45c4a3eab6cca6ff4a3b (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:34.111677  3597 tablet_service.cc:1511] Processing CreateTablet for tablet e9f188849ee344b3aa4ca0b680fedbda (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:34.112859  3599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b376a0f3a02a45c4a3eab6cca6ff4a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.114127  3598 tablet_service.cc:1511] Processing CreateTablet for tablet d52b992f53de440a9c609eb9a6787239 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:34.114668  3597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f188849ee344b3aa4ca0b680fedbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.116650  3598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b992f53de440a9c609eb9a6787239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.125825  3596 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1b7dead0a147dea07b2d34e4115450 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:34.127547  3596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1b7dead0a147dea07b2d34e4115450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.130383  3450 tablet_service.cc:1511] Processing CreateTablet for tablet b376a0f3a02a45c4a3eab6cca6ff4a3b (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:34.131989  3450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b376a0f3a02a45c4a3eab6cca6ff4a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.133966  3449 tablet_service.cc:1511] Processing CreateTablet for tablet d52b992f53de440a9c609eb9a6787239 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:34.135457  3449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b992f53de440a9c609eb9a6787239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.139381  3448 tablet_service.cc:1511] Processing CreateTablet for tablet e9f188849ee344b3aa4ca0b680fedbda (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:34.140955  3448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f188849ee344b3aa4ca0b680fedbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.143671  3447 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1b7dead0a147dea07b2d34e4115450 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:34.145182  3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1b7dead0a147dea07b2d34e4115450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.146622  3594 tablet_service.cc:1511] Processing CreateTablet for tablet d99b40b347c3420398a720ffae71441d (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:34.147568  3446 tablet_service.cc:1511] Processing CreateTablet for tablet 607eba4852cc42f2bb44d6f949d08ee6 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:34.148283  3594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b40b347c3420398a720ffae71441d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.149042  3446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607eba4852cc42f2bb44d6f949d08ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.151641  3445 tablet_service.cc:1511] Processing CreateTablet for tablet d99b40b347c3420398a720ffae71441d (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:34.153112  3445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b40b347c3420398a720ffae71441d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.159392  3595 tablet_service.cc:1511] Processing CreateTablet for tablet 607eba4852cc42f2bb44d6f949d08ee6 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:34.161005  3595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607eba4852cc42f2bb44d6f949d08ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.164309  3593 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a77caa85940c69b005bbe1f44aa24 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:34.157603  3444 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a77caa85940c69b005bbe1f44aa24 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:34.166208  3592 tablet_service.cc:1511] Processing CreateTablet for tablet 48c3855e15a24fe993d411300c2be843 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:34.167532  3444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a77caa85940c69b005bbe1f44aa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.161026  3443 tablet_service.cc:1511] Processing CreateTablet for tablet 48c3855e15a24fe993d411300c2be843 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:34.169894  3443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c3855e15a24fe993d411300c2be843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.183156  3524 tablet_service.cc:1511] Processing CreateTablet for tablet d52b992f53de440a9c609eb9a6787239 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:34.184942  3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d52b992f53de440a9c609eb9a6787239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.185570  3442 tablet_service.cc:1511] Processing CreateTablet for tablet e9dffe8f34ed415c854944a1c77c8993 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:34.187323  3442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9dffe8f34ed415c854944a1c77c8993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.191756  3525 tablet_service.cc:1511] Processing CreateTablet for tablet b376a0f3a02a45c4a3eab6cca6ff4a3b (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:34.194769  3523 tablet_service.cc:1511] Processing CreateTablet for tablet e9f188849ee344b3aa4ca0b680fedbda (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:34.197275  3522 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1b7dead0a147dea07b2d34e4115450 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:34.199848  3521 tablet_service.cc:1511] Processing CreateTablet for tablet 607eba4852cc42f2bb44d6f949d08ee6 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:34.202443  3520 tablet_service.cc:1511] Processing CreateTablet for tablet d99b40b347c3420398a720ffae71441d (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:34.205435  3519 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a77caa85940c69b005bbe1f44aa24 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:34.206466  3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b376a0f3a02a45c4a3eab6cca6ff4a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.215653  3649 tablet_bootstrap.cc:492] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.222550  3592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c3855e15a24fe993d411300c2be843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.226786  3518 tablet_service.cc:1511] Processing CreateTablet for tablet 48c3855e15a24fe993d411300c2be843 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:34.228410  3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99b40b347c3420398a720ffae71441d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.229601  3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f188849ee344b3aa4ca0b680fedbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.233392  3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a77caa85940c69b005bbe1f44aa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.237690  3517 tablet_service.cc:1511] Processing CreateTablet for tablet e9dffe8f34ed415c854944a1c77c8993 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:34.252321  3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c3855e15a24fe993d411300c2be843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.258492  3593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a77caa85940c69b005bbe1f44aa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.289381  3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9dffe8f34ed415c854944a1c77c8993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.297854  3649 tablet_bootstrap.cc:654] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.302211  3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1b7dead0a147dea07b2d34e4115450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.305634  3650 tablet_bootstrap.cc:492] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.306427  3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 607eba4852cc42f2bb44d6f949d08ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.319393  3597 tablet_service.cc:1511] Processing CreateTablet for tablet e9dffe8f34ed415c854944a1c77c8993 (DEFAULT_TABLE table=test-workload [id=365ced74afda4a52a3da8e419c6b9374]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:34.321049  3597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9dffe8f34ed415c854944a1c77c8993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:34.354009  3649 tablet_bootstrap.cc:492] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.354892  3649 ts_tablet_manager.cc:1403] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.000s
I20260709 12:14:34.369427  3650 tablet_bootstrap.cc:654] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.378602  3651 tablet_bootstrap.cc:492] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.374238  3649 raft_consensus.cc:359] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.380244  3649 raft_consensus.cc:385] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.380553  3649 raft_consensus.cc:740] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.382217  3649 consensus_queue.cc:260] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.388110  3634 heartbeater.cc:499] Master 127.23.222.190:39105 was elected leader, sending a full tablet report...
I20260709 12:14:34.388741  3649 ts_tablet_manager.cc:1434] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.003s
I20260709 12:14:34.389425  3650 tablet_bootstrap.cc:492] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.389994  3650 ts_tablet_manager.cc:1403] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.007s
I20260709 12:14:34.390134  3649 tablet_bootstrap.cc:492] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.394459  3650 raft_consensus.cc:359] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.395465  3650 raft_consensus.cc:385] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.395867  3650 raft_consensus.cc:740] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.396692  3650 consensus_queue.cc:260] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.398633  3649 tablet_bootstrap.cc:654] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.399179  3485 heartbeater.cc:499] Master 127.23.222.190:39105 was elected leader, sending a full tablet report...
I20260709 12:14:34.404603  3650 ts_tablet_manager.cc:1434] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 12:14:34.405951  3650 tablet_bootstrap.cc:492] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.406054  3649 tablet_bootstrap.cc:492] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.406810  3649 ts_tablet_manager.cc:1403] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:14:34.410423  3649 raft_consensus.cc:359] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.411384  3649 raft_consensus.cc:385] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.411742  3649 raft_consensus.cc:740] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.412781  3649 consensus_queue.cc:260] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.413873  3650 tablet_bootstrap.cc:654] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.414131  3651 tablet_bootstrap.cc:654] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.415627  3649 ts_tablet_manager.cc:1434] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:34.416985  3649 tablet_bootstrap.cc:492] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.427045  3649 tablet_bootstrap.cc:654] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.430892  3650 tablet_bootstrap.cc:492] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.437079  3650 ts_tablet_manager.cc:1403] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
I20260709 12:14:34.440510  3651 tablet_bootstrap.cc:492] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.441265  3651 ts_tablet_manager.cc:1403] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.006s
I20260709 12:14:34.441737  3650 raft_consensus.cc:359] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.444056  3650 raft_consensus.cc:385] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.444365  3650 raft_consensus.cc:740] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.444761  3651 raft_consensus.cc:359] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:34.445751  3651 raft_consensus.cc:385] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.445319  3650 consensus_queue.cc:260] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.446071  3651 raft_consensus.cc:740] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.447136  3651 consensus_queue.cc:260] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:34.448181  3649 tablet_bootstrap.cc:492] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.448861  3649 ts_tablet_manager.cc:1403] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.008s
I20260709 12:14:34.450390  3560 heartbeater.cc:499] Master 127.23.222.190:39105 was elected leader, sending a full tablet report...
I20260709 12:14:34.452417  3649 raft_consensus.cc:359] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:34.453408  3649 raft_consensus.cc:385] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.453752  3649 raft_consensus.cc:740] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.454721  3649 consensus_queue.cc:260] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:34.455513  3650 ts_tablet_manager.cc:1434] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:14:34.457223  3649 ts_tablet_manager.cc:1434] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:14:34.458561  3649 tablet_bootstrap.cc:492] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.459481  3650 tablet_bootstrap.cc:492] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.466456  3649 tablet_bootstrap.cc:654] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.467765  3650 tablet_bootstrap.cc:654] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.473768  3649 tablet_bootstrap.cc:492] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.474566  3649 ts_tablet_manager.cc:1403] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
W20260709 12:14:34.478699  3635 tablet.cc:2406] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:34.478825  3649 raft_consensus.cc:359] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.480211  3649 raft_consensus.cc:385] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.480574  3649 raft_consensus.cc:740] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.481544  3649 consensus_queue.cc:260] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.484731  3649 ts_tablet_manager.cc:1434] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:14:34.485980  3649 tablet_bootstrap.cc:492] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.486459  3650 tablet_bootstrap.cc:492] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.487299  3650 ts_tablet_manager.cc:1403] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.014s
I20260709 12:14:34.488113  3651 ts_tablet_manager.cc:1434] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:14:34.490157  3651 tablet_bootstrap.cc:492] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.491106  3650 raft_consensus.cc:359] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.492017  3650 raft_consensus.cc:385] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.492334  3650 raft_consensus.cc:740] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.493606  3649 tablet_bootstrap.cc:654] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.493847  3650 consensus_queue.cc:260] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.498771  3650 ts_tablet_manager.cc:1434] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:34.500101  3649 tablet_bootstrap.cc:492] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.501091  3649 ts_tablet_manager.cc:1403] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:14:34.500205  3650 tablet_bootstrap.cc:492] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.506101  3651 tablet_bootstrap.cc:654] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.510671  3650 tablet_bootstrap.cc:654] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.523339  3649 raft_consensus.cc:359] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.525363  3649 raft_consensus.cc:385] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.525763  3649 raft_consensus.cc:740] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.527485  3649 consensus_queue.cc:260] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.531790  3651 tablet_bootstrap.cc:492] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.532593  3651 ts_tablet_manager.cc:1403] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.003s
I20260709 12:14:34.535691  3650 tablet_bootstrap.cc:492] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.541601  3650 ts_tablet_manager.cc:1403] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.015s
W20260709 12:14:34.544598  3405 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:34.544981  3651 raft_consensus.cc:359] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.545936  3651 raft_consensus.cc:385] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.545706  3650 raft_consensus.cc:359] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.546507  3651 raft_consensus.cc:740] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.546713  3650 raft_consensus.cc:385] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.546972  3649 ts_tablet_manager.cc:1434] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 12:14:34.547096  3650 raft_consensus.cc:740] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.547578  3651 consensus_queue.cc:260] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.548173  3650 consensus_queue.cc:260] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.550350  3651 ts_tablet_manager.cc:1434] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.017s	user 0.014s	sys 0.004s
I20260709 12:14:34.550693  3650 ts_tablet_manager.cc:1434] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:14:34.548661  3649 tablet_bootstrap.cc:492] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.551455  3651 tablet_bootstrap.cc:492] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.551815  3650 tablet_bootstrap.cc:492] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.559075  3649 tablet_bootstrap.cc:654] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.559949  3650 tablet_bootstrap.cc:654] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.559130  3651 tablet_bootstrap.cc:654] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.564531  3655 raft_consensus.cc:493] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.565214  3655 raft_consensus.cc:515] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.568045  3655 leader_election.cc:290] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.569571  3651 tablet_bootstrap.cc:492] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.570397  3651 ts_tablet_manager.cc:1403] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 12:14:34.571440  3649 tablet_bootstrap.cc:492] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.572222  3649 ts_tablet_manager.cc:1403] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:14:34.574764  3651 raft_consensus.cc:359] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.575726  3651 raft_consensus.cc:385] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.576107  3651 raft_consensus.cc:740] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.576995  3651 consensus_queue.cc:260] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.578778  3650 tablet_bootstrap.cc:492] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.579442  3650 ts_tablet_manager.cc:1403] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 12:14:34.583338  3651 ts_tablet_manager.cc:1434] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:14:34.587917  3651 tablet_bootstrap.cc:492] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.588542  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:34.586007  3650 raft_consensus.cc:359] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.588780  3649 raft_consensus.cc:359] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.589709  3649 raft_consensus.cc:385] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.589406  3650 raft_consensus.cc:385] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.593060  3650 raft_consensus.cc:740] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.590034  3649 raft_consensus.cc:740] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
W20260709 12:14:34.590986  3423 leader_election.cc:343] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.594643  3649 consensus_queue.cc:260] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.597687  3649 ts_tablet_manager.cc:1434] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:14:34.599148  3649 tablet_bootstrap.cc:492] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.600232  3651 tablet_bootstrap.cc:654] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.600541  3650 consensus_queue.cc:260] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.603847  3650 ts_tablet_manager.cc:1434] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:14:34.607029  3650 tablet_bootstrap.cc:492] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.616766  3654 raft_consensus.cc:493] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.617479  3654 raft_consensus.cc:515] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.618629  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:34.619458  3609 raft_consensus.cc:2468] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 0.
I20260709 12:14:34.620945  3650 tablet_bootstrap.cc:654] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.620872  3423 leader_election.cc:304] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:34.622287  3655 raft_consensus.cc:2804] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.622825  3655 raft_consensus.cc:493] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.623392  3655 raft_consensus.cc:3060] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.624558  3654 leader_election.cc:290] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:34.628038  3651 tablet_bootstrap.cc:492] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.628623  3651 ts_tablet_manager.cc:1403] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.016s
I20260709 12:14:34.631559  3651 raft_consensus.cc:359] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.632372  3651 raft_consensus.cc:385] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.632682  3651 raft_consensus.cc:740] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.632843  3650 tablet_bootstrap.cc:492] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.633530  3650 ts_tablet_manager.cc:1403] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 12:14:34.633648  3651 consensus_queue.cc:260] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.633803  3655 raft_consensus.cc:515] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.637238  3650 raft_consensus.cc:359] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.638316  3650 raft_consensus.cc:385] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.638540  3651 ts_tablet_manager.cc:1434] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:14:34.638726  3650 raft_consensus.cc:740] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.639333  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:34.639889  3651 tablet_bootstrap.cc:492] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.639889  3650 consensus_queue.cc:260] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
W20260709 12:14:34.641508  3423 leader_election.cc:343] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.649086  3649 tablet_bootstrap.cc:654] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.650161  3651 tablet_bootstrap.cc:654] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.651213  3660 raft_consensus.cc:493] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.651921  3660 raft_consensus.cc:515] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.653527  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:34.654299  3609 raft_consensus.cc:3060] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.664955  3660 leader_election.cc:290] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.666464  3609 raft_consensus.cc:2468] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 1.
I20260709 12:14:34.667589  3655 leader_election.cc:290] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.670681  3423 leader_election.cc:304] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:34.678759  3655 raft_consensus.cc:2804] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:34.679375  3655 raft_consensus.cc:697] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:34.680315  3655 consensus_queue.cc:237] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.687136  3649 tablet_bootstrap.cc:492] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.687788  3650 ts_tablet_manager.cc:1434] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.054s	user 0.026s	sys 0.024s
I20260709 12:14:34.690752  3650 tablet_bootstrap.cc:492] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.694103  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:34.695297  3535 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:34.698340  3572 leader_election.cc:304] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:34.699971  3654 raft_consensus.cc:2804] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.700615  3654 raft_consensus.cc:493] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.701086  3654 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.703919  3651 tablet_bootstrap.cc:492] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.704722  3651 ts_tablet_manager.cc:1403] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.000s
I20260709 12:14:34.708593  3651 raft_consensus.cc:359] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.709435  3651 raft_consensus.cc:385] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.709928  3651 raft_consensus.cc:740] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.711139  3651 consensus_queue.cc:260] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.715649  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:34.689877  3649 ts_tablet_manager.cc:1403] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.000s
I20260709 12:14:34.720031  3650 tablet_bootstrap.cc:654] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:34.723186  3573 leader_election.cc:343] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.728283  3651 ts_tablet_manager.cc:1434] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 12:14:34.747709  3651 tablet_bootstrap.cc:492] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.747960  3654 raft_consensus.cc:515] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.751437  3682 raft_consensus.cc:493] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.751837  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:34.752125  3682 raft_consensus.cc:515] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.753610  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:34.753873  3609 raft_consensus.cc:2468] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:34.752789  3649 raft_consensus.cc:359] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.754516  3460 raft_consensus.cc:2468] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:34.754699  3649 raft_consensus.cc:385] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.755098  3649 raft_consensus.cc:740] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.755673  3498 leader_election.cc:304] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:34.756574  3651 tablet_bootstrap.cc:654] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.757017  3660 raft_consensus.cc:2804] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.757524  3660 raft_consensus.cc:493] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.757923  3660 raft_consensus.cc:3060] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.758970  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:34.760118  3460 raft_consensus.cc:2468] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:34.761010  3650 tablet_bootstrap.cc:492] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.761710  3573 leader_election.cc:304] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:34.761935  3650 ts_tablet_manager.cc:1403] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.008s
I20260709 12:14:34.756167  3649 consensus_queue.cc:260] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.768755  3655 raft_consensus.cc:493] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.769680  3655 raft_consensus.cc:515] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.772169  3655 leader_election.cc:290] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.772747  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:34.766834  3650 raft_consensus.cc:359] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.773694  3535 raft_consensus.cc:2468] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:34.774012  3650 raft_consensus.cc:385] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.774441  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:34.775254  3609 raft_consensus.cc:2468] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 0.
I20260709 12:14:34.776396  3682 leader_election.cc:290] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:34.777487  3423 leader_election.cc:304] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:34.777508  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:34.778712  3655 raft_consensus.cc:2804] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.779120  3655 raft_consensus.cc:493] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.777864  3356 catalog_manager.cc:5697] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.779480  3655 raft_consensus.cc:3060] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:34.779420  3423 leader_election.cc:343] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.783205  3660 raft_consensus.cc:515] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.787225  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:34.787918  3609 raft_consensus.cc:3060] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.774531  3650 raft_consensus.cc:740] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.795274  3682 raft_consensus.cc:2804] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.806682  3682 raft_consensus.cc:493] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.807126  3682 raft_consensus.cc:3060] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.807158  3687 raft_consensus.cc:493] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.794657  3660 leader_election.cc:290] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.807962  3687 raft_consensus.cc:515] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:34.816140  3609 raft_consensus.cc:2468] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:34.817365  3687 leader_election.cc:290] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617), 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501)
I20260709 12:14:34.819450  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:34.819835  3654 leader_election.cc:290] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:34.820179  3460 raft_consensus.cc:3060] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.798893  3655 raft_consensus.cc:515] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.810721  3650 consensus_queue.cc:260] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.808725  3651 tablet_bootstrap.cc:492] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.822901  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:34.824600  3535 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.826011  3675 raft_consensus.cc:493] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.826566  3675 raft_consensus.cc:515] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.829442  3675 leader_election.cc:290] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.831018  3459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:34.831368  3651 ts_tablet_manager.cc:1403] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.029s
I20260709 12:14:34.831887  3682 raft_consensus.cc:515] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
W20260709 12:14:34.833228  3499 leader_election.cc:343] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.831010  3649 ts_tablet_manager.cc:1434] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.018s
I20260709 12:14:34.833652  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c3855e15a24fe993d411300c2be843" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:34.834389  3682 leader_election.cc:290] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:34.819525  3498 leader_election.cc:304] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
W20260709 12:14:34.835153  3423 leader_election.cc:343] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.835978  3649 tablet_bootstrap.cc:492] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.836306  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c3855e15a24fe993d411300c2be843" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:34.835438  3687 raft_consensus.cc:2804] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:34.837909  3650 ts_tablet_manager.cc:1434] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.001s
I20260709 12:14:34.822433  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
W20260709 12:14:34.840247  3423 leader_election.cc:343] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:34.841899  3573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.129:44501, user_credentials={real_user=slave}} blocked reactor thread for 80285.7us
I20260709 12:14:34.843067  3650 tablet_bootstrap.cc:492] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.838421  3687 raft_consensus.cc:697] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:34.843489  3651 raft_consensus.cc:359] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.843966  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:34.844424  3651 raft_consensus.cc:385] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.845074  3534 raft_consensus.cc:3060] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.843966  3459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:34.846925  3459 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.849869  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:34.850586  3655 leader_election.cc:290] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:34.850713  3458 raft_consensus.cc:3060] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.841943  3423 leader_election.cc:304] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:34.856138  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:34.844959  3651 raft_consensus.cc:740] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.857950  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:34.858417  3649 tablet_bootstrap.cc:654] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.856775  3459 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:34.859874  3655 raft_consensus.cc:2749] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:34.863765  3535 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:34.864348  3650 tablet_bootstrap.cc:654] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.856844  3608 raft_consensus.cc:3060] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.868860  3572 leader_election.cc:304] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:34.844977  3687 consensus_queue.cc:237] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.870056  3686 raft_consensus.cc:2804] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:34.870685  3686 raft_consensus.cc:697] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:34.871745  3686 consensus_queue.cc:237] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.872290  3685 raft_consensus.cc:493] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.841940  3609 raft_consensus.cc:2468] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:34.858121  3651 consensus_queue.cc:260] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.872928  3685 raft_consensus.cc:515] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.876221  3651 ts_tablet_manager.cc:1434] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
W20260709 12:14:34.873368  3423 leader_election.cc:343] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.877188  3685 leader_election.cc:290] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:34.878683  3498 leader_election.cc:304] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:34.862375  3534 raft_consensus.cc:2468] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:34.877621  3651 tablet_bootstrap.cc:492] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:34.880605  3660 raft_consensus.cc:2804] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.881012  3660 raft_consensus.cc:493] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.881368  3660 raft_consensus.cc:3060] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.882131  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:34.886693  3572 leader_election.cc:304] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:34.887008  3459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:34.887874  3459 raft_consensus.cc:2468] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
W20260709 12:14:34.887979  3572 leader_election.cc:343] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.889077  3573 leader_election.cc:304] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:34.889320  3651 tablet_bootstrap.cc:654] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:34.893033  3458 raft_consensus.cc:2468] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:34.895781  3682 raft_consensus.cc:2804] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:34.899143  3682 raft_consensus.cc:493] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.899600  3682 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.895383  3685 raft_consensus.cc:2804] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:34.903484  3685 raft_consensus.cc:697] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:34.904124  3460 raft_consensus.cc:2468] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:34.910060  3608 raft_consensus.cc:2468] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 1.
I20260709 12:14:34.912248  3423 leader_election.cc:304] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:34.913986  3655 raft_consensus.cc:2804] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:34.913584  3685 consensus_queue.cc:237] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.914592  3655 raft_consensus.cc:697] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:34.915526  3655 consensus_queue.cc:237] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.927724  3358 catalog_manager.cc:5697] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:34.929051  3649 tablet_bootstrap.cc:492] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:34.929481  3650 tablet_bootstrap.cc:492] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:34.929736  3649 ts_tablet_manager.cc:1403] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.015s
I20260709 12:14:34.930055  3650 ts_tablet_manager.cc:1403] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.007s
I20260709 12:14:34.928905  3682 raft_consensus.cc:515] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.934096  3682 leader_election.cc:290] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:34.935798  3649 raft_consensus.cc:359] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.937496  3649 raft_consensus.cc:385] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.937294  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:34.938171  3649 raft_consensus.cc:740] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.938498  3460 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.939306  3649 consensus_queue.cc:260] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.923936  3660 raft_consensus.cc:515] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:34.950735  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:34.955987  3649 ts_tablet_manager.cc:1434] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 12:14:34.960811  3649 tablet_bootstrap.cc:492] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:34.960404  3650 raft_consensus.cc:359] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.966832  3650 raft_consensus.cc:385] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.967131  3650 raft_consensus.cc:740] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.965118  3660 leader_election.cc:290] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617), 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501)
W20260709 12:14:34.965420  3572 leader_election.cc:343] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.968725  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:34.964324  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:34.970314  3608 raft_consensus.cc:3060] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:34.972764  3650 consensus_queue.cc:260] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
W20260709 12:14:34.975098  3499 leader_election.cc:343] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:34.978871  3650 ts_tablet_manager.cc:1434] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:14:34.980284  3650 tablet_bootstrap.cc:492] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:34.980924  3356 catalog_manager.cc:5697] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:34.964951  3460 raft_consensus.cc:2468] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:34.984107  3573 leader_election.cc:304] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:34.985373  3685 raft_consensus.cc:2804] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:34.986035  3685 raft_consensus.cc:697] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:34.987090  3651 tablet_bootstrap.cc:492] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:34.987870  3651 ts_tablet_manager.cc:1403] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.111s	user 0.007s	sys 0.018s
I20260709 12:14:34.987208  3685 consensus_queue.cc:237] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.991482  3651 raft_consensus.cc:359] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.992509  3651 raft_consensus.cc:385] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:34.993040  3651 raft_consensus.cc:740] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:34.993887  3651 consensus_queue.cc:260] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:34.996528  3651 ts_tablet_manager.cc:1434] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:14:34.998329  3651 tablet_bootstrap.cc:492] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:35.004803  3608 raft_consensus.cc:2468] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:35.006861  3651 tablet_bootstrap.cc:654] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.007306  3498 leader_election.cc:304] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.008713  3660 raft_consensus.cc:2804] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:35.009227  3660 raft_consensus.cc:697] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.010368  3660 consensus_queue.cc:237] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.013955  3650 tablet_bootstrap.cc:654] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.014778  3357 catalog_manager.cc:5697] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.020104  3651 tablet_bootstrap.cc:492] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:35.020653  3651 ts_tablet_manager.cc:1403] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 12:14:35.021596  3660 raft_consensus.cc:493] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.022183  3660 raft_consensus.cc:515] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.023576  3651 raft_consensus.cc:359] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.024313  3651 raft_consensus.cc:385] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.024492  3660 leader_election.cc:290] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.024621  3650 tablet_bootstrap.cc:492] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:35.024585  3651 raft_consensus.cc:740] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.025575  3650 ts_tablet_manager.cc:1403] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 12:14:35.025725  3651 consensus_queue.cc:260] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.026567  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:35.027284  3460 raft_consensus.cc:2468] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:35.028003  3651 ts_tablet_manager.cc:1434] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:35.028586  3499 leader_election.cc:304] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.029024  3651 tablet_bootstrap.cc:492] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:35.028968  3650 raft_consensus.cc:359] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.029852  3687 raft_consensus.cc:2804] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:35.030045  3650 raft_consensus.cc:385] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.030586  3650 raft_consensus.cc:740] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.032006  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:35.031664  3650 consensus_queue.cc:260] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.030376  3687 raft_consensus.cc:493] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.034407  3650 ts_tablet_manager.cc:1434] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:35.034588  3687 raft_consensus.cc:3060] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.037186  3651 tablet_bootstrap.cc:654] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:35.034116  3498 leader_election.cc:343] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:35.045648  3687 raft_consensus.cc:515] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.047427  3651 tablet_bootstrap.cc:492] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:35.048305  3651 ts_tablet_manager.cc:1403] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:14:35.044466  3356 catalog_manager.cc:5697] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.049120  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:35.049861  3460 raft_consensus.cc:3060] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.053187  3651 raft_consensus.cc:359] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.054358  3651 raft_consensus.cc:385] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.054728  3651 raft_consensus.cc:740] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.056000  3651 consensus_queue.cc:260] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.060001  3651 ts_tablet_manager.cc:1434] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
I20260709 12:14:35.048622  3649 tablet_bootstrap.cc:654] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.064317  3460 raft_consensus.cc:2468] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:35.067471  3499 leader_election.cc:304] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.068874  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.070207  3660 raft_consensus.cc:2804] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:35.071107  3649 tablet_bootstrap.cc:492] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
W20260709 12:14:35.072124  3498 leader_election.cc:343] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:35.071708  3649 ts_tablet_manager.cc:1403] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.001s
I20260709 12:14:35.078905  3660 raft_consensus.cc:697] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.079080  3649 raft_consensus.cc:359] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.079926  3649 raft_consensus.cc:385] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.080245  3649 raft_consensus.cc:740] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.080310  3660 consensus_queue.cc:237] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.081037  3649 consensus_queue.cc:260] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.078120  3687 leader_election.cc:290] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.083386  3649 ts_tablet_manager.cc:1434] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:35.078015  3355 catalog_manager.cc:5697] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.086783  3355 catalog_manager.cc:5697] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.093626  3660 raft_consensus.cc:493] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.094341  3660 raft_consensus.cc:515] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.096524  3660 leader_election.cc:290] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.098320  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:35.098941  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:35.099802  3608 raft_consensus.cc:2393] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e40ab447e46441593eca3776e0cf0b7 in current term 1: Already voted for candidate 575eb2eea84a4baa9c8c313e035a5b82 in this term.
I20260709 12:14:35.101115  3498 leader_election.cc:304] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7; no voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.102165  3660 raft_consensus.cc:3060] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.110481  3685 raft_consensus.cc:493] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.110837  3660 raft_consensus.cc:2749] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:35.111224  3685 raft_consensus.cc:515] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.110884  3355 catalog_manager.cc:5697] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.113993  3685 leader_election.cc:290] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:35.115211  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:35.116168  3460 raft_consensus.cc:2393] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48dadfe9d82c4b13b51c3459a4162531 in current term 1: Already voted for candidate 4e40ab447e46441593eca3776e0cf0b7 in this term.
I20260709 12:14:35.115897  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:35.117995  3573 leader_election.cc:304] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531; no voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.119081  3685 raft_consensus.cc:3060] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.127740  3685 raft_consensus.cc:2749] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:35.131346  3660 raft_consensus.cc:493] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.132012  3660 raft_consensus.cc:515] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.133989  3660 leader_election.cc:290] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.135165  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c3855e15a24fe993d411300c2be843" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:35.135195  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c3855e15a24fe993d411300c2be843" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:35.135908  3608 raft_consensus.cc:2468] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:35.136337  3460 raft_consensus.cc:2468] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:35.137529  3499 leader_election.cc:304] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.138441  3660 raft_consensus.cc:2804] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:35.138886  3660 raft_consensus.cc:493] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.139386  3660 raft_consensus.cc:3060] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.145277  3660 raft_consensus.cc:515] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.148541  3660 leader_election.cc:290] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.149456  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c3855e15a24fe993d411300c2be843" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:35.150206  3460 raft_consensus.cc:3060] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.151238  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c3855e15a24fe993d411300c2be843" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.151983  3608 raft_consensus.cc:3060] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.159989  3460 raft_consensus.cc:2468] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:35.160063  3608 raft_consensus.cc:2468] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:35.162236  3498 leader_election.cc:304] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:35.163162  3660 raft_consensus.cc:2804] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:35.163743  3660 raft_consensus.cc:697] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.164750  3660 consensus_queue.cc:237] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.174340  3355 catalog_manager.cc:5697] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.184866  3655 consensus_queue.cc:1048] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.200178  3655 consensus_queue.cc:1048] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.247241  3655 raft_consensus.cc:493] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.247972  3655 raft_consensus.cc:515] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.250567  3655 leader_election.cc:290] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:35.251370  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:35.251642  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:35.252265  3608 raft_consensus.cc:2393] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 575eb2eea84a4baa9c8c313e035a5b82 in current term 1: Already voted for candidate 4e40ab447e46441593eca3776e0cf0b7 in this term.
I20260709 12:14:35.253473  3423 leader_election.cc:304] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:35.254284  3655 raft_consensus.cc:3060] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.261413  3655 raft_consensus.cc:2749] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:35.284353  3660 consensus_queue.cc:1048] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.292049  3660 consensus_queue.cc:1048] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.296321  3535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:55404
I20260709 12:14:35.297135  3535 raft_consensus.cc:606] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.322206  3608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:35.322937  3608 raft_consensus.cc:606] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.329887  3535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:55404
I20260709 12:14:35.330637  3535 raft_consensus.cc:606] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.332180  3687 raft_consensus.cc:493] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.332680  3687 raft_consensus.cc:515] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.335028  3687 leader_election.cc:290] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.336024  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:35.336406  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:35.337868  3608 raft_consensus.cc:2393] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e40ab447e46441593eca3776e0cf0b7 in current term 1: Already voted for candidate 575eb2eea84a4baa9c8c313e035a5b82 in this term.
I20260709 12:14:35.338956  3609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:35.339285  3498 leader_election.cc:304] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7; no voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.339673  3609 raft_consensus.cc:606] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.340173  3687 raft_consensus.cc:3060] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.347796  3687 raft_consensus.cc:2749] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:35.356186  3460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
mode: GRACEFUL
new_leader_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:14:35.356948  3460 raft_consensus.cc:606] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Received request to transfer leadership to TS 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:35.363301  3609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99b40b347c3420398a720ffae71441d"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:35.363922  3609 raft_consensus.cc:606] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:35.370069  3460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
mode: GRACEFUL
new_leader_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:14:35.370811  3460 raft_consensus.cc:606] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Received request to transfer leadership to TS 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:35.374130  3685 consensus_queue.cc:1048] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.376582  3655 consensus_queue.cc:1048] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.381824  3534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
mode: GRACEFUL
new_leader_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:55404
I20260709 12:14:35.382682  3534 raft_consensus.cc:606] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Received request to transfer leadership to TS 48dadfe9d82c4b13b51c3459a4162531
I20260709 12:14:35.384385  3686 raft_consensus.cc:993] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.385181  3682 raft_consensus.cc:1081] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.387106  3458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36634
I20260709 12:14:35.387761  3458 raft_consensus.cc:493] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.388300  3458 raft_consensus.cc:3060] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.390903  3675 raft_consensus.cc:993] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: : Instructing follower 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:35.391960  3655 raft_consensus.cc:1081] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Signalling peer 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:35.392982  3685 consensus_queue.cc:1048] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.395821  3535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:55392
I20260709 12:14:35.401650  3660 raft_consensus.cc:493] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.403039  3660 raft_consensus.cc:515] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.405536  3660 leader_election.cc:290] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.406414  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:35.407380  3460 raft_consensus.cc:2393] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4e40ab447e46441593eca3776e0cf0b7 in current term 1: Already voted for candidate 48dadfe9d82c4b13b51c3459a4162531 in this term.
I20260709 12:14:35.409495  3660 consensus_queue.cc:1048] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.409818  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:35.400986  3535 raft_consensus.cc:493] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.412182  3535 raft_consensus.cc:3060] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.413661  3498 leader_election.cc:304] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7; no voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:35.414541  3533 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.401678  3458 raft_consensus.cc:515] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.420707  3682 consensus_queue.cc:1048] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.430945  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:35.431736  3533 raft_consensus.cc:3060] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.427510  3682 consensus_queue.cc:1048] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.432830  3655 consensus_queue.cc:1048] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.422008  3458 leader_election.cc:290] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.432215  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b7dead0a147dea07b2d34e4115450" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.434473  3608 raft_consensus.cc:3055] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.434834  3608 raft_consensus.cc:740] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:35.435817  3608 consensus_queue.cc:260] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.437100  3608 raft_consensus.cc:3060] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.432402  3660 raft_consensus.cc:2749] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:35.442082  3533 raft_consensus.cc:2468] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.443667  3423 leader_election.cc:304] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.444948  3655 raft_consensus.cc:2804] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.445931  3655 raft_consensus.cc:697] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:35.447167  3655 consensus_queue.cc:237] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.450278  3535 raft_consensus.cc:515] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.459806  3608 raft_consensus.cc:2468] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.460418  3654 raft_consensus.cc:993] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:35.460927  3682 raft_consensus.cc:1081] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:35.464820  3535 leader_election.cc:290] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.467201  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.467563  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2a77caa85940c69b005bbe1f44aa24" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:35.468072  3609 raft_consensus.cc:3060] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.468230  3460 raft_consensus.cc:3055] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.468703  3460 raft_consensus.cc:740] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:35.469583  3460 consensus_queue.cc:260] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.472862  3460 raft_consensus.cc:3060] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.473304  3687 consensus_queue.cc:1048] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.476982  3686 raft_consensus.cc:993] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.477625  3686 raft_consensus.cc:1081] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.480032  3654 consensus_queue.cc:1048] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.486819  3609 raft_consensus.cc:2468] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:35.488317  3498 leader_election.cc:304] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:35.489900  3660 raft_consensus.cc:2804] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.490454  3660 raft_consensus.cc:697] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.491241  3455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36634
I20260709 12:14:35.492010  3455 raft_consensus.cc:493] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.492403  3455 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.492198  3660 consensus_queue.cc:237] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.497552  3682 consensus_queue.cc:1048] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.502769  3534 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99b40b347c3420398a720ffae71441d"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:55396
I20260709 12:14:35.503489  3534 raft_consensus.cc:493] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.503877  3534 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.520874  3704 consensus_queue.cc:1048] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.531049  3460 raft_consensus.cc:2468] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:35.539317  3660 consensus_queue.cc:1048] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:35.548803  3534 raft_consensus.cc:515] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.552500  3608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.553215  3608 raft_consensus.cc:3055] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.553591  3608 raft_consensus.cc:740] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:35.554524  3608 consensus_queue.cc:260] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.555567  3608 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.557493  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:35.558362  3460 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.561177  3455 raft_consensus.cc:515] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.565948  3687 consensus_queue.cc:1048] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.568574  3460 raft_consensus.cc:2468] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:35.570243  3499 leader_election.cc:304] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.572983  3687 raft_consensus.cc:2804] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.573942  3687 raft_consensus.cc:697] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.575301  3704 raft_consensus.cc:993] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: : Instructing follower 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:35.575961  3704 raft_consensus.cc:1081] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Signalling peer 48dadfe9d82c4b13b51c3459a4162531 to start an election
W20260709 12:14:35.575402  3686 consensus_queue.cc:1175] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "575eb2eea84a4baa9c8c313e035a5b82" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:14:35.575342  3687 consensus_queue.cc:237] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.578161  3609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:49040
I20260709 12:14:35.578905  3609 raft_consensus.cc:493] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.579380  3609 raft_consensus.cc:3060] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.581872  3660 raft_consensus.cc:993] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.582460  3660 raft_consensus.cc:1081] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.584872  3456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36648
I20260709 12:14:35.585355  3456 raft_consensus.cc:493] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.585620  3456 raft_consensus.cc:3060] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.587152  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:35.587890  3533 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.587702  3358 catalog_manager.cc:5697] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.588292  3609 raft_consensus.cc:515] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.591871  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:35.597774  3460 raft_consensus.cc:3060] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.598305  3608 raft_consensus.cc:2468] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:35.592402  3455 leader_election.cc:290] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.593952  3606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.599154  3606 raft_consensus.cc:3055] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.599481  3606 raft_consensus.cc:740] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:35.600399  3606 consensus_queue.cc:260] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.596133  3456 raft_consensus.cc:515] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.601861  3606 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.602211  3534 leader_election.cc:290] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.605098  3356 catalog_manager.cc:5697] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 1 to 2, leader changed from 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129) to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.609985  3606 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.611574  3423 leader_election.cc:304] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.612533  3655 raft_consensus.cc:2804] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.613031  3655 raft_consensus.cc:697] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:35.613550  3533 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.613967  3655 consensus_queue.cc:237] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.614962  3687 consensus_queue.cc:1048] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:35.624259  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9dffe8f34ed415c854944a1c77c8993" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:35.625018  3533 raft_consensus.cc:3055] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.625365  3533 raft_consensus.cc:740] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.626120  3609 leader_election.cc:290] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:35.627178  3460 raft_consensus.cc:2468] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 2.
I20260709 12:14:35.628433  3533 consensus_queue.cc:260] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.628778  3573 leader_election.cc:304] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.630051  3533 raft_consensus.cc:3060] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.630529  3686 raft_consensus.cc:2804] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.631331  3686 raft_consensus.cc:697] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:35.632512  3686 consensus_queue.cc:237] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.643317  3456 leader_election.cc:290] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:35.644927  3355 catalog_manager.cc:5697] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 1 to 2, leader changed from 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130) to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.646404  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.647071  3609 raft_consensus.cc:3060] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.649227  3356 catalog_manager.cc:5697] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.654570  3533 raft_consensus.cc:2468] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 2.
I20260709 12:14:35.654722  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b376a0f3a02a45c4a3eab6cca6ff4a3b" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:35.655480  3534 raft_consensus.cc:3055] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.655824  3534 raft_consensus.cc:740] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.656695  3534 consensus_queue.cc:260] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.658166  3534 raft_consensus.cc:3060] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.660174  3609 raft_consensus.cc:2468] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.661535  3423 leader_election.cc:304] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.662469  3655 raft_consensus.cc:2804] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.662949  3655 raft_consensus.cc:697] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:35.662695  3358 catalog_manager.cc:5697] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.663936  3655 consensus_queue.cc:237] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } }
I20260709 12:14:35.671401  3534 raft_consensus.cc:2468] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.680279  3358 catalog_manager.cc:5697] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:35.776655  3704 raft_consensus.cc:993] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.777164  3687 raft_consensus.cc:1081] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:35.778734  3458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36648
I20260709 12:14:35.779320  3458 raft_consensus.cc:493] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.779652  3458 raft_consensus.cc:3060] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.785450  3458 raft_consensus.cc:515] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.787274  3458 leader_election.cc:290] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.788417  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:35.788671  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f188849ee344b3aa4ca0b680fedbda" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.789287  3609 raft_consensus.cc:3060] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.789256  3534 raft_consensus.cc:3055] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.789999  3534 raft_consensus.cc:740] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.791167  3534 consensus_queue.cc:260] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.792932  3534 raft_consensus.cc:3060] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.794998  3675 raft_consensus.cc:993] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: : Instructing follower 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:35.795565  3655 raft_consensus.cc:1081] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Signalling peer 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:35.797142  3533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:55392
I20260709 12:14:35.797745  3533 raft_consensus.cc:493] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:35.798084  3533 raft_consensus.cc:3060] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.799583  3609 raft_consensus.cc:2468] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.801172  3423 leader_election.cc:304] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:35.801782  3534 raft_consensus.cc:2468] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:35.802199  3655 raft_consensus.cc:2804] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.802903  3655 raft_consensus.cc:697] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:35.803790  3655 consensus_queue.cc:237] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.805800  3533 raft_consensus.cc:515] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.808162  3533 leader_election.cc:290] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:35.809218  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:35.810016  3458 raft_consensus.cc:3055] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:35.810400  3458 raft_consensus.cc:740] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:35.810352  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "607eba4852cc42f2bb44d6f949d08ee6" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:35.811268  3609 raft_consensus.cc:3060] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.812381  3458 consensus_queue.cc:260] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.812476  3358 catalog_manager.cc:5697] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.813954  3458 raft_consensus.cc:3060] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:35.820072  3609 raft_consensus.cc:2468] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:35.821429  3498 leader_election.cc:304] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:35.822414  3687 raft_consensus.cc:2804] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:35.822868  3687 raft_consensus.cc:697] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:35.822899  3458 raft_consensus.cc:2468] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:35.823849  3687 consensus_queue.cc:237] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:35.831125  3358 catalog_manager.cc:5697] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 1 to 2, leader changed from 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129) to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:35.877591  3609 raft_consensus.cc:1275] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.879494  3675 consensus_queue.cc:1048] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.881107  3533 raft_consensus.cc:1275] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.882633  3675 consensus_queue.cc:1048] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.897341  3609 raft_consensus.cc:1275] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.898890  3687 consensus_queue.cc:1048] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.915699  3458 raft_consensus.cc:1275] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.917255  3687 consensus_queue.cc:1048] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.965754  3609 raft_consensus.cc:1275] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.967386  3687 consensus_queue.cc:1048] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:35.976475  3458 raft_consensus.cc:1275] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:35.978659  3687 consensus_queue.cc:1048] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.082561  3609 raft_consensus.cc:1275] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.084086  3734 consensus_queue.cc:1048] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.092711  3533 raft_consensus.cc:1275] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.095549  3458 raft_consensus.cc:1275] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.095805  3735 consensus_queue.cc:1048] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:36.097326  3685 consensus_queue.cc:1048] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:36.111644  3533 raft_consensus.cc:1275] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.113649  3685 consensus_queue.cc:1048] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.207362  3609 raft_consensus.cc:1275] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.209578  3734 consensus_queue.cc:1048] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.218699  3533 raft_consensus.cc:1275] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.220752  3735 consensus_queue.cc:1048] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.234797  3533 raft_consensus.cc:1275] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.236346  3735 consensus_queue.cc:1048] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.246070  3609 raft_consensus.cc:1275] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.248172  3675 consensus_queue.cc:1048] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:36.262300  3609 raft_consensus.cc:1275] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.263952  3687 consensus_queue.cc:1048] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:36.274381  3456 raft_consensus.cc:1275] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:36.276098  3704 consensus_queue.cc:1048] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:38.426811  3355 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49960:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:38.431134  3355 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:38.496973  3450 tablet_service.cc:1511] Processing CreateTablet for tablet 2e67404cef74429db91a817369b03ee8 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:38.497560  3520 tablet_service.cc:1511] Processing CreateTablet for tablet 2e67404cef74429db91a817369b03ee8 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:38.499155  3450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e67404cef74429db91a817369b03ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.499926  3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e67404cef74429db91a817369b03ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.502158  3597 tablet_service.cc:1511] Processing CreateTablet for tablet 2e67404cef74429db91a817369b03ee8 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:38.505424  3442 tablet_service.cc:1511] Processing CreateTablet for tablet 3b97c43244a447229566d16d6cf59b76 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:38.507179  3442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b97c43244a447229566d16d6cf59b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.508880  3592 tablet_service.cc:1511] Processing CreateTablet for tablet 3b97c43244a447229566d16d6cf59b76 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:38.511605  3519 tablet_service.cc:1511] Processing CreateTablet for tablet 3b97c43244a447229566d16d6cf59b76 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:38.513172  3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b97c43244a447229566d16d6cf59b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.516997  3449 tablet_service.cc:1511] Processing CreateTablet for tablet 9ded39d6e42647d7a8fa5dd7af444ad4 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:38.518559  3449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ded39d6e42647d7a8fa5dd7af444ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.524988  3518 tablet_service.cc:1511] Processing CreateTablet for tablet 9ded39d6e42647d7a8fa5dd7af444ad4 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:38.526758  3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ded39d6e42647d7a8fa5dd7af444ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.528316  3593 tablet_service.cc:1511] Processing CreateTablet for tablet 9ded39d6e42647d7a8fa5dd7af444ad4 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:38.529150  3597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e67404cef74429db91a817369b03ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.534106  3592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b97c43244a447229566d16d6cf59b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.539040  3593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ded39d6e42647d7a8fa5dd7af444ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.558758  3752 tablet_bootstrap.cc:492] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:38.566073  3448 tablet_service.cc:1511] Processing CreateTablet for tablet f993765c0fa14c729958199d2a7b9e16 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:38.568336  3448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f993765c0fa14c729958199d2a7b9e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.574193  3520 tablet_service.cc:1511] Processing CreateTablet for tablet f993765c0fa14c729958199d2a7b9e16 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:38.576161  3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f993765c0fa14c729958199d2a7b9e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.575939  3596 tablet_service.cc:1511] Processing CreateTablet for tablet f993765c0fa14c729958199d2a7b9e16 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:38.577466  3596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f993765c0fa14c729958199d2a7b9e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.597937  3447 tablet_service.cc:1511] Processing CreateTablet for tablet 1a76b7cdd0574dd2b1a07bd1dfadd1d5 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:38.599925  3447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a76b7cdd0574dd2b1a07bd1dfadd1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.605928  3518 tablet_service.cc:1511] Processing CreateTablet for tablet 1a76b7cdd0574dd2b1a07bd1dfadd1d5 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:38.608397  3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a76b7cdd0574dd2b1a07bd1dfadd1d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.614384  3753 tablet_bootstrap.cc:492] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:38.615340  3595 tablet_service.cc:1511] Processing CreateTablet for tablet 1a76b7cdd0574dd2b1a07bd1dfadd1d5 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:38.617470  3595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a76b7cdd0574dd2b1a07bd1dfadd1d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:38.627691  3405 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:38.632905  3521 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb52a6c301c4ea499c94ee9ef5250dd (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:38.633038  3448 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb52a6c301c4ea499c94ee9ef5250dd (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:38.636018  3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb52a6c301c4ea499c94ee9ef5250dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.636961  3448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb52a6c301c4ea499c94ee9ef5250dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.640995  3753 tablet_bootstrap.cc:654] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.644281  3752 tablet_bootstrap.cc:654] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.641819  3594 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb52a6c301c4ea499c94ee9ef5250dd (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:38.644112  3444 tablet_service.cc:1511] Processing CreateTablet for tablet c9dcbe55854f403d91840add96b09644 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:38.646209  3444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9dcbe55854f403d91840add96b09644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.646239  3594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb52a6c301c4ea499c94ee9ef5250dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.660804  3522 tablet_service.cc:1511] Processing CreateTablet for tablet c9dcbe55854f403d91840add96b09644 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:38.664676  3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9dcbe55854f403d91840add96b09644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.678691  3599 tablet_service.cc:1511] Processing CreateTablet for tablet c9dcbe55854f403d91840add96b09644 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:38.681123  3599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9dcbe55854f403d91840add96b09644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.723114  3449 tablet_service.cc:1511] Processing CreateTablet for tablet 0112156b7a8745cba9f6703c5a971557 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:38.725862  3449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0112156b7a8745cba9f6703c5a971557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.731403  3519 tablet_service.cc:1511] Processing CreateTablet for tablet 0112156b7a8745cba9f6703c5a971557 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:38.733080  3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0112156b7a8745cba9f6703c5a971557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.738081  3753 tablet_bootstrap.cc:492] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:38.746248  3753 ts_tablet_manager.cc:1403] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.132s	user 0.030s	sys 0.029s
I20260709 12:14:38.746747  3752 tablet_bootstrap.cc:492] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:38.747474  3752 ts_tablet_manager.cc:1403] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.189s	user 0.028s	sys 0.009s
I20260709 12:14:38.747944  3592 tablet_service.cc:1511] Processing CreateTablet for tablet 0112156b7a8745cba9f6703c5a971557 (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:38.749616  3592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0112156b7a8745cba9f6703c5a971557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.751406  3752 raft_consensus.cc:359] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.754949  3756 tablet_bootstrap.cc:492] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:38.755065  3752 raft_consensus.cc:385] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.758692  3752 raft_consensus.cc:740] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.760097  3752 consensus_queue.cc:260] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.764003  3444 tablet_service.cc:1511] Processing CreateTablet for tablet 4493902ecfcb4156a321e2fef08ae8ff (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:38.765568  3444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4493902ecfcb4156a321e2fef08ae8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.766601  3752 ts_tablet_manager.cc:1434] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 12:14:38.767892  3752 tablet_bootstrap.cc:492] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:38.778002  3754 raft_consensus.cc:493] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.778784  3754 raft_consensus.cc:515] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.779335  3752 tablet_bootstrap.cc:654] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.781361  3754 leader_election.cc:290] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:38.782454  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:38.783355  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
W20260709 12:14:38.785053  3499 leader_election.cc:343] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:38.786217  3498 leader_election.cc:343] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:38.786783  3498 leader_election.cc:304] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7; no voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:38.788095  3754 raft_consensus.cc:2749] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:38.790431  3756 tablet_bootstrap.cc:654] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.790501  3517 tablet_service.cc:1511] Processing CreateTablet for tablet 4493902ecfcb4156a321e2fef08ae8ff (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:38.792994  3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4493902ecfcb4156a321e2fef08ae8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.794824  3596 tablet_service.cc:1511] Processing CreateTablet for tablet 4493902ecfcb4156a321e2fef08ae8ff (DEFAULT_TABLE table=soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:38.796681  3596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4493902ecfcb4156a321e2fef08ae8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.802642  3753 raft_consensus.cc:359] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.803571  3753 raft_consensus.cc:385] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.803854  3753 raft_consensus.cc:740] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.804814  3753 consensus_queue.cc:260] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.838271  3753 ts_tablet_manager.cc:1434] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.003s
I20260709 12:14:38.839481  3752 tablet_bootstrap.cc:492] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:38.839704  3753 tablet_bootstrap.cc:492] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:38.840221  3752 ts_tablet_manager.cc:1403] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.001s
I20260709 12:14:38.843918  3752 raft_consensus.cc:359] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.844800  3752 raft_consensus.cc:385] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.845121  3752 raft_consensus.cc:740] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.845999  3752 consensus_queue.cc:260] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.847647  3756 tablet_bootstrap.cc:492] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:38.848331  3756 ts_tablet_manager.cc:1403] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.103s	user 0.006s	sys 0.010s
I20260709 12:14:38.851351  3752 ts_tablet_manager.cc:1434] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:38.852679  3752 tablet_bootstrap.cc:492] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:38.852381  3756 raft_consensus.cc:359] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.853255  3756 raft_consensus.cc:385] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.853596  3756 raft_consensus.cc:740] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.854526  3756 consensus_queue.cc:260] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.863263  3753 tablet_bootstrap.cc:654] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.868067  3756 ts_tablet_manager.cc:1434] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:14:38.868863  3752 tablet_bootstrap.cc:654] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.869464  3756 tablet_bootstrap.cc:492] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:38.876012  3753 tablet_bootstrap.cc:492] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:38.876871  3753 ts_tablet_manager.cc:1403] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 12:14:38.878409  3756 tablet_bootstrap.cc:654] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.881798  3752 tablet_bootstrap.cc:492] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:38.882603  3752 ts_tablet_manager.cc:1403] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 12:14:38.885695  3753 raft_consensus.cc:359] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.888363  3753 raft_consensus.cc:385] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.888751  3753 raft_consensus.cc:740] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.890025  3753 consensus_queue.cc:260] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.892668  3753 ts_tablet_manager.cc:1434] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.009s
I20260709 12:14:38.892503  3752 raft_consensus.cc:359] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.893469  3752 raft_consensus.cc:385] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.893812  3752 raft_consensus.cc:740] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.894299  3756 tablet_bootstrap.cc:492] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:38.894539  3753 tablet_bootstrap.cc:492] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:38.894950  3756 ts_tablet_manager.cc:1403] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:14:38.894728  3752 consensus_queue.cc:260] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.898916  3756 raft_consensus.cc:359] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.899722  3756 raft_consensus.cc:385] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.900022  3756 raft_consensus.cc:740] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.900764  3752 ts_tablet_manager.cc:1434] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:14:38.900841  3756 consensus_queue.cc:260] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.902005  3752 tablet_bootstrap.cc:492] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:38.903558  3756 ts_tablet_manager.cc:1434] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:38.904872  3756 tablet_bootstrap.cc:492] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:38.905498  3753 tablet_bootstrap.cc:654] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.911027  3752 tablet_bootstrap.cc:654] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.912989  3756 tablet_bootstrap.cc:654] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.931820  3753 tablet_bootstrap.cc:492] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:38.933122  3753 ts_tablet_manager.cc:1403] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.012s
I20260709 12:14:38.936540  3753 raft_consensus.cc:359] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.937482  3753 raft_consensus.cc:385] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.937799  3753 raft_consensus.cc:740] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.942806  3754 raft_consensus.cc:493] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.943514  3754 raft_consensus.cc:515] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.944386  3753 consensus_queue.cc:260] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.945924  3752 tablet_bootstrap.cc:492] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:38.946360  3754 leader_election.cc:290] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:38.946861  3752 ts_tablet_manager.cc:1403] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.016s
I20260709 12:14:38.947965  3756 tablet_bootstrap.cc:492] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:38.947741  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:38.949617  3756 ts_tablet_manager.cc:1403] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.000s
W20260709 12:14:38.950709  3499 leader_election.cc:343] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:38.950719  3752 raft_consensus.cc:359] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.952350  3752 raft_consensus.cc:385] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.952739  3752 raft_consensus.cc:740] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.953152  3756 raft_consensus.cc:359] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.954007  3756 raft_consensus.cc:385] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.953725  3752 consensus_queue.cc:260] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.954377  3756 raft_consensus.cc:740] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.954669  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:38.955879  3753 ts_tablet_manager.cc:1434] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.005s
I20260709 12:14:38.955677  3756 consensus_queue.cc:260] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.956746  3607 raft_consensus.cc:2468] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:38.958303  3756 ts_tablet_manager.cc:1434] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:14:38.964440  3498 leader_election.cc:304] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:38.965206  3756 tablet_bootstrap.cc:492] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:38.965215  3753 tablet_bootstrap.cc:492] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:38.965746  3754 raft_consensus.cc:2804] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:38.966428  3754 raft_consensus.cc:493] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.966836  3754 raft_consensus.cc:3060] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.963938  3752 ts_tablet_manager.cc:1434] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:38.971910  3752 tablet_bootstrap.cc:492] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:38.974375  3753 tablet_bootstrap.cc:654] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.976311  3754 raft_consensus.cc:515] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:38.978627  3754 leader_election.cc:290] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:38.982103  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:38.983318  3756 tablet_bootstrap.cc:654] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.983357  3752 tablet_bootstrap.cc:654] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:38.984272  3499 leader_election.cc:343] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:38.990902  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:38.991817  3607 raft_consensus.cc:3060] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.982100  3753 tablet_bootstrap.cc:492] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:38.996165  3753 ts_tablet_manager.cc:1403] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 12:14:38.998667  3752 tablet_bootstrap.cc:492] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:38.999104  3756 tablet_bootstrap.cc:492] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:38.999380  3752 ts_tablet_manager.cc:1403] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 12:14:38.999859  3756 ts_tablet_manager.cc:1403] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.012s
I20260709 12:14:39.000842  3753 raft_consensus.cc:359] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.001693  3753 raft_consensus.cc:385] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.002137  3753 raft_consensus.cc:740] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.003358  3753 consensus_queue.cc:260] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.003278  3752 raft_consensus.cc:359] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.004453  3752 raft_consensus.cc:385] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.004761  3752 raft_consensus.cc:740] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.005782  3607 raft_consensus.cc:2468] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:39.005620  3752 consensus_queue.cc:260] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.006594  3753 ts_tablet_manager.cc:1434] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.006s
I20260709 12:14:39.003981  3756 raft_consensus.cc:359] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.011067  3752 ts_tablet_manager.cc:1434] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:14:39.019392  3756 raft_consensus.cc:385] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.019879  3756 raft_consensus.cc:740] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.020300  3752 tablet_bootstrap.cc:492] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:39.020733  3498 leader_election.cc:304] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.008445  3753 tablet_bootstrap.cc:492] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:39.022405  3754 raft_consensus.cc:2804] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.022899  3754 raft_consensus.cc:697] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:39.023818  3754 consensus_queue.cc:237] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.030603  3753 tablet_bootstrap.cc:654] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.032053  3752 tablet_bootstrap.cc:654] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.034580  3756 consensus_queue.cc:260] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.039788  3756 ts_tablet_manager.cc:1434] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.005s
I20260709 12:14:39.041100  3756 tablet_bootstrap.cc:492] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:39.049506  3752 tablet_bootstrap.cc:492] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:39.050364  3752 ts_tablet_manager.cc:1403] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 12:14:39.050570  3756 tablet_bootstrap.cc:654] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.051093  3741 raft_consensus.cc:493] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.051841  3741 raft_consensus.cc:515] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.049751  3355 catalog_manager.cc:5697] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.056463  3741 leader_election.cc:290] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.057183  3752 raft_consensus.cc:359] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.058966  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.059692  3534 raft_consensus.cc:2468] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:39.060256  3752 raft_consensus.cc:385] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.060663  3752 raft_consensus.cc:740] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.061540  3752 consensus_queue.cc:260] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.061923  3572 leader_election.cc:304] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:39.063340  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.064227  3752 ts_tablet_manager.cc:1434] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
W20260709 12:14:39.065243  3573 leader_election.cc:343] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.067353  3753 tablet_bootstrap.cc:492] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:39.067950  3753 ts_tablet_manager.cc:1403] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.060s	user 0.036s	sys 0.008s
I20260709 12:14:39.070171  3741 raft_consensus.cc:2804] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.070626  3756 tablet_bootstrap.cc:492] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:39.071672  3756 ts_tablet_manager.cc:1403] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.007s
I20260709 12:14:39.070652  3741 raft_consensus.cc:493] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.072568  3741 raft_consensus.cc:3060] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.074054  3754 raft_consensus.cc:493] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.074647  3754 raft_consensus.cc:515] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.077378  3754 leader_election.cc:290] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.071491  3753 raft_consensus.cc:359] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.078507  3753 raft_consensus.cc:385] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.065415  3752 tablet_bootstrap.cc:492] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:39.078548  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.079216  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
W20260709 12:14:39.080919  3499 leader_election.cc:343] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:39.081601  3498 leader_election.cc:343] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.079210  3753 raft_consensus.cc:740] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.082085  3498 leader_election.cc:304] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7; no voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.083231  3754 raft_consensus.cc:2749] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:39.085209  3756 raft_consensus.cc:359] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.086650  3756 raft_consensus.cc:385] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.087193  3756 raft_consensus.cc:740] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.087658  3753 consensus_queue.cc:260] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.088620  3756 consensus_queue.cc:260] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.099182  3758 raft_consensus.cc:493] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.099884  3758 raft_consensus.cc:515] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.101799  3756 ts_tablet_manager.cc:1434] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:14:39.102399  3758 leader_election.cc:290] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.106344  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.110813  3752 tablet_bootstrap.cc:654] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.111207  3609 raft_consensus.cc:2393] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 575eb2eea84a4baa9c8c313e035a5b82 in current term 1: Already voted for candidate 4e40ab447e46441593eca3776e0cf0b7 in this term.
I20260709 12:14:39.111020  3775 raft_consensus.cc:493] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.102502  3753 ts_tablet_manager.cc:1434] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.008s
I20260709 12:14:39.106976  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.114127  3753 tablet_bootstrap.cc:492] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:39.115859  3423 leader_election.cc:304] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.118173  3758 raft_consensus.cc:3060] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.122499  3775 raft_consensus.cc:515] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.105021  3756 tablet_bootstrap.cc:492] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:39.131527  3775 leader_election.cc:290] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.132546  3775 raft_consensus.cc:493] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.133167  3775 raft_consensus.cc:515] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.142670  3775 leader_election.cc:290] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.128347  3741 raft_consensus.cc:515] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.143149  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.143960  3534 raft_consensus.cc:2468] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:39.144927  3741 leader_election.cc:290] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.138623  3753 tablet_bootstrap.cc:654] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.152489  3758 raft_consensus.cc:2749] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:39.152328  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.153976  3456 raft_consensus.cc:2468] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:39.152431  3756 tablet_bootstrap.cc:654] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.156829  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.157775  3456 raft_consensus.cc:2468] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:39.161480  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:39.163707  3573 leader_election.cc:304] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.165133  3741 raft_consensus.cc:2804] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.165625  3741 raft_consensus.cc:493] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.166038  3741 raft_consensus.cc:3060] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.170792  3756 tablet_bootstrap.cc:492] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:39.171813  3756 ts_tablet_manager.cc:1403] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.009s
I20260709 12:14:39.176836  3756 raft_consensus.cc:359] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.178464  3756 raft_consensus.cc:385] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.179023  3756 raft_consensus.cc:740] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.181298  3756 consensus_queue.cc:260] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.181876  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.183089  3534 raft_consensus.cc:2468] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:39.185846  3756 ts_tablet_manager.cc:1434] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:14:39.187196  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.187750  3756 tablet_bootstrap.cc:492] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:39.188244  3534 raft_consensus.cc:3060] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.200492  3758 raft_consensus.cc:493] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.201355  3758 raft_consensus.cc:515] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.205963  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f993765c0fa14c729958199d2a7b9e16" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
W20260709 12:14:39.207887  3423 leader_election.cc:343] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.210317  3758 leader_election.cc:290] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.210929  3756 tablet_bootstrap.cc:654] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.179098  3573 leader_election.cc:304] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.211936  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f993765c0fa14c729958199d2a7b9e16" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
W20260709 12:14:39.212774  3573 leader_election.cc:343] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.212833  3609 raft_consensus.cc:2468] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 0.
I20260709 12:14:39.212908  3779 raft_consensus.cc:2804] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.214141  3752 tablet_bootstrap.cc:492] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:39.214087  3779 raft_consensus.cc:493] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.214643  3779 raft_consensus.cc:3060] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.214771  3752 ts_tablet_manager.cc:1403] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.150s	user 0.047s	sys 0.068s
I20260709 12:14:39.214892  3423 leader_election.cc:304] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.221714  3758 raft_consensus.cc:2804] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.222158  3758 raft_consensus.cc:493] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.222564  3758 raft_consensus.cc:3060] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.223438  3752 raft_consensus.cc:359] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.224370  3756 tablet_bootstrap.cc:492] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:39.224336  3752 raft_consensus.cc:385] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.225054  3756 ts_tablet_manager.cc:1403] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.005s
I20260709 12:14:39.225220  3752 raft_consensus.cc:740] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.226346  3752 consensus_queue.cc:260] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.227288  3741 raft_consensus.cc:515] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.229562  3741 leader_election.cc:290] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.229740  3752 ts_tablet_manager.cc:1434] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:14:39.219197  3534 raft_consensus.cc:2468] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:39.231537  3752 tablet_bootstrap.cc:492] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:39.232048  3756 raft_consensus.cc:359] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.232859  3756 raft_consensus.cc:385] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.233157  3756 raft_consensus.cc:740] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.233918  3756 consensus_queue.cc:260] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.234406  3758 raft_consensus.cc:515] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.233908  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:39.235845  3456 raft_consensus.cc:3060] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.236534  3756 ts_tablet_manager.cc:1434] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:14:39.237739  3756 tablet_bootstrap.cc:492] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:39.237552  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f993765c0fa14c729958199d2a7b9e16" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.238310  3533 raft_consensus.cc:3060] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.245981  3752 tablet_bootstrap.cc:654] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.246847  3779 raft_consensus.cc:515] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.249425  3779 leader_election.cc:290] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.251125  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:39.252447  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.252837  3458 raft_consensus.cc:3060] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.251489  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f993765c0fa14c729958199d2a7b9e16" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:39.253450  3609 raft_consensus.cc:3060] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.256701  3533 raft_consensus.cc:2468] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 1.
I20260709 12:14:39.258770  3423 leader_election.cc:304] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.259951  3655 raft_consensus.cc:2804] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.264562  3609 raft_consensus.cc:2468] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 1.
I20260709 12:14:39.252442  3758 leader_election.cc:290] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.271283  3786 raft_consensus.cc:493] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.272262  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.273283  3533 raft_consensus.cc:3060] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.265640  3756 tablet_bootstrap.cc:654] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.266848  3534 raft_consensus.cc:3060] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.268608  3753 tablet_bootstrap.cc:492] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:39.278844  3753 ts_tablet_manager.cc:1403] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.165s	user 0.025s	sys 0.021s
I20260709 12:14:39.286346  3779 raft_consensus.cc:493] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.287117  3779 raft_consensus.cc:515] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.272251  3786 raft_consensus.cc:515] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.293146  3572 leader_election.cc:304] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.296202  3741 raft_consensus.cc:2804] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.296841  3741 raft_consensus.cc:697] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:39.298048  3741 consensus_queue.cc:237] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.282618  3753 raft_consensus.cc:359] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.320335  3753 raft_consensus.cc:385] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.320770  3753 raft_consensus.cc:740] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.320926  3779 leader_election.cc:290] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:39.321610  3753 consensus_queue.cc:260] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.322062  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.323541  3754 raft_consensus.cc:493] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.324635  3753 ts_tablet_manager.cc:1434] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.045s	user 0.012s	sys 0.015s
I20260709 12:14:39.324239  3754 raft_consensus.cc:515] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.325843  3753 tablet_bootstrap.cc:492] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:39.329145  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.330518  3456 raft_consensus.cc:2468] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:39.332955  3756 tablet_bootstrap.cc:492] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
W20260709 12:14:39.333304  3573 leader_election.cc:343] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.333551  3756 ts_tablet_manager.cc:1403] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.019s
I20260709 12:14:39.334024  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.330952  3754 leader_election.cc:290] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
W20260709 12:14:39.337159  3498 leader_election.cc:343] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:39.336783  3572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.222.130:44763, user_credentials={real_user=slave}} blocked reactor thread for 43790.5us
W20260709 12:14:39.338440  3423 leader_election.cc:343] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.339443  3535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.340214  3535 raft_consensus.cc:2468] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 0.
I20260709 12:14:39.341694  3572 leader_election.cc:304] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.343040  3779 raft_consensus.cc:2804] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.343425  3779 raft_consensus.cc:493] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.334162  3573 leader_election.cc:304] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.343950  3779 raft_consensus.cc:3060] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.344403  3775 raft_consensus.cc:2804] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.344965  3775 raft_consensus.cc:697] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:39.345779  3758 raft_consensus.cc:493] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.346415  3758 raft_consensus.cc:515] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.345891  3775 consensus_queue.cc:237] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.348922  3758 leader_election.cc:290] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.348937  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.351079  3456 raft_consensus.cc:2468] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:39.351689  3756 raft_consensus.cc:359] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.352530  3499 leader_election.cc:304] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531
I20260709 12:14:39.353871  3754 raft_consensus.cc:2804] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.354322  3754 raft_consensus.cc:493] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.354007  3779 raft_consensus.cc:515] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.354730  3754 raft_consensus.cc:3060] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.352551  3756 raft_consensus.cc:385] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.355504  3756 raft_consensus.cc:740] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.351678  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.356307  3756 consensus_queue.cc:260] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.356329  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.357977  3460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:39.358758  3609 raft_consensus.cc:2468] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 0.
I20260709 12:14:39.359700  3779 leader_election.cc:290] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
W20260709 12:14:39.359870  3573 leader_election.cc:343] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:39.361107  3533 raft_consensus.cc:2468] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:39.364128  3458 raft_consensus.cc:2468] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:39.366032  3573 leader_election.cc:304] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.367924  3779 raft_consensus.cc:2804] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.368732  3779 raft_consensus.cc:697] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:39.369674  3779 consensus_queue.cc:237] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.370426  3655 raft_consensus.cc:697] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:39.372398  3756 ts_tablet_manager.cc:1434] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.004s
I20260709 12:14:39.372653  3786 leader_election.cc:290] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.373656  3756 tablet_bootstrap.cc:492] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: Bootstrap starting.
I20260709 12:14:39.373875  3655 consensus_queue.cc:237] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.382302  3752 tablet_bootstrap.cc:492] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:39.383142  3752 ts_tablet_manager.cc:1403] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.152s	user 0.037s	sys 0.049s
I20260709 12:14:39.383392  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.384375  3609 raft_consensus.cc:2468] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 0.
I20260709 12:14:39.385890  3423 leader_election.cc:304] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.387043  3753 tablet_bootstrap.cc:654] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.387652  3423 leader_election.cc:304] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.388640  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.389079  3758 raft_consensus.cc:2804] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.389587  3758 raft_consensus.cc:493] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.390225  3758 raft_consensus.cc:3060] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.389840  3358 catalog_manager.cc:5697] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.389313  3533 raft_consensus.cc:3060] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.389699  3752 raft_consensus.cc:359] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.394712  3752 raft_consensus.cc:385] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.395064  3752 raft_consensus.cc:740] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.395900  3752 consensus_queue.cc:260] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.398487  3756 tablet_bootstrap.cc:654] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.398629  3786 raft_consensus.cc:2804] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.399096  3786 raft_consensus.cc:493] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.399470  3786 raft_consensus.cc:3060] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.407982  3533 raft_consensus.cc:2468] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:39.421897  3753 tablet_bootstrap.cc:492] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:39.422189  3572 leader_election.cc:304] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.422631  3753 ts_tablet_manager.cc:1403] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.008s
I20260709 12:14:39.423347  3775 raft_consensus.cc:2804] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.387513  3754 raft_consensus.cc:515] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.326112  3534 raft_consensus.cc:2468] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 1.
I20260709 12:14:39.420722  3752 ts_tablet_manager.cc:1434] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.012s
I20260709 12:14:39.423892  3775 raft_consensus.cc:697] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:39.425297  3775 consensus_queue.cc:237] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.425865  3752 tablet_bootstrap.cc:492] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: Bootstrap starting.
I20260709 12:14:39.426849  3532 raft_consensus.cc:2393] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 575eb2eea84a4baa9c8c313e035a5b82 in current term 1: Already voted for candidate 4e40ab447e46441593eca3776e0cf0b7 in this term.
I20260709 12:14:39.428918  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:39.430596  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:39.431314  3609 raft_consensus.cc:3060] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.425637  3355 catalog_manager.cc:5697] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.435652  3355 catalog_manager.cc:5697] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.436488  3756 tablet_bootstrap.cc:492] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: No bootstrap required, opened a new log
I20260709 12:14:39.439742  3756 ts_tablet_manager.cc:1403] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.007s
I20260709 12:14:39.440065  3758 raft_consensus.cc:515] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.441323  3609 raft_consensus.cc:2468] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:39.427984  3754 leader_election.cc:290] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.441561  3456 raft_consensus.cc:2393] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e40ab447e46441593eca3776e0cf0b7 in current term 1: Already voted for candidate 575eb2eea84a4baa9c8c313e035a5b82 in this term.
I20260709 12:14:39.442582  3758 leader_election.cc:290] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.443965  3756 raft_consensus.cc:359] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.426872  3753 raft_consensus.cc:359] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.445094  3756 raft_consensus.cc:385] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.445521  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:39.445640  3753 raft_consensus.cc:385] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.435665  3752 tablet_bootstrap.cc:654] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.450809  3534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9dcbe55854f403d91840add96b09644" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.451786  3534 raft_consensus.cc:2393] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 575eb2eea84a4baa9c8c313e035a5b82 in current term 1: Already voted for candidate 4e40ab447e46441593eca3776e0cf0b7 in this term.
I20260709 12:14:39.451982  3753 raft_consensus.cc:740] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.453090  3753 consensus_queue.cc:260] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.453449  3423 leader_election.cc:304] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.445657  3756 raft_consensus.cc:740] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.457734  3498 leader_election.cc:304] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.457738  3756 consensus_queue.cc:260] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.459033  3754 raft_consensus.cc:2804] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.459831  3754 raft_consensus.cc:697] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:39.460582  3756 ts_tablet_manager.cc:1434] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:14:39.460721  3754 consensus_queue.cc:237] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.462734  3758 raft_consensus.cc:2749] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:39.463532  3753 ts_tablet_manager.cc:1434] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:14:39.463217  3786 raft_consensus.cc:515] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.465452  3786 leader_election.cc:290] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.466985  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:39.467742  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:39.467999  3533 raft_consensus.cc:3060] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.468511  3607 raft_consensus.cc:3060] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.468263  3793 consensus_queue.cc:1048] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.478037  3533 raft_consensus.cc:2468] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 1.
I20260709 12:14:39.481392  3423 leader_election.cc:304] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.486512  3786 raft_consensus.cc:2804] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.487171  3786 raft_consensus.cc:697] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:39.487527  3356 catalog_manager.cc:5697] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.488066  3786 consensus_queue.cc:237] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.489368  3607 raft_consensus.cc:2468] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 1.
I20260709 12:14:39.491523  3355 catalog_manager.cc:5697] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 1 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.491531  3752 tablet_bootstrap.cc:492] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: No bootstrap required, opened a new log
I20260709 12:14:39.494433  3752 ts_tablet_manager.cc:1403] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.005s
I20260709 12:14:39.497677  3753 tablet_bootstrap.cc:492] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:39.508695  3752 raft_consensus.cc:359] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.509547  3752 raft_consensus.cc:385] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.509934  3752 raft_consensus.cc:740] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.510789  3752 consensus_queue.cc:260] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.519863  3753 tablet_bootstrap.cc:654] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:39.525671  3752 ts_tablet_manager.cc:1434] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:14:39.530136  3754 consensus_queue.cc:1048] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.556053  3753 tablet_bootstrap.cc:492] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:39.556748  3753 ts_tablet_manager.cc:1403] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.014s
I20260709 12:14:39.557108  3358 catalog_manager.cc:5697] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.561344  3753 raft_consensus.cc:359] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.562587  3753 raft_consensus.cc:385] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.562956  3753 raft_consensus.cc:740] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.563997  3753 consensus_queue.cc:260] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.567541  3753 ts_tablet_manager.cc:1434] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:14:39.570080  3753 tablet_bootstrap.cc:492] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: Bootstrap starting.
I20260709 12:14:39.580258  3753 tablet_bootstrap.cc:654] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:39.592289  3499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.129:44501, user_credentials={real_user=slave}} blocked reactor thread for 78461.7us
I20260709 12:14:39.593899  3753 tablet_bootstrap.cc:492] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: No bootstrap required, opened a new log
I20260709 12:14:39.594583  3753 ts_tablet_manager.cc:1403] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:14:39.598798  3753 raft_consensus.cc:359] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.599741  3753 raft_consensus.cc:385] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:39.600029  3753 raft_consensus.cc:740] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Initialized, Role: FOLLOWER
I20260709 12:14:39.600857  3753 consensus_queue.cc:260] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.603026  3753 ts_tablet_manager.cc:1434] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:39.609843  3358 catalog_manager.cc:5697] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 1 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:39.636647  3405 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:39.684470  3786 raft_consensus.cc:493] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.685302  3786 raft_consensus.cc:515] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.687372  3786 leader_election.cc:290] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.688810  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.689227  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.689689  3533 raft_consensus.cc:2393] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 575eb2eea84a4baa9c8c313e035a5b82 in current term 1: Already voted for candidate 48dadfe9d82c4b13b51c3459a4162531 in this term.
I20260709 12:14:39.691056  3423 leader_election.cc:304] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.692082  3786 raft_consensus.cc:3060] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.698498  3786 raft_consensus.cc:2749] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:39.749091  3456 raft_consensus.cc:3060] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.755820  3775 consensus_queue.cc:1048] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.757902  3775 consensus_queue.cc:1048] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.763969  3786 raft_consensus.cc:493] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48dadfe9d82c4b13b51c3459a4162531)
I20260709 12:14:39.764592  3786 raft_consensus.cc:515] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.770977  3786 leader_election.cc:290] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.771910  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.775533  3533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4e40ab447e46441593eca3776e0cf0b7" is_pre_election: true
I20260709 12:14:39.777523  3423 leader_election.cc:304] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 575eb2eea84a4baa9c8c313e035a5b82; no voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.779067  3779 consensus_queue.cc:1048] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.779299  3777 consensus_queue.cc:1048] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.780830  3786 raft_consensus.cc:2749] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:39.781998  3660 raft_consensus.cc:493] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.782521  3660 raft_consensus.cc:515] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.787854  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531" is_pre_election: true
I20260709 12:14:39.788828  3609 raft_consensus.cc:2468] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:39.784751  3660 leader_election.cc:290] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.791601  3498 leader_election.cc:304] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:39.793747  3660 raft_consensus.cc:2804] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:39.794165  3660 raft_consensus.cc:493] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.794540  3660 raft_consensus.cc:3060] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.795454  3456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82" is_pre_election: true
I20260709 12:14:39.796379  3456 raft_consensus.cc:2468] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 0.
I20260709 12:14:39.804549  3660 raft_consensus.cc:515] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.807803  3660 leader_election.cc:290] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:39.808496  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:39.809309  3458 raft_consensus.cc:3060] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.814939  3609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:39.815721  3609 raft_consensus.cc:3060] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:39.818251  3458 raft_consensus.cc:2468] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:39.819794  3499 leader_election.cc:304] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:39.820950  3660 raft_consensus.cc:2804] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:39.821700  3660 raft_consensus.cc:697] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:39.822840  3775 consensus_queue.cc:1048] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.823237  3660 consensus_queue.cc:237] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:39.823939  3609 raft_consensus.cc:2468] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 1.
I20260709 12:14:39.835891  3358 catalog_manager.cc:5697] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 1 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.838054  3811 consensus_queue.cc:1048] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:39.850188  3779 consensus_queue.cc:1048] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.866792  3775 consensus_queue.cc:1048] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.905089  3609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e67404cef74429db91a817369b03ee8"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:39.905946  3609 raft_consensus.cc:606] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.912277  3609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:39.912878  3609 raft_consensus.cc:606] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.919137  3532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
mode: GRACEFUL
new_leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:55404
I20260709 12:14:39.919823  3532 raft_consensus.cc:606] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Received request to transfer leadership to TS 575eb2eea84a4baa9c8c313e035a5b82
I20260709 12:14:39.930528  3458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
mode: GRACEFUL
new_leader_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:14:39.931326  3458 raft_consensus.cc:606] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Received request to transfer leadership to TS 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.937788  3609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:39.938449  3609 raft_consensus.cc:606] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.947785  3609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
mode: GRACEFUL
new_leader_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:49056
I20260709 12:14:39.948487  3609 raft_consensus.cc:606] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Received request to transfer leadership to TS 4e40ab447e46441593eca3776e0cf0b7
I20260709 12:14:39.951885  3660 consensus_queue.cc:1048] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.953871  3786 consensus_queue.cc:1048] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.955475  3532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
mode: GRACEFUL
new_leader_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:55404
I20260709 12:14:39.956198  3532 raft_consensus.cc:606] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Received request to transfer leadership to TS 48dadfe9d82c4b13b51c3459a4162531
I20260709 12:14:39.979393  3804 consensus_queue.cc:1048] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.978608  3786 consensus_queue.cc:1048] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:40.020859  3786 consensus_queue.cc:1048] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:40.028800  3758 raft_consensus.cc:993] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: : Instructing follower 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:40.029363  3758 raft_consensus.cc:1081] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Signalling peer 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:40.034986  3786 consensus_queue.cc:1048] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:40.035408  3532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:55392
I20260709 12:14:40.036290  3532 raft_consensus.cc:493] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.036723  3532 raft_consensus.cc:3060] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.047190  3532 raft_consensus.cc:515] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.050153  3532 leader_election.cc:290] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:40.051014  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:40.051844  3458 raft_consensus.cc:3055] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.052174  3458 raft_consensus.cc:740] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:40.052279  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a76b7cdd0574dd2b1a07bd1dfadd1d5" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:40.052906  3607 raft_consensus.cc:3060] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.053054  3458 consensus_queue.cc:260] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.054454  3458 raft_consensus.cc:3060] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.061098  3458 raft_consensus.cc:2468] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:40.061477  3607 raft_consensus.cc:2468] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:40.062400  3499 leader_election.cc:304] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:40.063470  3804 raft_consensus.cc:2804] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.063906  3804 raft_consensus.cc:697] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:40.064587  3804 consensus_queue.cc:237] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.072714  3358 catalog_manager.cc:5697] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 1 to 2, leader changed from 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129) to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.252182  3779 raft_consensus.cc:993] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:40.252712  3775 raft_consensus.cc:1081] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:40.254230  3458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e67404cef74429db91a817369b03ee8"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36634
I20260709 12:14:40.254812  3458 raft_consensus.cc:493] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.255139  3458 raft_consensus.cc:3060] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.261508  3458 raft_consensus.cc:515] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.263402  3458 leader_election.cc:290] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:40.264353  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:40.264762  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e67404cef74429db91a817369b03ee8" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:40.265067  3532 raft_consensus.cc:3060] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.265406  3607 raft_consensus.cc:3055] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.265758  3607 raft_consensus.cc:740] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:40.266579  3607 consensus_queue.cc:260] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.268038  3607 raft_consensus.cc:3060] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.273262  3532 raft_consensus.cc:2468] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:40.274714  3423 leader_election.cc:304] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:40.275194  3607 raft_consensus.cc:2468] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:40.275552  3786 raft_consensus.cc:2804] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.276173  3786 raft_consensus.cc:697] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:40.277036  3786 consensus_queue.cc:237] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.284330  3358 catalog_manager.cc:5697] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.344870  3777 raft_consensus.cc:993] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:40.345417  3777 raft_consensus.cc:1081] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:40.347276  3532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:55396
I20260709 12:14:40.347810  3532 raft_consensus.cc:493] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.348116  3532 raft_consensus.cc:3060] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.354570  3804 consensus_queue.cc:1048] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:40.356644  3532 raft_consensus.cc:515] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.359726  3532 leader_election.cc:290] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:40.360054  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:40.360994  3458 raft_consensus.cc:3060] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.363937  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb52a6c301c4ea499c94ee9ef5250dd" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:40.364470  3793 raft_consensus.cc:993] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: : Instructing follower 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:40.364792  3607 raft_consensus.cc:3055] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.365027  3804 raft_consensus.cc:1081] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Signalling peer 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:40.365253  3607 raft_consensus.cc:740] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:40.366304  3607 consensus_queue.cc:260] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.367846  3607 raft_consensus.cc:3060] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.367982  3606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:49040
I20260709 12:14:40.368683  3606 raft_consensus.cc:493] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.369096  3606 raft_consensus.cc:3060] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.380322  3458 raft_consensus.cc:2468] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:40.382889  3606 raft_consensus.cc:515] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.382480  3754 consensus_queue.cc:1048] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:40.385363  3607 raft_consensus.cc:2468] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:40.385794  3499 leader_election.cc:304] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:40.386952  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:40.387607  3458 raft_consensus.cc:3060] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.388042  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4493902ecfcb4156a321e2fef08ae8ff" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:40.388734  3532 raft_consensus.cc:3055] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.389091  3532 raft_consensus.cc:740] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:40.390048  3532 consensus_queue.cc:260] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.387611  3804 raft_consensus.cc:2804] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.391649  3532 raft_consensus.cc:3060] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.392549  3804 raft_consensus.cc:697] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:40.393644  3804 consensus_queue.cc:237] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.396163  3458 raft_consensus.cc:2468] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 2.
I20260709 12:14:40.397006  3460 raft_consensus.cc:1240] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Rejecting Update request from peer 4e40ab447e46441593eca3776e0cf0b7 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:14:40.397774  3606 leader_election.cc:290] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:40.400170  3573 leader_election.cc:304] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:40.401036  3777 raft_consensus.cc:2804] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.401365  3532 raft_consensus.cc:2468] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 2.
I20260709 12:14:40.401571  3777 raft_consensus.cc:697] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 2 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:40.402571  3777 consensus_queue.cc:237] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.407964  3358 catalog_manager.cc:5697] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.409911  3356 catalog_manager.cc:5697] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 1 to 2, leader changed from 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130) to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 2 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:40.446964  3775 raft_consensus.cc:993] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:40.447510  3777 raft_consensus.cc:1081] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:40.449093  3460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36634
I20260709 12:14:40.449595  3460 raft_consensus.cc:493] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.450016  3460 raft_consensus.cc:3060] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.456329  3460 raft_consensus.cc:515] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.458353  3460 leader_election.cc:290] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:40.459463  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:40.459306  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b97c43244a447229566d16d6cf59b76" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:40.460114  3607 raft_consensus.cc:3055] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.460232  3532 raft_consensus.cc:3060] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.460568  3607 raft_consensus.cc:740] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:40.461251  3754 raft_consensus.cc:993] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: : Instructing follower 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:40.461751  3754 raft_consensus.cc:1081] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Signalling peer 575eb2eea84a4baa9c8c313e035a5b82 to start an election
I20260709 12:14:40.461548  3607 consensus_queue.cc:260] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.463006  3607 raft_consensus.cc:3060] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.463577  3458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
 from {username='slave'} at 127.0.0.1:36648
I20260709 12:14:40.464531  3458 raft_consensus.cc:493] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.464916  3458 raft_consensus.cc:3060] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.469338  3777 raft_consensus.cc:993] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: : Instructing follower 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:40.469965  3777 raft_consensus.cc:1081] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Signalling peer 4e40ab447e46441593eca3776e0cf0b7 to start an election
I20260709 12:14:40.469847  3532 raft_consensus.cc:2468] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:40.471210  3607 raft_consensus.cc:2468] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:40.472366  3423 leader_election.cc:304] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e40ab447e46441593eca3776e0cf0b7, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:40.472558  3533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
 from {username='slave'} at 127.0.0.1:55396
I20260709 12:14:40.473234  3786 raft_consensus.cc:2804] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.473327  3533 raft_consensus.cc:493] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:40.473805  3533 raft_consensus.cc:3060] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.473737  3458 raft_consensus.cc:515] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.473834  3786 raft_consensus.cc:697] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:40.475292  3786 consensus_queue.cc:237] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.475916  3458 leader_election.cc:290] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Requested vote from peers 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:40.477068  3532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:40.477715  3532 raft_consensus.cc:3055] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.478046  3532 raft_consensus.cc:740] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:40.479745  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ded39d6e42647d7a8fa5dd7af444ad4" candidate_uuid: "575eb2eea84a4baa9c8c313e035a5b82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:40.480438  3607 raft_consensus.cc:3060] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.481411  3532 consensus_queue.cc:260] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.482750  3532 raft_consensus.cc:3060] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.484365  3356 catalog_manager.cc:5697] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.484301  3533 raft_consensus.cc:515] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.489540  3607 raft_consensus.cc:2468] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:40.491110  3533 leader_election.cc:290] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131:43617)
I20260709 12:14:40.491561  3532 raft_consensus.cc:2468] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 575eb2eea84a4baa9c8c313e035a5b82 in term 2.
I20260709 12:14:40.491839  3607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
I20260709 12:14:40.492514  3607 raft_consensus.cc:3055] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:40.492687  3423 leader_election.cc:304] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:40.492885  3607 raft_consensus.cc:740] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:40.493566  3786 raft_consensus.cc:2804] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.494095  3786 raft_consensus.cc:697] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Leader. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:40.493850  3607 consensus_queue.cc:260] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.495325  3607 raft_consensus.cc:3060] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.495062  3786 consensus_queue.cc:237] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.497756  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0112156b7a8745cba9f6703c5a971557" candidate_uuid: "4e40ab447e46441593eca3776e0cf0b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:40.498517  3458 raft_consensus.cc:3060] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:40.504172  3607 raft_consensus.cc:2468] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:40.505856  3498 leader_election.cc:304] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:40.506736  3754 raft_consensus.cc:2804] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:40.507332  3754 raft_consensus.cc:697] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Leader. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:40.508213  3754 consensus_queue.cc:237] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:40.509473  3458 raft_consensus.cc:2468] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e40ab447e46441593eca3776e0cf0b7 in term 2.
I20260709 12:14:40.510241  3356 catalog_manager.cc:5697] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 reported cstate change: term changed from 1 to 2, leader changed from 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130) to 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129). New cstate: current_term: 2 leader_uuid: "575eb2eea84a4baa9c8c313e035a5b82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.518841  3358 catalog_manager.cc:5697] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 reported cstate change: term changed from 1 to 2, leader changed from 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131) to 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130). New cstate: current_term: 2 leader_uuid: "4e40ab447e46441593eca3776e0cf0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:40.654112  3606 raft_consensus.cc:1275] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.655643  3754 consensus_queue.cc:1048] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.663873  3458 raft_consensus.cc:1275] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.665307  3533 raft_consensus.cc:1275] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.665566  3754 consensus_queue.cc:1048] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:40.667414  3655 consensus_queue.cc:1048] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.683611  3606 raft_consensus.cc:1275] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.685389  3827 consensus_queue.cc:1048] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.828742  3458 raft_consensus.cc:1275] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.830722  3660 consensus_queue.cc:1048] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.843183  3606 raft_consensus.cc:1275] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.845273  3804 consensus_queue.cc:1048] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.884155  3533 raft_consensus.cc:1275] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.885676  3777 consensus_queue.cc:1048] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.899200  3458 raft_consensus.cc:1275] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.900491  3460 raft_consensus.cc:1275] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.901062  3775 consensus_queue.cc:1048] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:40.902580  3804 consensus_queue.cc:1048] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:40.916505  3606 raft_consensus.cc:1275] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 4e40ab447e46441593eca3776e0cf0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:40.918308  3793 consensus_queue.cc:1048] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:41.018630  3606 raft_consensus.cc:1275] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.020270  3786 consensus_queue.cc:1048] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:41.030997  3533 raft_consensus.cc:1275] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.032735  3655 consensus_queue.cc:1048] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:41.042253  3533 raft_consensus.cc:1275] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.043848  3655 consensus_queue.cc:1048] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:41.054662  3606 raft_consensus.cc:1275] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Refusing update from remote peer 575eb2eea84a4baa9c8c313e035a5b82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:41.056417  3827 consensus_queue.cc:1048] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:42.960601  3355 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49960:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:42.982172  3355 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49960:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:43.061064 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:43.185839  3423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:43617, user_credentials={real_user=slave}} blocked reactor thread for 50618.4us
W20260709 12:14:43.303612  3498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:43617, user_credentials={real_user=slave}} blocked reactor thread for 78511.7us
I20260709 12:14:43.307183  3897 tablet.cc:1724] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:43.320770  3866 log.cc:927] Time spent T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: Append to log took a long time: real 0.180s	user 0.002s	sys 0.001s
I20260709 12:14:43.275990  3891 tablet.cc:1724] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.330691  3894 tablet.cc:1724] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.343286  3893 tablet.cc:1724] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:43.329862  3889 log.cc:927] Time spent T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:14:43.363463  3902 tablet.cc:1724] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:43.378840  3861 log.cc:927] Time spent T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: Append to log took a long time: real 0.234s	user 0.004s	sys 0.000s
I20260709 12:14:43.381529  3903 tablet.cc:1724] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:43.422463  3498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.222.131:43617, user_credentials={real_user=slave}} blocked reactor thread for 111295us
I20260709 12:14:43.445128  3906 tablet.cc:1724] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.436954  3901 tablet.cc:1724] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.474208  3904 tablet.cc:1724] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.476389  3897 tablet.cc:1724] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.497313  3891 tablet.cc:1724] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.523612  3908 tablet.cc:1724] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.530205  3901 tablet.cc:1724] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.539724  3910 tablet.cc:1724] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.568015  3902 tablet.cc:1724] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.577194  3458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239"
dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
mode: GRACEFUL
new_leader_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:36658
I20260709 12:14:43.578275  3458 raft_consensus.cc:606] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Received request to transfer leadership to TS 48dadfe9d82c4b13b51c3459a4162531
I20260709 12:14:43.529439  3894 tablet.cc:1724] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.583256  3912 tablet.cc:1724] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.597862  3908 tablet.cc:1724] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.599169  3912 tablet.cc:1724] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.601087  3893 tablet.cc:1724] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.595908  3904 tablet.cc:1724] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.626678  3902 tablet.cc:1724] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.641443  3897 tablet.cc:1724] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.644546  3912 tablet.cc:1724] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.634860  3904 tablet.cc:1724] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.655380  3903 tablet.cc:1724] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.630029  3891 tablet.cc:1724] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:43.711911  3530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99b40b347c3420398a720ffae71441d"
dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
mode: GRACEFUL
new_leader_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:55406
I20260709 12:14:43.712534  3530 raft_consensus.cc:606] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Received request to transfer leadership to TS 48dadfe9d82c4b13b51c3459a4162531
I20260709 12:14:43.713888 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:43.714663 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:43.715104  3358 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436: soft_deleted_table [id=5a83e6aad07048149ead6faef55f53da] alter complete (version 1)
I20260709 12:14:43.756637  3858 raft_consensus.cc:993] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: : Instructing follower 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:43.757361  3876 raft_consensus.cc:1081] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Signalling peer 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:43.759119  3606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:49028
I20260709 12:14:43.759689  3606 raft_consensus.cc:493] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:43.760020  3606 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:43.766067  3606 raft_consensus.cc:515] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:43.769364  3606 leader_election.cc:290] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 3 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:43.770591  3530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:43.770732  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d52b992f53de440a9c609eb9a6787239" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:43.771422  3530 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:43.771492  3458 raft_consensus.cc:3055] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:43.772086  3458 raft_consensus.cc:740] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 575eb2eea84a4baa9c8c313e035a5b82, State: Running, Role: LEADER
I20260709 12:14:43.772838  3458 consensus_queue.cc:260] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:43.773806  3458 raft_consensus.cc:3060] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:43.777930  3530 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 3.
I20260709 12:14:43.779044  3458 raft_consensus.cc:2468] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 3.
I20260709 12:14:43.779422  3572 leader_election.cc:304] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 4e40ab447e46441593eca3776e0cf0b7; no voters: 
I20260709 12:14:43.780572  3839 raft_consensus.cc:2804] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:43.781097  3839 raft_consensus.cc:697] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 3 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:43.781903  3839 consensus_queue.cc:237] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:43.792027  3357 catalog_manager.cc:5697] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 2 to 3, leader changed from 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129) to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.114027  3907 raft_consensus.cc:993] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: : Instructing follower 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:44.114655  3919 raft_consensus.cc:1081] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Signalling peer 48dadfe9d82c4b13b51c3459a4162531 to start an election
I20260709 12:14:44.116288  3609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99b40b347c3420398a720ffae71441d"
dest_uuid: "48dadfe9d82c4b13b51c3459a4162531"
 from {username='slave'} at 127.0.0.1:49040
I20260709 12:14:44.116755  3609 raft_consensus.cc:493] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.117000  3609 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.123075  3609 raft_consensus.cc:515] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:44.124781  3609 leader_election.cc:290] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 3 election: Requested vote from peers 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501), 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763)
I20260709 12:14:44.126048  3530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4e40ab447e46441593eca3776e0cf0b7"
I20260709 12:14:44.126708  3458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99b40b347c3420398a720ffae71441d" candidate_uuid: "48dadfe9d82c4b13b51c3459a4162531" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "575eb2eea84a4baa9c8c313e035a5b82"
I20260709 12:14:44.126813  3530 raft_consensus.cc:3055] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:44.127404  3458 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.127350  3530 raft_consensus.cc:740] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4e40ab447e46441593eca3776e0cf0b7, State: Running, Role: LEADER
I20260709 12:14:44.128686  3530 consensus_queue.cc:260] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:44.130157  3530 raft_consensus.cc:3060] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.136018  3458 raft_consensus.cc:2468] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 3.
I20260709 12:14:44.137780  3573 leader_election.cc:304] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48dadfe9d82c4b13b51c3459a4162531, 575eb2eea84a4baa9c8c313e035a5b82; no voters: 
I20260709 12:14:44.138507  3530 raft_consensus.cc:2468] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48dadfe9d82c4b13b51c3459a4162531 in term 3.
I20260709 12:14:44.138962  3839 raft_consensus.cc:2804] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:44.139508  3839 raft_consensus.cc:697] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 3 LEADER]: Becoming Leader. State: Replica: 48dadfe9d82c4b13b51c3459a4162531, State: Running, Role: LEADER
I20260709 12:14:44.140326  3839 consensus_queue.cc:237] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } }
I20260709 12:14:44.151652  3357 catalog_manager.cc:5697] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 reported cstate change: term changed from 2 to 3, leader changed from 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130) to 48dadfe9d82c4b13b51c3459a4162531 (127.23.222.131). New cstate: current_term: 3 leader_uuid: "48dadfe9d82c4b13b51c3459a4162531" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48dadfe9d82c4b13b51c3459a4162531" member_type: VOTER last_known_addr { host: "127.23.222.131" port: 43617 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.177342  3458 raft_consensus.cc:1275] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:44.178843  3839 consensus_queue.cc:1048] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:44.195163  3530 raft_consensus.cc:1275] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:44.196944  3882 consensus_queue.cc:1048] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:44.612776  3458 raft_consensus.cc:1275] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:44.614444  3882 consensus_queue.cc:1048] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "575eb2eea84a4baa9c8c313e035a5b82" member_type: VOTER last_known_addr { host: "127.23.222.129" port: 44501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:44.628224  3530 raft_consensus.cc:1275] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Refusing update from remote peer 48dadfe9d82c4b13b51c3459a4162531: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:44.629739  3839 consensus_queue.cc:1048] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e40ab447e46441593eca3776e0cf0b7" member_type: VOTER last_known_addr { host: "127.23.222.130" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:44.715907 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:44.722662 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:44.723212 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:45.724380 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:45.730247 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:45.730861 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:46.732264 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:46.739744 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:46.740187 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:47.741420 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:47.747205 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:47.747740 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:48.748899 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:48.754637 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:48.755184 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:49.756335 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:49.762161 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:49.762739 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:50.764127 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:50.769299 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:50.769853 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:51.771095 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:51.777019 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:51.777590 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:52.778893 24442 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:52.784235 24442 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:52.784724 24442 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:53.863932 24442 tablet_server.cc:179] TabletServer@127.23.222.129:0 shutting down...
W20260709 12:14:53.873920  3573 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 12:14:53.878931  3573 consensus_peers.cc:597] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.935783 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:53.937405 24442 tablet_replica.cc:333] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.939086 24442 raft_consensus.cc:2243] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.940008 24442 raft_consensus.cc:2272] T 4493902ecfcb4156a321e2fef08ae8ff P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.943687 24442 tablet_replica.cc:333] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.944635 24442 raft_consensus.cc:2243] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.945544 24442 raft_consensus.cc:2272] T 1fb52a6c301c4ea499c94ee9ef5250dd P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.948369 24442 tablet_replica.cc:333] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.949258 24442 raft_consensus.cc:2243] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.950054 24442 raft_consensus.cc:2272] T c9dcbe55854f403d91840add96b09644 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.954466 24442 tablet_replica.cc:333] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.955440 24442 raft_consensus.cc:2243] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.957365 24442 raft_consensus.cc:2272] T 3b97c43244a447229566d16d6cf59b76 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.959494  3499 consensus_peers.cc:597] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.961333 24442 tablet_replica.cc:333] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.962117 24442 raft_consensus.cc:2243] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.962795 24442 raft_consensus.cc:2272] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.966197 24442 tablet_replica.cc:333] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.967053 24442 raft_consensus.cc:2243] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.968189 24442 raft_consensus.cc:2272] T f993765c0fa14c729958199d2a7b9e16 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.971601 24442 tablet_replica.cc:333] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.972241 24442 raft_consensus.cc:2243] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.972816 24442 raft_consensus.cc:2272] T d52b992f53de440a9c609eb9a6787239 P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.976105 24442 tablet_replica.cc:333] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.977041 24442 raft_consensus.cc:2243] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.978510 24442 raft_consensus.cc:2272] T e9f188849ee344b3aa4ca0b680fedbda P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:53.981899  3499 consensus_peers.cc:597] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:53.982776 24442 tablet_replica.cc:333] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.983567 24442 raft_consensus.cc:2243] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.984170 24442 raft_consensus.cc:2272] T e9dffe8f34ed415c854944a1c77c8993 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.987448 24442 tablet_replica.cc:333] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.988240 24442 raft_consensus.cc:2243] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.989291 24442 raft_consensus.cc:2272] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.992430 24442 tablet_replica.cc:333] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.993323 24442 raft_consensus.cc:2243] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:53.994563 24442 raft_consensus.cc:2272] T 1a1b7dead0a147dea07b2d34e4115450 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:53.998008 24442 tablet_replica.cc:333] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:53.998883 24442 raft_consensus.cc:2243] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:53.999720 24442 raft_consensus.cc:2272] T 0f2a77caa85940c69b005bbe1f44aa24 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.001842  3499 consensus_peers.cc:597] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.003782 24442 tablet_replica.cc:333] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:54.004580 24442 raft_consensus.cc:2243] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.005630 24442 raft_consensus.cc:2272] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.008502 24442 tablet_replica.cc:333] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:54.009167 24442 raft_consensus.cc:2243] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.009850 24442 raft_consensus.cc:2272] T 0112156b7a8745cba9f6703c5a971557 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.012706 24442 tablet_replica.cc:333] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:54.013386 24442 raft_consensus.cc:2243] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.014070 24442 raft_consensus.cc:2272] T d99b40b347c3420398a720ffae71441d P 575eb2eea84a4baa9c8c313e035a5b82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.016848 24442 tablet_replica.cc:333] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:54.017565 24442 raft_consensus.cc:2243] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.018496 24442 raft_consensus.cc:2272] T 607eba4852cc42f2bb44d6f949d08ee6 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.021844 24442 tablet_replica.cc:333] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:54.022758 24442 raft_consensus.cc:2243] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.023882 24442 raft_consensus.cc:2272] T 2e67404cef74429db91a817369b03ee8 P 575eb2eea84a4baa9c8c313e035a5b82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.027113 24442 tablet_replica.cc:333] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82: stopping tablet replica
I20260709 12:14:54.027721 24442 raft_consensus.cc:2243] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.028313 24442 raft_consensus.cc:2272] T 48c3855e15a24fe993d411300c2be843 P 575eb2eea84a4baa9c8c313e035a5b82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.083652 24442 tablet_server.cc:196] TabletServer@127.23.222.129:0 shutdown complete.
W20260709 12:14:54.088685  3499 consensus_peers.cc:597] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:44501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.141686 24442 tablet_server.cc:179] TabletServer@127.23.222.130:0 shutting down...
I20260709 12:14:54.192016 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:54.193065 24442 tablet_replica.cc:333] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.194130 24442 raft_consensus.cc:2243] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.195014 24442 raft_consensus.cc:2272] T 4493902ecfcb4156a321e2fef08ae8ff P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.198175 24442 tablet_replica.cc:333] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.199170 24442 raft_consensus.cc:2243] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.200178 24442 raft_consensus.cc:2272] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.203186 24442 tablet_replica.cc:333] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.203857 24442 raft_consensus.cc:2243] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.204574 24442 raft_consensus.cc:2272] T f993765c0fa14c729958199d2a7b9e16 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.208328 24442 tablet_replica.cc:333] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.209580 24442 raft_consensus.cc:2243] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.210805 24442 raft_consensus.cc:2272] T c9dcbe55854f403d91840add96b09644 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.210820  3499 consensus_peers.cc:597] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:44501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:54.213140  3499 consensus_peers.cc:597] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:44501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.213883 24442 tablet_replica.cc:333] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.214754 24442 raft_consensus.cc:2243] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.215729 24442 raft_consensus.cc:2272] T 1fb52a6c301c4ea499c94ee9ef5250dd P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.218698 24442 tablet_replica.cc:333] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.219337 24442 raft_consensus.cc:2243] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.219923 24442 raft_consensus.cc:2272] T 3b97c43244a447229566d16d6cf59b76 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.222978 24442 tablet_replica.cc:333] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.223852 24442 raft_consensus.cc:2243] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.224436 24442 raft_consensus.cc:2272] T 1a1b7dead0a147dea07b2d34e4115450 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.224805  3572 consensus_peers.cc:597] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 -> Peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Couldn't send request to peer 4e40ab447e46441593eca3776e0cf0b7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.227236 24442 tablet_replica.cc:333] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.228006 24442 raft_consensus.cc:2243] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.228592 24442 raft_consensus.cc:2272] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.232175 24442 tablet_replica.cc:333] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.232914 24442 raft_consensus.cc:2243] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.234170 24442 raft_consensus.cc:2272] T 0f2a77caa85940c69b005bbe1f44aa24 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:54.236172  3573 consensus_peers.cc:597] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:44501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:54.236845  3573 consensus_peers.cc:597] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:44501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.238112 24442 tablet_replica.cc:333] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.238879 24442 raft_consensus.cc:2243] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.239485 24442 raft_consensus.cc:2272] T 2e67404cef74429db91a817369b03ee8 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.242408 24442 tablet_replica.cc:333] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.243057 24442 raft_consensus.cc:2243] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.244129 24442 raft_consensus.cc:2272] T 48c3855e15a24fe993d411300c2be843 P 4e40ab447e46441593eca3776e0cf0b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.246821 24442 tablet_replica.cc:333] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.247429 24442 raft_consensus.cc:2243] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.247969 24442 raft_consensus.cc:2272] T e9dffe8f34ed415c854944a1c77c8993 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.250458 24442 tablet_replica.cc:333] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.251085 24442 raft_consensus.cc:2243] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.251600 24442 raft_consensus.cc:2272] T e9f188849ee344b3aa4ca0b680fedbda P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.254084 24442 tablet_replica.cc:333] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.255013 24442 raft_consensus.cc:2243] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.255585 24442 raft_consensus.cc:2272] T d52b992f53de440a9c609eb9a6787239 P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.257829 24442 tablet_replica.cc:333] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.258416 24442 raft_consensus.cc:2243] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.259290 24442 raft_consensus.cc:2272] T 0112156b7a8745cba9f6703c5a971557 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.262423 24442 tablet_replica.cc:333] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.263044 24442 raft_consensus.cc:2243] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.263571 24442 raft_consensus.cc:2272] T d99b40b347c3420398a720ffae71441d P 4e40ab447e46441593eca3776e0cf0b7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.266765 24442 tablet_replica.cc:333] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.267428 24442 raft_consensus.cc:2243] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.268452 24442 raft_consensus.cc:2272] T 607eba4852cc42f2bb44d6f949d08ee6 P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.271047 24442 tablet_replica.cc:333] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7: stopping tablet replica
I20260709 12:14:54.271586 24442 raft_consensus.cc:2243] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.272149 24442 raft_consensus.cc:2272] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 4e40ab447e46441593eca3776e0cf0b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.320438 24442 tablet_server.cc:196] TabletServer@127.23.222.130:0 shutdown complete.
I20260709 12:14:54.374753 24442 tablet_server.cc:179] TabletServer@127.23.222.131:0 shutting down...
W20260709 12:14:54.378346  3572 consensus_peers.cc:597] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 -> Peer 4e40ab447e46441593eca3776e0cf0b7 (127.23.222.130:44763): Couldn't send request to peer 4e40ab447e46441593eca3776e0cf0b7. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.130:44763: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:54.419883  3573 consensus_peers.cc:597] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 -> Peer 575eb2eea84a4baa9c8c313e035a5b82 (127.23.222.129:44501): Couldn't send request to peer 575eb2eea84a4baa9c8c313e035a5b82. Status: Network error: Client connection negotiation failed: client connection to 127.23.222.129:44501: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.450843 24442 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:54.451893 24442 tablet_replica.cc:333] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.453045 24442 raft_consensus.cc:2243] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.454543 24442 raft_consensus.cc:2272] T 4493902ecfcb4156a321e2fef08ae8ff P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.457304 24442 tablet_replica.cc:333] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.458323 24442 raft_consensus.cc:2243] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.458935 24442 raft_consensus.cc:2272] T c9dcbe55854f403d91840add96b09644 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.461613 24442 tablet_replica.cc:333] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.462363 24442 raft_consensus.cc:2243] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.462973 24442 raft_consensus.cc:2272] T 1a76b7cdd0574dd2b1a07bd1dfadd1d5 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.465637 24442 tablet_replica.cc:333] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.466245 24442 raft_consensus.cc:2243] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.466899 24442 raft_consensus.cc:2272] T f993765c0fa14c729958199d2a7b9e16 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.469316 24442 tablet_replica.cc:333] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.469908 24442 raft_consensus.cc:2243] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.470543 24442 raft_consensus.cc:2272] T 1fb52a6c301c4ea499c94ee9ef5250dd P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.472985 24442 tablet_replica.cc:333] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.473708 24442 raft_consensus.cc:2243] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.474251 24442 raft_consensus.cc:2272] T 2e67404cef74429db91a817369b03ee8 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.476742 24442 tablet_replica.cc:333] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.477332 24442 raft_consensus.cc:2243] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.477787 24442 raft_consensus.cc:2272] T 48c3855e15a24fe993d411300c2be843 P 48dadfe9d82c4b13b51c3459a4162531 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.480257 24442 tablet_replica.cc:333] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.480806 24442 raft_consensus.cc:2243] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.481242 24442 raft_consensus.cc:2272] T 0f2a77caa85940c69b005bbe1f44aa24 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.483805 24442 tablet_replica.cc:333] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.484447 24442 raft_consensus.cc:2243] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.485318 24442 raft_consensus.cc:2272] T e9dffe8f34ed415c854944a1c77c8993 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.488057 24442 tablet_replica.cc:333] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.488711 24442 raft_consensus.cc:2243] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.489248 24442 raft_consensus.cc:2272] T 9ded39d6e42647d7a8fa5dd7af444ad4 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.491976 24442 tablet_replica.cc:333] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.492739 24442 raft_consensus.cc:2243] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.493438 24442 raft_consensus.cc:2272] T 1a1b7dead0a147dea07b2d34e4115450 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.496086 24442 tablet_replica.cc:333] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.496632 24442 raft_consensus.cc:2243] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.497197 24442 raft_consensus.cc:2272] T 3b97c43244a447229566d16d6cf59b76 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.499944 24442 tablet_replica.cc:333] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.500515 24442 raft_consensus.cc:2243] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.501071 24442 raft_consensus.cc:2272] T 0112156b7a8745cba9f6703c5a971557 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.503784 24442 tablet_replica.cc:333] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.504371 24442 raft_consensus.cc:2243] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.505331 24442 raft_consensus.cc:2272] T d99b40b347c3420398a720ffae71441d P 48dadfe9d82c4b13b51c3459a4162531 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.508002 24442 tablet_replica.cc:333] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.508550 24442 raft_consensus.cc:2243] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.509050 24442 raft_consensus.cc:2272] T 607eba4852cc42f2bb44d6f949d08ee6 P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.511274 24442 tablet_replica.cc:333] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.512120 24442 raft_consensus.cc:2243] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.512903 24442 raft_consensus.cc:2272] T b376a0f3a02a45c4a3eab6cca6ff4a3b P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.515790 24442 tablet_replica.cc:333] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.516323 24442 raft_consensus.cc:2243] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.517261 24442 raft_consensus.cc:2272] T d52b992f53de440a9c609eb9a6787239 P 48dadfe9d82c4b13b51c3459a4162531 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.519878 24442 tablet_replica.cc:333] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531: stopping tablet replica
I20260709 12:14:54.520370 24442 raft_consensus.cc:2243] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:54.520866 24442 raft_consensus.cc:2272] T e9f188849ee344b3aa4ca0b680fedbda P 48dadfe9d82c4b13b51c3459a4162531 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.572057 24442 tablet_server.cc:196] TabletServer@127.23.222.131:0 shutdown complete.
I20260709 12:14:54.630702 24442 master.cc:562] Master@127.23.222.190:39105 shutting down...
I20260709 12:14:54.663601 24442 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:54.664484 24442 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:54.664927 24442 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5c0f76a841c243fbbadafc742bce6436: stopping tablet replica
I20260709 12:14:54.688676 24442 master.cc:584] Master@127.23.222.190:39105 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21387 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44684 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (399760 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:14:54.763055 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2250 messages since previous log ~33 seconds ago
I20260709 12:14:54.763351 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2250 messages since previous log ~33 seconds ago
I20260709 12:14:54.763561 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2247 messages since previous log ~33 seconds ago
I20260709 12:14:54.763790 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:14:54.764003 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:14:54.764236 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~206 seconds ago
I20260709 12:14:54.764523 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260709 12:14:54.764859 24442 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
